[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:15:48.736193 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:39517
I20260709 12:15:48.738010 18961 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:15:48.739193 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:48.758044 18970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:48.758131 18968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:48.758215 18967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.960584 18969 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:15:49.960745 18961 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:15:49.965893 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:49.966161 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:49.966331 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599349966309 us; error 0 us; skew 500 ppm
I20260709 12:15:49.967262 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:49.973534 18961 webserver.cc:533] Webserver started at http://127.18.132.126:35277/ using document root <none> and password file <none>
I20260709 12:15:49.974501 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:49.974728 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:49.975193 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:49.981894 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "365eb3c8958d40ba9e3818c477dd08ff"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-xbvc"
I20260709 12:15:49.990419 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.004s
I20260709 12:15:49.996341 18976 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:49.997653 18961 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:15:49.998070 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "365eb3c8958d40ba9e3818c477dd08ff"
format_stamp: "Formatted at 2026-07-09 12:15:49 on dist-test-slave-xbvc"
I20260709 12:15:49.998427 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.063915 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.065794 18961 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:15:50.066394 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.152323 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:39517
I20260709 12:15:50.152371 19027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:39517 every 8 connection(s)
I20260709 12:15:50.161530 19028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:50.185474 19028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff: Bootstrap starting.
I20260709 12:15:50.192461 19028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.194506 19028 log.cc:826] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff: Log is configured to *not* fsync() on all Append() calls
I20260709 12:15:50.199434 19028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff: No bootstrap required, opened a new log
I20260709 12:15:50.220551 19028 raft_consensus.cc:359] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365eb3c8958d40ba9e3818c477dd08ff" member_type: VOTER }
I20260709 12:15:50.221128 19028 raft_consensus.cc:385] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.221473 19028 raft_consensus.cc:740] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365eb3c8958d40ba9e3818c477dd08ff, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.222568 19028 consensus_queue.cc:260] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365eb3c8958d40ba9e3818c477dd08ff" member_type: VOTER }
I20260709 12:15:50.223057 19028 raft_consensus.cc:399] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:50.223392 19028 raft_consensus.cc:493] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:50.223783 19028 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.228179 19028 raft_consensus.cc:515] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365eb3c8958d40ba9e3818c477dd08ff" member_type: VOTER }
I20260709 12:15:50.228956 19028 leader_election.cc:304] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 365eb3c8958d40ba9e3818c477dd08ff; no voters: 
I20260709 12:15:50.230897 19028 leader_election.cc:290] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:50.231222 19031 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.234333 19031 raft_consensus.cc:697] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 1 LEADER]: Becoming Leader. State: Replica: 365eb3c8958d40ba9e3818c477dd08ff, State: Running, Role: LEADER
I20260709 12:15:50.235262 19031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365eb3c8958d40ba9e3818c477dd08ff" member_type: VOTER }
I20260709 12:15:50.236426 19028 sys_catalog.cc:565] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:50.247385 19033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 365eb3c8958d40ba9e3818c477dd08ff. Latest consensus state: current_term: 1 leader_uuid: "365eb3c8958d40ba9e3818c477dd08ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365eb3c8958d40ba9e3818c477dd08ff" member_type: VOTER } }
I20260709 12:15:50.247458 19032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "365eb3c8958d40ba9e3818c477dd08ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365eb3c8958d40ba9e3818c477dd08ff" member_type: VOTER } }
I20260709 12:15:50.248200 19033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:50.248206 19032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:50.252388 19041 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:50.265250 19041 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:50.268085 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:50.284934 19041 catalog_manager.cc:1383] Generated new cluster ID: 51cf24944dad46249b62970bb6da8b1e
I20260709 12:15:50.285241 19041 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:50.304138 19041 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:50.305848 19041 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:50.321347 19041 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff: Generated new TSK 0
I20260709 12:15:50.322395 19041 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:50.335022 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:50.344549 19050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.345557 19051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.351040 19053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.351257 18961 server_base.cc:1061] running on GCE node
I20260709 12:15:50.352226 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.352458 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.352705 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599350352681 us; error 0 us; skew 500 ppm
I20260709 12:15:50.353349 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.358326 18961 webserver.cc:533] Webserver started at http://127.18.132.65:36295/ using document root <none> and password file <none>
I20260709 12:15:50.358906 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.359126 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:50.359452 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:50.360720 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "7a1e43cba24a409aa172566e8f55b4c4"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-xbvc"
I20260709 12:15:50.367048 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:15:50.371644 19058 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.372509 18961 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:50.372828 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "7a1e43cba24a409aa172566e8f55b4c4"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-xbvc"
I20260709 12:15:50.373155 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.401504 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.403057 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.406278 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:50.410848 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:50.411108 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.411377 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:50.411592 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.526948 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:43479
I20260709 12:15:50.527009 19120 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:43479 every 8 connection(s)
I20260709 12:15:50.535045 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:50.549129 19125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.551928 19126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.558992 19128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.560827 18961 server_base.cc:1061] running on GCE node
I20260709 12:15:50.561972 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.562278 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.562510 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599350562488 us; error 0 us; skew 500 ppm
I20260709 12:15:50.563308 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.567765 19121 heartbeater.cc:344] Connected to a master server at 127.18.132.126:39517
I20260709 12:15:50.568292 19121 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:50.569609 19121 heartbeater.cc:507] Master 127.18.132.126:39517 requested a full tablet report, sending...
I20260709 12:15:50.569721 18961 webserver.cc:533] Webserver started at http://127.18.132.66:37041/ using document root <none> and password file <none>
I20260709 12:15:50.570272 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.570451 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:50.570667 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:50.572086 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-xbvc"
I20260709 12:15:50.573619 18993 ts_manager.cc:194] Registered new tserver with Master: 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479)
I20260709 12:15:50.577052 18993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55784
I20260709 12:15:50.580901 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:50.585736 19133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.586627 18961 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:50.586906 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-xbvc"
I20260709 12:15:50.587175 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.612323 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.613754 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.616647 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:50.620384 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:50.620569 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.620859 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:50.621021 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.738363 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:42039
I20260709 12:15:50.738648 19195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:42039 every 8 connection(s)
I20260709 12:15:50.746323 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:50.754153 19199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.756176 19200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.763592 19196 heartbeater.cc:344] Connected to a master server at 127.18.132.126:39517
I20260709 12:15:50.764029 19196 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:50.765025 19196 heartbeater.cc:507] Master 127.18.132.126:39517 requested a full tablet report, sending...
I20260709 12:15:50.767501 18993 ts_manager.cc:194] Registered new tserver with Master: ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:50.770761 18961 server_base.cc:1061] running on GCE node
I20260709 12:15:50.770781 18993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55794
W20260709 12:15:50.775207 19203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.776193 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.776427 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.776609 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599350776588 us; error 0 us; skew 500 ppm
I20260709 12:15:50.777196 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.780107 18961 webserver.cc:533] Webserver started at http://127.18.132.67:42941/ using document root <none> and password file <none>
I20260709 12:15:50.780597 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.780807 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:50.781071 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:50.782157 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "f894d45a70a94c4e9092d26943e2a058"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-xbvc"
I20260709 12:15:50.787388 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:15:50.791227 19207 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.792135 18961 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:50.792418 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "f894d45a70a94c4e9092d26943e2a058"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-xbvc"
I20260709 12:15:50.792701 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.808655 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.809950 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.812691 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:50.815807 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:50.815984 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.816282 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:50.816447 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.930352 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:42585
I20260709 12:15:50.930433 19269 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:42585 every 8 connection(s)
I20260709 12:15:50.949862 19270 heartbeater.cc:344] Connected to a master server at 127.18.132.126:39517
I20260709 12:15:50.950258 19270 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:50.951112 19270 heartbeater.cc:507] Master 127.18.132.126:39517 requested a full tablet report, sending...
I20260709 12:15:50.953401 18993 ts_manager.cc:194] Registered new tserver with Master: f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:50.954141 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017623524s
I20260709 12:15:50.955231 18993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55810
I20260709 12:15:51.021883 18993 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:51.027421 18993 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:51.136940 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbe561003b14b75b4a8f3393823b452 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:51.138358 19084 tablet_service.cc:1511] Processing CreateTablet for tablet 4783a101c3e64eccaf31160acf9614be (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:51.139899 19083 tablet_service.cc:1511] Processing CreateTablet for tablet 933d759bff134734adbfe59134116005 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:51.140437 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783a101c3e64eccaf31160acf9614be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.140940 19086 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8636526b9645ec8121c2c5c7014769 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:51.142506 19086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8636526b9645ec8121c2c5c7014769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.146485 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbe561003b14b75b4a8f3393823b452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.147540 19083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 933d759bff134734adbfe59134116005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.144783 19082 tablet_service.cc:1511] Processing CreateTablet for tablet 38976202940b4a6597bcee5d9d6fc4ad (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:51.150938 19082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38976202940b4a6597bcee5d9d6fc4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.157253 19081 tablet_service.cc:1511] Processing CreateTablet for tablet c984a5b3b9ec4b5fb7f5d55721a9279f (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:51.159124 19081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c984a5b3b9ec4b5fb7f5d55721a9279f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.169528 19080 tablet_service.cc:1511] Processing CreateTablet for tablet 489547a53e9f42039075714ed2b34dab (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:51.171029 19080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489547a53e9f42039075714ed2b34dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.174235 19079 tablet_service.cc:1511] Processing CreateTablet for tablet cc235deec39a42aba7f1b38bceafc3c0 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:51.175894 19079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc235deec39a42aba7f1b38bceafc3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.181195 19078 tablet_service.cc:1511] Processing CreateTablet for tablet 175512c7a06742a99e93ebad63b41cf6 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:51.182788 19078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175512c7a06742a99e93ebad63b41cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.229698 19234 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbe561003b14b75b4a8f3393823b452 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:51.232748 19234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbe561003b14b75b4a8f3393823b452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.246119 19233 tablet_service.cc:1511] Processing CreateTablet for tablet 4783a101c3e64eccaf31160acf9614be (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:51.234601 19235 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8636526b9645ec8121c2c5c7014769 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:51.249924 19232 tablet_service.cc:1511] Processing CreateTablet for tablet 933d759bff134734adbfe59134116005 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:51.252743 19231 tablet_service.cc:1511] Processing CreateTablet for tablet 38976202940b4a6597bcee5d9d6fc4ad (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:51.256667 19235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8636526b9645ec8121c2c5c7014769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.263767 19227 tablet_service.cc:1511] Processing CreateTablet for tablet 175512c7a06742a99e93ebad63b41cf6 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:51.265375 19228 tablet_service.cc:1511] Processing CreateTablet for tablet cc235deec39a42aba7f1b38bceafc3c0 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:51.266180 19230 tablet_service.cc:1511] Processing CreateTablet for tablet c984a5b3b9ec4b5fb7f5d55721a9279f (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 12:15:51.268028 19040 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:51.269829 19229 tablet_service.cc:1511] Processing CreateTablet for tablet 489547a53e9f42039075714ed2b34dab (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:51.277015 19233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783a101c3e64eccaf31160acf9614be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.278270 19288 tablet_bootstrap.cc:492] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.281900 19231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38976202940b4a6597bcee5d9d6fc4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.285779 19229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489547a53e9f42039075714ed2b34dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.287577 19160 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbe561003b14b75b4a8f3393823b452 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:51.294965 19160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbe561003b14b75b4a8f3393823b452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.293094 19159 tablet_service.cc:1511] Processing CreateTablet for tablet 4783a101c3e64eccaf31160acf9614be (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:51.293730 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175512c7a06742a99e93ebad63b41cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.285806 19161 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8636526b9645ec8121c2c5c7014769 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:51.300467 19157 tablet_service.cc:1511] Processing CreateTablet for tablet 38976202940b4a6597bcee5d9d6fc4ad (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:51.305452 19232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 933d759bff134734adbfe59134116005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.306965 19161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8636526b9645ec8121c2c5c7014769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.306069 19156 tablet_service.cc:1511] Processing CreateTablet for tablet c984a5b3b9ec4b5fb7f5d55721a9279f (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:51.303993 19158 tablet_service.cc:1511] Processing CreateTablet for tablet 933d759bff134734adbfe59134116005 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:51.316515 19155 tablet_service.cc:1511] Processing CreateTablet for tablet 489547a53e9f42039075714ed2b34dab (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:51.317828 19228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc235deec39a42aba7f1b38bceafc3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.315069 19159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783a101c3e64eccaf31160acf9614be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.322283 19155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489547a53e9f42039075714ed2b34dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.323074 19156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c984a5b3b9ec4b5fb7f5d55721a9279f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.324676 19230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c984a5b3b9ec4b5fb7f5d55721a9279f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.325783 19158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 933d759bff134734adbfe59134116005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.328045 19154 tablet_service.cc:1511] Processing CreateTablet for tablet cc235deec39a42aba7f1b38bceafc3c0 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:51.330250 19157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38976202940b4a6597bcee5d9d6fc4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.333374 19154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc235deec39a42aba7f1b38bceafc3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.336918 19153 tablet_service.cc:1511] Processing CreateTablet for tablet 175512c7a06742a99e93ebad63b41cf6 (DEFAULT_TABLE table=test-workload [id=48e5f111f1ae41b4b14e6aa3ce9c279a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:51.340173 19153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175512c7a06742a99e93ebad63b41cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.361519 19288 tablet_bootstrap.cc:654] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.390815 19289 tablet_bootstrap.cc:492] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.439532 19290 tablet_bootstrap.cc:492] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.446488 19289 tablet_bootstrap.cc:654] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.460263 19288 tablet_bootstrap.cc:492] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.460840 19288 ts_tablet_manager.cc:1403] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.020s
I20260709 12:15:51.483495 19288 raft_consensus.cc:359] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.485217 19288 raft_consensus.cc:385] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.485551 19288 raft_consensus.cc:740] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.487527 19290 tablet_bootstrap.cc:654] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.489526 19288 consensus_queue.cc:260] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.490480 19289 tablet_bootstrap.cc:492] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.490968 19289 ts_tablet_manager.cc:1403] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.009s
I20260709 12:15:51.494590 19289 raft_consensus.cc:359] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.495280 19289 raft_consensus.cc:385] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.495678 19289 raft_consensus.cc:740] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.496450 19289 consensus_queue.cc:260] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.501132 19121 heartbeater.cc:499] Master 127.18.132.126:39517 was elected leader, sending a full tablet report...
I20260709 12:15:51.501394 19290 tablet_bootstrap.cc:492] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.501909 19290 ts_tablet_manager.cc:1403] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.010s
I20260709 12:15:51.502140 19288 ts_tablet_manager.cc:1434] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.014s
I20260709 12:15:51.503201 19288 tablet_bootstrap.cc:492] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.508623 19290 raft_consensus.cc:359] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.509389 19290 raft_consensus.cc:385] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.509675 19290 raft_consensus.cc:740] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.510484 19290 consensus_queue.cc:260] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.510139 19288 tablet_bootstrap.cc:654] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.511709 19270 heartbeater.cc:499] Master 127.18.132.126:39517 was elected leader, sending a full tablet report...
I20260709 12:15:51.512094 19289 ts_tablet_manager.cc:1434] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.021s	user 0.018s	sys 0.004s
I20260709 12:15:51.513043 19289 tablet_bootstrap.cc:492] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.519381 19196 heartbeater.cc:499] Master 127.18.132.126:39517 was elected leader, sending a full tablet report...
I20260709 12:15:51.520097 19290 ts_tablet_manager.cc:1434] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:15:51.521389 19290 tablet_bootstrap.cc:492] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.523275 19288 tablet_bootstrap.cc:492] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.523699 19289 tablet_bootstrap.cc:654] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.523800 19288 ts_tablet_manager.cc:1403] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:15:51.527266 19288 raft_consensus.cc:359] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:51.528060 19288 raft_consensus.cc:385] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.528426 19290 tablet_bootstrap.cc:654] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.528414 19288 raft_consensus.cc:740] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.529349 19288 consensus_queue.cc:260] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:51.532186 19288 ts_tablet_manager.cc:1434] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:51.533365 19288 tablet_bootstrap.cc:492] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
W20260709 12:15:51.534794 19122 tablet.cc:2406] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:51.541368 19290 tablet_bootstrap.cc:492] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.541917 19290 ts_tablet_manager.cc:1403] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:15:51.544122 19288 tablet_bootstrap.cc:654] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.544608 19289 tablet_bootstrap.cc:492] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.545095 19289 ts_tablet_manager.cc:1403] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.021s
I20260709 12:15:51.545989 19290 raft_consensus.cc:359] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.546775 19290 raft_consensus.cc:385] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.547114 19290 raft_consensus.cc:740] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.548309 19289 raft_consensus.cc:359] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.548378 19290 consensus_queue.cc:260] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.549226 19289 raft_consensus.cc:385] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.549597 19289 raft_consensus.cc:740] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.550436 19289 consensus_queue.cc:260] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.551625 19290 ts_tablet_manager.cc:1434] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:15:51.552847 19290 tablet_bootstrap.cc:492] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.553011 19289 ts_tablet_manager.cc:1434] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:51.554028 19289 tablet_bootstrap.cc:492] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.558001 19288 tablet_bootstrap.cc:492] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.558609 19288 ts_tablet_manager.cc:1403] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.011s
I20260709 12:15:51.561199 19289 tablet_bootstrap.cc:654] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.561277 19290 tablet_bootstrap.cc:654] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.562894 19288 raft_consensus.cc:359] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.563781 19288 raft_consensus.cc:385] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.564147 19288 raft_consensus.cc:740] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.567169 19288 consensus_queue.cc:260] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.570694 19288 ts_tablet_manager.cc:1434] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:15:51.571954 19288 tablet_bootstrap.cc:492] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.573899 19290 tablet_bootstrap.cc:492] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.574391 19290 ts_tablet_manager.cc:1403] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:15:51.574550 19289 tablet_bootstrap.cc:492] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.575027 19289 ts_tablet_manager.cc:1403] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:15:51.578001 19290 raft_consensus.cc:359] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.578773 19290 raft_consensus.cc:385] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.579102 19290 raft_consensus.cc:740] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.578152 19289 raft_consensus.cc:359] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.580047 19290 consensus_queue.cc:260] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.580520 19288 tablet_bootstrap.cc:654] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.580641 19289 raft_consensus.cc:385] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.581079 19289 raft_consensus.cc:740] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.581889 19289 consensus_queue.cc:260] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.582674 19290 ts_tablet_manager.cc:1434] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:51.583750 19290 tablet_bootstrap.cc:492] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.584410 19289 ts_tablet_manager.cc:1434] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 12:15:51.585361 19289 tablet_bootstrap.cc:492] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.592244 19289 tablet_bootstrap.cc:654] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.592267 19290 tablet_bootstrap.cc:654] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.595768 19288 tablet_bootstrap.cc:492] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.596344 19288 ts_tablet_manager.cc:1403] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 12:15:51.598524 19296 raft_consensus.cc:493] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.599028 19296 raft_consensus.cc:515] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.600503 19288 raft_consensus.cc:359] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.601243 19288 raft_consensus.cc:385] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.601583 19288 raft_consensus.cc:740] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.602398 19296 leader_election.cc:290] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.602391 19288 consensus_queue.cc:260] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.604748 19289 tablet_bootstrap.cc:492] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.605235 19289 ts_tablet_manager.cc:1403] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:15:51.606436 19288 ts_tablet_manager.cc:1434] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:51.608453 19288 tablet_bootstrap.cc:492] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.608841 19289 raft_consensus.cc:359] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.609817 19289 raft_consensus.cc:385] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.610190 19289 raft_consensus.cc:740] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.617125 19288 tablet_bootstrap.cc:654] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.620465 19290 tablet_bootstrap.cc:492] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.621080 19290 ts_tablet_manager.cc:1403] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.011s
I20260709 12:15:51.611202 19289 consensus_queue.cc:260] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.624953 19290 raft_consensus.cc:359] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.626552 19289 ts_tablet_manager.cc:1434] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:15:51.628096 19289 tablet_bootstrap.cc:492] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.625927 19290 raft_consensus.cc:385] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.629067 19290 raft_consensus.cc:740] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.631621 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175512c7a06742a99e93ebad63b41cf6" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
W20260709 12:15:51.634258 19136 leader_election.cc:343] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.630059 19290 consensus_queue.cc:260] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.637084 19290 ts_tablet_manager.cc:1434] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:15:51.638197 19290 tablet_bootstrap.cc:492] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.638710 19289 tablet_bootstrap.cc:654] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.638197 19288 tablet_bootstrap.cc:492] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.639273 19288 ts_tablet_manager.cc:1403] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:15:51.647505 19288 raft_consensus.cc:359] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.648907 19288 raft_consensus.cc:385] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.649354 19288 raft_consensus.cc:740] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.650390 19288 consensus_queue.cc:260] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.657343 19288 ts_tablet_manager.cc:1434] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:15:51.658735 19288 tablet_bootstrap.cc:492] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.666440 19296 raft_consensus.cc:493] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.667102 19296 raft_consensus.cc:515] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.670759 19296 leader_election.cc:290] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.670801 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.671737 19290 tablet_bootstrap.cc:654] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.672039 19096 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.673606 19136 leader_election.cc:304] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:51.674504 19296 raft_consensus.cc:2804] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.675035 19296 raft_consensus.cc:493] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.675417 19296 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.683415 19296 raft_consensus.cc:515] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.684625 19295 raft_consensus.cc:493] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.685334 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175512c7a06742a99e93ebad63b41cf6" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:51.685173 19295 raft_consensus.cc:515] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.685742 19296 leader_election.cc:290] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.686496 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:51.687052 19096 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.687162 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:51.688537 19244 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.689649 19289 tablet_bootstrap.cc:492] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.690148 19295 leader_election.cc:290] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
W20260709 12:15:51.694722 19134 leader_election.cc:343] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.695188 19134 leader_election.cc:304] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e; no voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:51.691901 19289 ts_tablet_manager.cc:1403] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.017s
I20260709 12:15:51.698136 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:51.698735 19244 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.701288 19288 tablet_bootstrap.cc:654] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.703936 19296 raft_consensus.cc:2749] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:51.705714 19289 raft_consensus.cc:359] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.706581 19289 raft_consensus.cc:385] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.706957 19289 raft_consensus.cc:740] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.707962 19289 consensus_queue.cc:260] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.710561 19096 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:51.713259 19136 leader_election.cc:304] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:51.714028 19296 raft_consensus.cc:2804] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:51.712069 19244 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:51.722977 19296 raft_consensus.cc:697] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:51.723891 19290 tablet_bootstrap.cc:492] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.724524 19290 ts_tablet_manager.cc:1403] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.003s
I20260709 12:15:51.725339 19314 raft_consensus.cc:493] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.725867 19314 raft_consensus.cc:515] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.728438 19314 leader_election.cc:290] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.723943 19296 consensus_queue.cc:237] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.729481 19289 ts_tablet_manager.cc:1434] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 12:15:51.736713 19288 tablet_bootstrap.cc:492] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.737250 19288 ts_tablet_manager.cc:1403] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.001s
I20260709 12:15:51.738910 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.739854 19095 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 0.
I20260709 12:15:51.741276 19294 raft_consensus.cc:493] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.741592 19210 leader_election.cc:304] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:51.741825 19294 raft_consensus.cc:515] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:51.743815 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.745136 19096 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.745615 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:51.746688 19244 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.748847 19134 leader_election.cc:304] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:51.749461 19295 raft_consensus.cc:2804] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.752825 19295 raft_consensus.cc:493] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.753362 19295 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.754164 19315 raft_consensus.cc:2804] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.756989 19315 raft_consensus.cc:493] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.757401 19315 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.757606 19288 raft_consensus.cc:359] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.758397 19288 raft_consensus.cc:385] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.758689 19288 raft_consensus.cc:740] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.759697 19294 leader_election.cc:290] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:51.760924 19288 consensus_queue.cc:260] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.762301 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:15:51.764030 19288 ts_tablet_manager.cc:1434] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 12:15:51.765043 19288 tablet_bootstrap.cc:492] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.765551 19295 raft_consensus.cc:515] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.768566 19290 raft_consensus.cc:359] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.769413 19290 raft_consensus.cc:385] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.769717 19290 raft_consensus.cc:740] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.771944 19289 tablet_bootstrap.cc:492] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.772531 19288 tablet_bootstrap.cc:654] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.779522 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
W20260709 12:15:51.781251 19062 leader_election.cc:343] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.781889 19289 tablet_bootstrap.cc:654] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.784768 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:51.785084 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:51.784307 18992 catalog_manager.cc:5697] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 0 to 1, leader changed from <none> to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 1 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:51.785521 19096 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.789834 19295 leader_election.cc:290] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:51.770545 19290 consensus_queue.cc:260] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.792165 19290 ts_tablet_manager.cc:1434] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:15:51.793191 19290 tablet_bootstrap.cc:492] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.793627 19096 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 1.
I20260709 12:15:51.795059 19210 leader_election.cc:304] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:15:51.796005 19295 raft_consensus.cc:2804] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:51.799002 19288 tablet_bootstrap.cc:492] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.799643 19288 ts_tablet_manager.cc:1403] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.004s
I20260709 12:15:51.800338 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
W20260709 12:15:51.801811 19059 leader_election.cc:343] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.802250 19059 leader_election.cc:304] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4; no voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:51.803102 19294 raft_consensus.cc:2749] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:51.805145 19288 raft_consensus.cc:359] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.806054 19288 raft_consensus.cc:385] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.806421 19288 raft_consensus.cc:740] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.807113 19290 tablet_bootstrap.cc:654] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.807476 19288 consensus_queue.cc:260] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.810616 19315 raft_consensus.cc:515] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.814242 19171 raft_consensus.cc:2393] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f894d45a70a94c4e9092d26943e2a058 in current term 1: Already voted for candidate ee3bc233cb5b4745adbf37caf5834d0e in this term.
I20260709 12:15:51.823918 19288 ts_tablet_manager.cc:1434] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 12:15:51.824949 19288 tablet_bootstrap.cc:492] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.826172 19295 raft_consensus.cc:697] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:15:51.827170 19295 consensus_queue.cc:237] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.827734 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:51.827906 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:51.828550 19096 raft_consensus.cc:2393] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee3bc233cb5b4745adbf37caf5834d0e in current term 1: Already voted for candidate f894d45a70a94c4e9092d26943e2a058 in this term.
I20260709 12:15:51.829888 19136 leader_election.cc:304] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e; no voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:51.830365 19315 leader_election.cc:290] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.830816 19314 raft_consensus.cc:2749] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:51.836063 19321 raft_consensus.cc:493] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.843731 19288 tablet_bootstrap.cc:654] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.848889 19315 raft_consensus.cc:493] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.849454 19315 raft_consensus.cc:515] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.852514 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.852810 19315 leader_election.cc:290] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.854509 19096 raft_consensus.cc:2468] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.856618 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:51.858274 19136 leader_election.cc:304] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:51.863775 19289 tablet_bootstrap.cc:492] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.864423 19289 ts_tablet_manager.cc:1403] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.002s
I20260709 12:15:51.866142 19288 tablet_bootstrap.cc:492] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.866776 19288 ts_tablet_manager.cc:1403] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.011s
I20260709 12:15:51.868475 19314 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.867497 18992 catalog_manager.cc:5697] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 0 to 1, leader changed from <none> to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:51.868255 19315 raft_consensus.cc:2804] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.847903 19321 raft_consensus.cc:515] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.871842 19315 raft_consensus.cc:493] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.869359 19314 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.872390 19315 raft_consensus.cc:3060] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.872745 19244 raft_consensus.cc:2468] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.873991 19290 tablet_bootstrap.cc:492] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.874141 19314 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.874508 19290 ts_tablet_manager.cc:1403] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.007s
I20260709 12:15:51.875699 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.876410 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:51.876228 19289 raft_consensus.cc:359] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.877439 19289 raft_consensus.cc:385] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.877837 19289 raft_consensus.cc:740] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.877686 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.877802 19290 raft_consensus.cc:359] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.876103 19321 leader_election.cc:290] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:51.878520 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:15:51.878602 19290 raft_consensus.cc:385] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.878675 19095 raft_consensus.cc:2468] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 0.
I20260709 12:15:51.879653 19290 raft_consensus.cc:740] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
W20260709 12:15:51.879906 19134 leader_election.cc:343] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.879864 19289 consensus_queue.cc:260] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.880645 19210 leader_election.cc:304] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:51.880481 19290 consensus_queue.cc:260] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.882094 19295 raft_consensus.cc:2804] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.882535 19289 ts_tablet_manager.cc:1434] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:15:51.882817 19290 ts_tablet_manager.cc:1434] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:51.882700 19295 raft_consensus.cc:493] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.883327 19295 raft_consensus.cc:3060] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.884369 19290 tablet_bootstrap.cc:492] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.883630 19289 tablet_bootstrap.cc:492] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:51.871382 19288 raft_consensus.cc:359] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.888672 19288 raft_consensus.cc:385] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.888998 19288 raft_consensus.cc:740] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.889751 19288 consensus_queue.cc:260] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.890683 19096 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:51.892629 19290 tablet_bootstrap.cc:654] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.892282 19288 ts_tablet_manager.cc:1434] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:15:51.895527 19288 tablet_bootstrap.cc:492] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4: Bootstrap starting.
I20260709 12:15:51.895370 19136 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:51.899376 19314 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.899873 19314 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.901279 19314 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.905144 19290 tablet_bootstrap.cc:492] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.905656 19290 ts_tablet_manager.cc:1403] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:15:51.908291 19315 raft_consensus.cc:515] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.908658 19290 raft_consensus.cc:359] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.909336 19290 raft_consensus.cc:385] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.909663 19171 raft_consensus.cc:2393] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f894d45a70a94c4e9092d26943e2a058 in current term 1: Already voted for candidate ee3bc233cb5b4745adbf37caf5834d0e in this term.
I20260709 12:15:51.909637 19290 raft_consensus.cc:740] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.910584 19290 consensus_queue.cc:260] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.913334 19290 ts_tablet_manager.cc:1434] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:51.913192 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:51.913806 19096 raft_consensus.cc:3060] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.914331 19290 tablet_bootstrap.cc:492] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:51.917245 19289 tablet_bootstrap.cc:654] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.921564 19290 tablet_bootstrap.cc:654] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.921451 19096 raft_consensus.cc:2468] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:51.922955 19136 leader_election.cc:304] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:51.923877 19296 raft_consensus.cc:2804] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:51.925284 19288 tablet_bootstrap.cc:654] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.926046 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:51.927526 19315 leader_election.cc:290] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.928243 19294 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.928740 19294 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.930965 19294 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.932072 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:51.932772 19245 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 0.
I20260709 12:15:51.934563 19059 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:51.934849 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
W20260709 12:15:51.936807 19062 leader_election.cc:343] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.937630 19332 raft_consensus.cc:2804] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:51.909791 19314 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.938066 19332 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.942356 19332 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:51.944236 19314 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.945581 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:51.946031 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:51.946247 19096 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:51.947546 19134 leader_election.cc:343] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:51.950207 19296 raft_consensus.cc:697] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:51.951256 19296 consensus_queue.cc:237] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.954207 19290 tablet_bootstrap.cc:492] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:51.954591 19288 tablet_bootstrap.cc:492] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4: No bootstrap required, opened a new log
I20260709 12:15:51.954742 19290 ts_tablet_manager.cc:1403] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.008s
I20260709 12:15:51.954948 19096 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:51.955192 19288 ts_tablet_manager.cc:1403] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.004s
I20260709 12:15:51.940714 19295 raft_consensus.cc:515] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.956679 19244 raft_consensus.cc:2393] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee3bc233cb5b4745adbf37caf5834d0e in current term 1: Already voted for candidate f894d45a70a94c4e9092d26943e2a058 in this term.
I20260709 12:15:51.957998 19290 raft_consensus.cc:359] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:51.958781 19290 raft_consensus.cc:385] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.958794 19295 leader_election.cc:290] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:51.958279 19288 raft_consensus.cc:359] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.959641 19288 raft_consensus.cc:385] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.959931 19288 raft_consensus.cc:740] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.960511 19136 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:51.960683 19288 consensus_queue.cc:260] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.961663 19330 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:51.962432 19330 raft_consensus.cc:697] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:51.959745 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:51.964105 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38976202940b4a6597bcee5d9d6fc4ad" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:51.963434 19330 consensus_queue.cc:237] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.965418 19289 tablet_bootstrap.cc:492] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:51.965996 19289 ts_tablet_manager.cc:1403] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.004s
I20260709 12:15:51.964972 19096 raft_consensus.cc:2393] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f894d45a70a94c4e9092d26943e2a058 in current term 1: Already voted for candidate ee3bc233cb5b4745adbf37caf5834d0e in this term.
I20260709 12:15:51.966452 19332 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.967473 19210 leader_election.cc:304] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:15:51.959272 19290 raft_consensus.cc:740] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.969187 19289 raft_consensus.cc:359] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:51.969907 19289 raft_consensus.cc:385] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:51.970223 19289 raft_consensus.cc:740] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:51.996735 19296 raft_consensus.cc:493] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.973172 19294 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.999881 19294 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.003151 19288 ts_tablet_manager.cc:1434] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 12:15:52.002420 18991 catalog_manager.cc:5697] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 0 to 1, leader changed from <none> to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 1 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:51.999224 19296 raft_consensus.cc:515] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.999230 19289 consensus_queue.cc:260] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.005885 19296 leader_election.cc:290] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.006350 19289 ts_tablet_manager.cc:1434] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:15:52.006731 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:51.975011 19332 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:51.971081 19290 consensus_queue.cc:260] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.007498 19289 tablet_bootstrap.cc:492] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:52.007412 19096 raft_consensus.cc:2468] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:52.008858 19136 leader_election.cc:304] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:52.009632 19296 raft_consensus.cc:2804] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.010007 19296 raft_consensus.cc:493] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.010380 19296 raft_consensus.cc:3060] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.015678 19290 ts_tablet_manager.cc:1434] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.054s	user 0.012s	sys 0.010s
I20260709 12:15:52.016683 19290 tablet_bootstrap.cc:492] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: Bootstrap starting.
I20260709 12:15:52.017640 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:52.018321 19245 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 0.
I20260709 12:15:52.019629 19059 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:51.970880 19295 raft_consensus.cc:2749] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.022291 19296 raft_consensus.cc:515] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:51.975154 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.024295 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:52.024605 19296 leader_election.cc:290] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.024997 19245 raft_consensus.cc:2468] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:52.025315 19332 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.025111 19244 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.025831 19332 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.026356 19332 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.032332 19294 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.035003 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:52.036273 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:52.036631 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:15:52.036293 19096 raft_consensus.cc:3060] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.037284 19170 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 0.
I20260709 12:15:52.037302 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.039373 19244 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 1.
W20260709 12:15:52.040274 19062 leader_election.cc:343] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.038867 19245 raft_consensus.cc:3060] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.045276 19289 tablet_bootstrap.cc:654] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.045132 19096 raft_consensus.cc:2468] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:52.048821 19059 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:15:52.050240 19136 leader_election.cc:304] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:52.051317 19330 raft_consensus.cc:2804] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.051517 19294 raft_consensus.cc:2804] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.050760 19245 raft_consensus.cc:2468] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:52.050285 18991 catalog_manager.cc:5697] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 0 to 1, leader changed from <none> to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 1 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.052104 19294 raft_consensus.cc:697] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:52.054389 19294 consensus_queue.cc:237] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.055660 19290 tablet_bootstrap.cc:654] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.051864 19330 raft_consensus.cc:697] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:52.051479 19332 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.058580 19330 consensus_queue.cc:237] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.061913 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:52.062539 19170 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.068267 19289 tablet_bootstrap.cc:492] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:52.068887 19289 ts_tablet_manager.cc:1403] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.003s
I20260709 12:15:52.072690 19170 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 1.
I20260709 12:15:52.074117 19062 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:52.074657 19332 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 1 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.075309 19332 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.075871 19332 raft_consensus.cc:697] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:52.076383 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.077078 19245 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.073087 19289 raft_consensus.cc:359] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.078446 19289 raft_consensus.cc:385] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.078809 19289 raft_consensus.cc:740] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.084108 19289 consensus_queue.cc:260] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.085884 19290 tablet_bootstrap.cc:492] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: No bootstrap required, opened a new log
I20260709 12:15:52.086421 19290 ts_tablet_manager.cc:1403] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.004s
I20260709 12:15:52.086702 19289 ts_tablet_manager.cc:1434] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:15:52.087721 19289 tablet_bootstrap.cc:492] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058: Bootstrap starting.
I20260709 12:15:52.088413 18991 catalog_manager.cc:5697] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.088474 18992 catalog_manager.cc:5697] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 0 to 1, leader changed from <none> to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 1 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.093475 19245 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 1.
I20260709 12:15:52.099045 19289 tablet_bootstrap.cc:654] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.076851 19332 consensus_queue.cc:237] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.107414 19290 raft_consensus.cc:359] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.108268 19290 raft_consensus.cc:385] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.108597 19290 raft_consensus.cc:740] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.109395 19290 consensus_queue.cc:260] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.120754 19290 ts_tablet_manager.cc:1434] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:15:52.126295 19289 tablet_bootstrap.cc:492] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058: No bootstrap required, opened a new log
I20260709 12:15:52.126911 19289 ts_tablet_manager.cc:1403] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.009s
I20260709 12:15:52.126786 18991 catalog_manager.cc:5697] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.129815 19289 raft_consensus.cc:359] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.131104 19289 raft_consensus.cc:385] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.131387 19289 raft_consensus.cc:740] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.132134 19289 consensus_queue.cc:260] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.134451 19289 ts_tablet_manager.cc:1434] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:52.146632 19330 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.147111 19330 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.148811 19330 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.149771 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:52.149957 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:52.150856 19245 raft_consensus.cc:2393] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee3bc233cb5b4745adbf37caf5834d0e in current term 1: Already voted for candidate 7a1e43cba24a409aa172566e8f55b4c4 in this term.
I20260709 12:15:52.151845 19134 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e; no voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:52.152505 19330 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.160991 19330 raft_consensus.cc:2749] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.182400 19330 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.189932 19330 raft_consensus.cc:493] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.191761 19330 raft_consensus.cc:515] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.194128 19330 leader_election.cc:290] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.195699 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:15:52.196388 19245 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:52.196681 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:52.197613 19095 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 0.
I20260709 12:15:52.198097 19134 leader_election.cc:304] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:52.199149 19330 raft_consensus.cc:2804] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.199555 19330 raft_consensus.cc:493] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.199944 19330 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.204897 19295 raft_consensus.cc:493] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.205384 19295 raft_consensus.cc:515] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.207746 19295 leader_election.cc:290] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:52.213399 19296 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.208518 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175512c7a06742a99e93ebad63b41cf6" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:52.215143 19095 raft_consensus.cc:2468] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 0.
I20260709 12:15:52.208997 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175512c7a06742a99e93ebad63b41cf6" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:15:52.216171 19170 raft_consensus.cc:2468] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 0.
I20260709 12:15:52.207142 19330 raft_consensus.cc:515] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.217887 19211 leader_election.cc:304] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:52.218750 19295 raft_consensus.cc:2804] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.219214 19295 raft_consensus.cc:493] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.219789 19295 raft_consensus.cc:3060] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.229842 19330 leader_election.cc:290] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.230444 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:52.231163 19095 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.232359 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.232973 19244 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.233171 19295 raft_consensus.cc:515] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.235975 19295 leader_election.cc:290] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:52.236117 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175512c7a06742a99e93ebad63b41cf6" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:52.236738 19096 raft_consensus.cc:3060] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.240550 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175512c7a06742a99e93ebad63b41cf6" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:52.241125 19170 raft_consensus.cc:3060] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.246984 19244 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:52.248297 19134 leader_election.cc:304] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:52.249333 19330 raft_consensus.cc:2804] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.249915 19330 raft_consensus.cc:697] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:52.250883 19330 consensus_queue.cc:237] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.251446 19096 raft_consensus.cc:2468] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 1.
I20260709 12:15:52.252679 19210 leader_election.cc:304] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:52.255120 19095 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 1.
I20260709 12:15:52.256120 19170 raft_consensus.cc:2468] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 1.
I20260709 12:15:52.257078 19295 raft_consensus.cc:2804] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.257634 19295 raft_consensus.cc:697] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:15:52.258543 19295 consensus_queue.cc:237] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.266688 18992 catalog_manager.cc:5697] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 0 to 1, leader changed from <none> to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 1 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:52.270705 19040 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:52.270296 18993 catalog_manager.cc:5697] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 0 to 1, leader changed from <none> to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.276769 19295 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.277335 19295 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.281029 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4" is_pre_election: true
I20260709 12:15:52.281890 19095 raft_consensus.cc:2393] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f894d45a70a94c4e9092d26943e2a058 in current term 1: Already voted for candidate ee3bc233cb5b4745adbf37caf5834d0e in this term.
I20260709 12:15:52.281699 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:15:52.282160 19295 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:52.283222 19210 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:15:52.284029 19295 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.289093 19321 consensus_queue.cc:1048] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.290885 19295 raft_consensus.cc:2749] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.304628 19325 consensus_queue.cc:1048] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.398970 19330 consensus_queue.cc:1048] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.401225 19330 consensus_queue.cc:1048] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.486173 19332 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.486449 19296 consensus_queue.cc:1048] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.501327 19314 consensus_queue.cc:1048] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.506036 19294 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.516705 19294 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.536679 19314 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.558348 19337 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.560724 19314 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.594749 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:45940
I20260709 12:15:52.595541 19170 raft_consensus.cc:606] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Received request to transfer leadership to TS 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:15:52.626881 19243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
mode: GRACEFUL
new_leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:54858
I20260709 12:15:52.627609 19243 raft_consensus.cc:606] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Received request to transfer leadership to TS 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:15:52.634842 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:45940
I20260709 12:15:52.635528 19170 raft_consensus.cc:606] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Received request to transfer leadership to TS 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:15:52.658674 19095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "489547a53e9f42039075714ed2b34dab"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
mode: GRACEFUL
new_leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:43368
I20260709 12:15:52.659242 19095 raft_consensus.cc:606] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Received request to transfer leadership to TS ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:15:52.742761 19321 consensus_queue.cc:1048] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.755662 19370 consensus_queue.cc:1048] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.758445 19314 consensus_queue.cc:1048] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.774938 19330 raft_consensus.cc:993] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:15:52.775437 19330 raft_consensus.cc:1081] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Signalling peer 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:15:52.778690 19095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:43362
I20260709 12:15:52.779399 19095 raft_consensus.cc:493] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:52.779865 19095 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.783404 19314 consensus_queue.cc:1048] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.789728 19095 raft_consensus.cc:515] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.792697 19096 raft_consensus.cc:1240] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Rejecting Update request from peer ee3bc233cb5b4745adbf37caf5834d0e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:52.794334 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.795006 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:52.795632 19170 raft_consensus.cc:3055] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:52.795959 19170 raft_consensus.cc:740] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:52.796664 19095 leader_election.cc:290] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 2 election: Requested vote from peers f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:52.796845 19170 consensus_queue.cc:260] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.798190 19170 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.805958 19170 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 2.
I20260709 12:15:52.806877 19062 leader_election.cc:304] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:52.807710 19332 raft_consensus.cc:2804] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.808195 19332 raft_consensus.cc:697] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:52.809006 19332 consensus_queue.cc:237] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:15:52.815742 18991 catalog_manager.cc:5697] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 1 to 2, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.902012 19321 raft_consensus.cc:993] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: : Instructing follower 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:15:52.902515 19325 raft_consensus.cc:1081] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Signalling peer 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:15:52.904059 19095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:43366
I20260709 12:15:52.904580 19095 raft_consensus.cc:493] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:52.904896 19095 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.910225 19095 raft_consensus.cc:515] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.911898 19095 leader_election.cc:290] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 2 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.912657 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:52.912966 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.913267 19170 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.913525 19243 raft_consensus.cc:3055] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:52.913852 19243 raft_consensus.cc:740] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:15:52.914697 19243 consensus_queue.cc:260] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.915925 19243 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.921643 19170 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 2.
I20260709 12:15:52.923465 19062 leader_election.cc:304] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:52.924391 19332 raft_consensus.cc:2804] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.924674 19243 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 2.
I20260709 12:15:52.924921 19332 raft_consensus.cc:697] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:52.925820 19332 consensus_queue.cc:237] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.930409 19294 raft_consensus.cc:993] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: : Instructing follower ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:15:52.930827 19332 raft_consensus.cc:1081] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Signalling peer ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:15:52.932276 19170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "489547a53e9f42039075714ed2b34dab"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:15:52.932752 19170 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:52.933099 19170 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.932438 18991 catalog_manager.cc:5697] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 1 to 2, leader changed from f894d45a70a94c4e9092d26943e2a058 (127.18.132.67) to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.938632 19170 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.941190 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:52.941542 19170 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 2 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:52.941901 19095 raft_consensus.cc:3055] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:52.942142 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:52.942296 19095 raft_consensus.cc:740] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:52.942728 19243 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.943307 19095 consensus_queue.cc:260] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.944620 19095 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:52.949491 19095 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 2.
I20260709 12:15:52.950078 19243 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 2.
I20260709 12:15:52.950551 19136 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:15:52.951419 19314 raft_consensus.cc:2804] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:52.951920 19314 raft_consensus.cc:697] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:52.952793 19314 consensus_queue.cc:237] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:52.959372 18991 catalog_manager.cc:5697] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 1 to 2, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 2 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.156538 19315 raft_consensus.cc:993] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:15:53.157287 19330 raft_consensus.cc:1081] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Signalling peer 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:15:53.159879 19096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:43362
I20260709 12:15:53.160462 19096 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:53.160887 19096 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.165925 19096 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:53.167542 19096 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 2 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:15:53.168385 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:53.168565 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:15:53.168944 19170 raft_consensus.cc:3055] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:53.169117 19243 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.169194 19170 raft_consensus.cc:740] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:53.170017 19170 consensus_queue.cc:260] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:53.171165 19170 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.175904 19243 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 2.
I20260709 12:15:53.176934 19059 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:53.177647 19332 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:53.177600 19170 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 2.
I20260709 12:15:53.178236 19332 raft_consensus.cc:697] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:53.179132 19332 consensus_queue.cc:237] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:53.186127 18991 catalog_manager.cc:5697] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 1 to 2, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.370496 19170 raft_consensus.cc:1275] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.371944 19332 consensus_queue.cc:1048] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.381976 19243 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.384179 19096 raft_consensus.cc:1275] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.385674 19330 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.390100 19243 raft_consensus.cc:1275] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.392014 19332 consensus_queue.cc:1048] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.398638 19244 raft_consensus.cc:1275] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.404418 19379 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.475670 19170 raft_consensus.cc:1275] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.477037 19332 consensus_queue.cc:1048] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.486352 19244 raft_consensus.cc:1275] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.488255 19383 consensus_queue.cc:1048] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.570812 19170 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.572086 19383 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:53.582144 19244 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:53.583539 19332 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.692651 18961 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:15:55.693516 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:55.714207 19096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "933d759bff134734adbfe59134116005"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
mode: GRACEFUL
new_leader_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:43372
I20260709 12:15:55.714807 19096 raft_consensus.cc:606] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Received request to transfer leadership to TS f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:55.725342 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:15:55.725930 19170 raft_consensus.cc:606] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Received request to transfer leadership to TS f894d45a70a94c4e9092d26943e2a058
I20260709 12:15:55.727231 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:55.727759 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:55.742533 19389 raft_consensus.cc:993] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: : Instructing follower f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:15:55.743024 19393 raft_consensus.cc:1081] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Signalling peer f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:15:55.744779 19244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "933d759bff134734adbfe59134116005"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:54852
I20260709 12:15:55.745313 19244 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.745648 19244 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.750671 19244 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:55.752576 19244 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 2 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:55.753360 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:55.753659 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:55.754027 19096 raft_consensus.cc:3055] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:55.754232 19170 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.754380 19096 raft_consensus.cc:740] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:15:55.755288 19096 consensus_queue.cc:260] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:55.756634 19096 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.760020 19388 raft_consensus.cc:993] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:15:55.760509 19394 raft_consensus.cc:1081] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Signalling peer f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:15:55.760921 19170 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 2.
I20260709 12:15:55.762118 19211 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:55.762217 19244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:54846
I20260709 12:15:55.762789 19244 raft_consensus.cc:493] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.762866 19325 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.763226 19244 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.764258 19325 raft_consensus.cc:697] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:15:55.764227 19096 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 2.
I20260709 12:15:55.765405 19325 consensus_queue.cc:237] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:55.770431 19244 raft_consensus.cc:515] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:55.772332 19244 leader_election.cc:290] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 2 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:15:55.772990 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:15:55.773418 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:15:55.773581 19096 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.773984 19170 raft_consensus.cc:3055] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:55.774358 19170 raft_consensus.cc:740] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:15:55.774677 18992 catalog_manager.cc:5697] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 1 to 2, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:55.775332 19170 consensus_queue.cc:260] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:55.776592 19170 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.779382 19096 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 2.
I20260709 12:15:55.780692 19210 leader_election.cc:304] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:15:55.781522 19325 raft_consensus.cc:2804] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.782021 19325 raft_consensus.cc:697] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:15:55.782795 19170 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 2.
I20260709 12:15:55.782994 19325 consensus_queue.cc:237] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:15:55.793409 18992 catalog_manager.cc:5697] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 1 to 2, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:56.209910 19170 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.211246 19325 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:56.221742 19096 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.223798 19395 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:56.329250 19170 raft_consensus.cc:1275] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.330514 19395 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:56.339479 19096 raft_consensus.cc:1275] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.343410 19408 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:56.728920 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:56.735040 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:56.735421 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:57.736429 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.741856 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:57.742285 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:58.780083 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:58.790642 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:58.791155 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:59.792272 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:59.798404 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:59.798873 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:00.799913 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:00.804984 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:00.805404 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.806344 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.812225 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:01.812678 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:02.813649 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:02.818603 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:02.819090 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:03.820158 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:03.825357 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:03.825821 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:04.826970 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.832110 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:04.832520 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:05.860941 18961 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:16:05.865218 19096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
mode: GRACEFUL
new_leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:43368
I20260709 12:16:05.865945 19096 raft_consensus.cc:606] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Received request to transfer leadership to TS ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:05.870990 19096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
mode: GRACEFUL
new_leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:43368
I20260709 12:16:05.871490 19096 raft_consensus.cc:606] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Received request to transfer leadership to TS ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:05.876351 19095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
mode: GRACEFUL
new_leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:43368
I20260709 12:16:05.876839 19095 raft_consensus.cc:606] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Received request to transfer leadership to TS ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:05.881431 19244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "933d759bff134734adbfe59134116005"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
mode: GRACEFUL
new_leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:54858
I20260709 12:16:05.881839 19244 raft_consensus.cc:606] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Received request to transfer leadership to TS ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:05.893229 19244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
mode: GRACEFUL
new_leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:54858
I20260709 12:16:05.893761 19244 raft_consensus.cc:606] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Received request to transfer leadership to TS ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:05.915297 19420 raft_consensus.cc:993] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: : Instructing follower ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:05.915848 19420 raft_consensus.cc:1081] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Signalling peer ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:05.917533 19171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:45926
I20260709 12:16:05.918008 19171 raft_consensus.cc:493] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.918305 19171 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.923951 19171 raft_consensus.cc:515] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:05.925819 19171 leader_election.cc:290] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:05.926775 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:05.927029 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:05.927671 19095 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.927744 19243 raft_consensus.cc:3055] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:05.928118 19243 raft_consensus.cc:740] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:16:05.928993 19243 consensus_queue.cc:260] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:05.930074 19243 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:05.933244 19095 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:05.934471 19136 leader_election.cc:304] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:16:05.935312 19388 raft_consensus.cc:2804] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:05.935346 19243 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:05.936686 19388 raft_consensus.cc:697] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:05.937561 19388 consensus_queue.cc:237] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:05.944588 18991 catalog_manager.cc:5697] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 2 to 3, leader changed from f894d45a70a94c4e9092d26943e2a058 (127.18.132.67) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 3 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.043064 19417 raft_consensus.cc:993] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: : Instructing follower ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.043645 19427 raft_consensus.cc:1081] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Signalling peer ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.045099 19171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:16:06.045585 19171 raft_consensus.cc:493] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.045902 19171 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.051000 19171 raft_consensus.cc:515] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.052654 19171 leader_election.cc:290] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:06.053624 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:06.053617 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbe561003b14b75b4a8f3393823b452" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:06.054304 19244 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.054332 19095 raft_consensus.cc:3055] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.054822 19095 raft_consensus.cc:740] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:16:06.055759 19095 consensus_queue.cc:260] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.057122 19095 raft_consensus.cc:3060] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.061453 19244 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.062695 19134 leader_election.cc:304] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:06.063640 19388 raft_consensus.cc:2804] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.064070 19388 raft_consensus.cc:697] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:06.064940 19388 consensus_queue.cc:237] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.066057 19414 raft_consensus.cc:993] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: : Instructing follower ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.067057 19420 raft_consensus.cc:1081] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Signalling peer ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.067163 19095 raft_consensus.cc:2468] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.069105 19170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "933d759bff134734adbfe59134116005"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:45926
I20260709 12:16:06.069649 19170 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.070013 19170 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.077214 19170 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.076939 18991 catalog_manager.cc:5697] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 2 to 3, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 3 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.079005 19170 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:06.079630 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:06.080246 19095 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.080405 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:06.080966 19244 raft_consensus.cc:3055] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.081208 19244 raft_consensus.cc:740] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:16:06.081954 19244 consensus_queue.cc:260] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.083123 19244 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.086267 19095 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.087666 19136 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e; no voters: 
I20260709 12:16:06.088472 19388 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.088851 19388 raft_consensus.cc:697] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:06.089576 19244 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.089567 19388 consensus_queue.cc:237] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.096621 18991 catalog_manager.cc:5697] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 2 to 3, leader changed from f894d45a70a94c4e9092d26943e2a058 (127.18.132.67) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 3 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.208841 19417 raft_consensus.cc:993] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: : Instructing follower ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.209337 19427 raft_consensus.cc:1081] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Signalling peer ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.210592 19170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:16:06.211057 19170 raft_consensus.cc:493] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.211352 19170 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.215842 19170 raft_consensus.cc:515] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:16:06.217334 19170 leader_election.cc:290] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:06.218199 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:06.218353 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8636526b9645ec8121c2c5c7014769" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:06.218832 19095 raft_consensus.cc:3055] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.218873 19244 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.219205 19095 raft_consensus.cc:740] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:16:06.220019 19095 consensus_queue.cc:260] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:16:06.220999 19095 raft_consensus.cc:3060] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.223466 19244 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.224484 19134 leader_election.cc:304] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:06.225237 19388 raft_consensus.cc:2804] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.225639 19388 raft_consensus.cc:697] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:06.226397 19095 raft_consensus.cc:2468] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.226387 19388 consensus_queue.cc:237] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } }
I20260709 12:16:06.233655 18991 catalog_manager.cc:5697] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 2 to 3, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 3 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.422240 19244 raft_consensus.cc:1275] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.423481 19388 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.438074 19095 raft_consensus.cc:1275] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.439917 19434 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:06.483872 19244 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.485050 19434 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.490896 19427 raft_consensus.cc:993] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: : Instructing follower ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.491290 19095 raft_consensus.cc:1275] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.491379 19427 raft_consensus.cc:1081] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Signalling peer ee3bc233cb5b4745adbf37caf5834d0e to start an election
I20260709 12:16:06.493389 19170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:16:06.493567 19421 consensus_queue.cc:1048] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:06.493986 19170 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.494379 19170 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.498749 19096 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.500530 19434 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.502017 19170 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.503993 19170 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:06.505270 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:06.505801 19244 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.507529 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:06.508159 19094 raft_consensus.cc:3055] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:06.508453 19094 raft_consensus.cc:740] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:16:06.509196 19094 consensus_queue.cc:260] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.510447 19094 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:06.513206 19244 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.514791 19134 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:06.515772 19434 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:06.516247 19434 raft_consensus.cc:697] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:06.517122 19434 consensus_queue.cc:237] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:06.517766 19094 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:06.527827 18991 catalog_manager.cc:5697] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 2 to 3, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 3 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.529443 19244 raft_consensus.cc:1275] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.530910 19434 consensus_queue.cc:1048] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.757009 19095 raft_consensus.cc:1275] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.758312 19434 consensus_queue.cc:1048] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:06.767189 19244 raft_consensus.cc:1275] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:06.768823 19439 consensus_queue.cc:1048] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.059729 19244 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.060984 19439 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:07.072482 19095 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:07.073875 19388 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:08.925722 18961 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:16:08.927147 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.936044 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:16:08.936650 19170 raft_consensus.cc:606] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Received request to transfer leadership to TS 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:16:08.939177 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "489547a53e9f42039075714ed2b34dab"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:16:08.939585 19170 raft_consensus.cc:606] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 LEADER]: Received request to transfer leadership to TS 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:16:08.941643 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "933d759bff134734adbfe59134116005"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:16:08.942049 19170 raft_consensus.cc:606] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Received request to transfer leadership to TS 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:16:08.944028 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:16:08.944432 19170 raft_consensus.cc:606] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Received request to transfer leadership to TS f894d45a70a94c4e9092d26943e2a058
I20260709 12:16:08.946384 19170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0"
dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
mode: GRACEFUL
new_leader_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:45948
I20260709 12:16:08.946785 19170 raft_consensus.cc:606] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Received request to transfer leadership to TS f894d45a70a94c4e9092d26943e2a058
I20260709 12:16:08.947752 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:08.948148 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:09.009765 19388 raft_consensus.cc:993] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:16:09.010223 19388 raft_consensus.cc:1081] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Signalling peer f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:16:09.011695 19244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:54846
I20260709 12:16:09.012171 19244 raft_consensus.cc:493] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:09.012508 19244 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.018299 19244 raft_consensus.cc:515] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.020707 19244 leader_election.cc:290] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 4 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:16:09.021569 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:09.021987 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc235deec39a42aba7f1b38bceafc3c0" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:16:09.022369 19095 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.022563 19170 raft_consensus.cc:3055] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:09.022887 19170 raft_consensus.cc:740] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:09.023530 19170 consensus_queue.cc:260] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.024705 19170 raft_consensus.cc:3060] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.027228 19095 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 4.
I20260709 12:16:09.028419 19210 leader_election.cc:304] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:09.029263 19428 raft_consensus.cc:2804] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:09.029515 19170 raft_consensus.cc:2468] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 4.
I20260709 12:16:09.030499 19428 raft_consensus.cc:697] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 4 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:16:09.031525 19428 consensus_queue.cc:237] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.039850 18991 catalog_manager.cc:5697] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 3 to 4, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 4 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:09.147326 19448 raft_consensus.cc:993] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:16:09.147938 19388 raft_consensus.cc:1081] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Signalling peer 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:16:09.149348 19095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:43362
I20260709 12:16:09.149816 19095 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:09.150120 19095 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.154984 19095 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.156998 19095 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 4 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:09.157922 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:16:09.158098 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:09.158481 19170 raft_consensus.cc:3055] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:09.158651 19244 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.158777 19170 raft_consensus.cc:740] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:09.159648 19170 consensus_queue.cc:260] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.160645 19170 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.163391 19244 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 4.
I20260709 12:16:09.164614 19059 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:09.165968 19170 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 4.
I20260709 12:16:09.166548 19456 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:09.167912 19456 raft_consensus.cc:697] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:16:09.168723 19456 consensus_queue.cc:237] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.176201 18991 catalog_manager.cc:5697] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 3 to 4, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.190968 19448 raft_consensus.cc:993] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:16:09.191421 19388 raft_consensus.cc:1081] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Signalling peer f894d45a70a94c4e9092d26943e2a058 to start an election
I20260709 12:16:09.192726 19244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f"
dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
 from {username='slave'} at 127.0.0.1:54846
I20260709 12:16:09.193151 19244 raft_consensus.cc:493] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:09.193368 19244 raft_consensus.cc:3060] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:09.197817 19244 raft_consensus.cc:515] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.199096 19244 leader_election.cc:290] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 2 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:16:09.199923 19095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
I20260709 12:16:09.200142 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c984a5b3b9ec4b5fb7f5d55721a9279f" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:16:09.200527 19095 raft_consensus.cc:3060] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:09.200703 19170 raft_consensus.cc:3055] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:09.201040 19170 raft_consensus.cc:740] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:09.201728 19170 consensus_queue.cc:260] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.202718 19170 raft_consensus.cc:3060] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:09.204933 19095 raft_consensus.cc:2468] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 2.
I20260709 12:16:09.205860 19210 leader_election.cc:304] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:09.206674 19428 raft_consensus.cc:2804] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:09.207089 19428 raft_consensus.cc:697] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:16:09.207612 19170 raft_consensus.cc:2468] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 2.
I20260709 12:16:09.207980 19428 consensus_queue.cc:237] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.214995 18991 catalog_manager.cc:5697] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 1 to 2, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:09.226533 19448 raft_consensus.cc:993] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:16:09.226994 19388 raft_consensus.cc:1081] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Signalling peer 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:16:09.228193 19095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "933d759bff134734adbfe59134116005"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:43362
I20260709 12:16:09.228582 19095 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:09.228812 19095 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.232847 19095 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.234107 19095 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 4 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:09.234902 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:16:09.235189 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:09.235426 19170 raft_consensus.cc:3055] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:09.235713 19244 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.235782 19170 raft_consensus.cc:740] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:09.236549 19170 consensus_queue.cc:260] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.237387 19170 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:09.240490 19244 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 4.
I20260709 12:16:09.241509 19059 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:09.241834 19170 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 4.
I20260709 12:16:09.242344 19456 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:09.242863 19456 raft_consensus.cc:697] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:16:09.243732 19456 consensus_queue.cc:237] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.250675 18991 catalog_manager.cc:5697] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 3 to 4, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.266681 19448 raft_consensus.cc:993] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: : Instructing follower 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:16:09.267148 19388 raft_consensus.cc:1081] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 LEADER]: Signalling peer 7a1e43cba24a409aa172566e8f55b4c4 to start an election
I20260709 12:16:09.268425 19095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "489547a53e9f42039075714ed2b34dab"
dest_uuid: "7a1e43cba24a409aa172566e8f55b4c4"
 from {username='slave'} at 127.0.0.1:43362
I20260709 12:16:09.268785 19095 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:09.268991 19095 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:09.273329 19095 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.274729 19095 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 3 election: Requested vote from peers ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:09.275375 19170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:16:09.275951 19170 raft_consensus.cc:3055] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:09.275894 19244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "7a1e43cba24a409aa172566e8f55b4c4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:09.276206 19170 raft_consensus.cc:740] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:09.276371 19244 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:09.276919 19170 consensus_queue.cc:260] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.277830 19170 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:09.280829 19244 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 3.
I20260709 12:16:09.281709 19059 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:09.282382 19456 raft_consensus.cc:2804] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:09.282497 19170 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a1e43cba24a409aa172566e8f55b4c4 in term 3.
I20260709 12:16:09.282809 19456 raft_consensus.cc:697] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 LEADER]: Becoming Leader. State: Replica: 7a1e43cba24a409aa172566e8f55b4c4, State: Running, Role: LEADER
I20260709 12:16:09.283797 19456 consensus_queue.cc:237] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:09.290369 18991 catalog_manager.cc:5697] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 reported cstate change: term changed from 2 to 3, leader changed from ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66) to 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "7a1e43cba24a409aa172566e8f55b4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.511195 19095 raft_consensus.cc:1275] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.512511 19428 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:09.524905 19170 raft_consensus.cc:1275] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.526583 19465 consensus_queue.cc:1048] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:09.642204 19170 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.643523 19456 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:09.652457 19244 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.653914 19469 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:09.662009 19244 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.663199 19457 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:09.672770 19170 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.674120 19457 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:09.689208 19170 raft_consensus.cc:1275] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:09.690442 19457 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:09.701545 19170 raft_consensus.cc:1275] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.702075 19244 raft_consensus.cc:1275] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Refusing update from remote peer 7a1e43cba24a409aa172566e8f55b4c4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:09.702864 19465 consensus_queue.cc:1048] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.703971 19469 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:09.713430 19095 raft_consensus.cc:1275] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.714958 19428 consensus_queue.cc:1048] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.949384 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.954643 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:09.955062 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:10.956166 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.961405 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:10.961853 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.962953 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.968101 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:11.968659 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:12.969842 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:12.974963 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:12.975435 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:13.976492 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:13.981546 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:13.981982 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.983209 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.988318 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:14.988796 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.989902 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.995365 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:15.995879 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:16.997033 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:17.002285 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:17.002827 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:18.143165 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:18.149089 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:18.149535 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:19.121428 19266 debug-util.cc:398] Leaking SignalData structure 0x7b080016d060 after lost signal to thread 18964
W20260709 12:16:19.122553 19266 debug-util.cc:398] Leaking SignalData structure 0x7b080016d740 after lost signal to thread 19027
W20260709 12:16:19.123618 19266 debug-util.cc:398] Leaking SignalData structure 0x7b080017d1a0 after lost signal to thread 19120
W20260709 12:16:19.124617 19266 debug-util.cc:398] Leaking SignalData structure 0x7b0800097640 after lost signal to thread 19195
W20260709 12:16:19.125532 19266 debug-util.cc:398] Leaking SignalData structure 0x7b0800183be0 after lost signal to thread 19269
I20260709 12:16:19.632097 18961 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:16:19.632776 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
I20260709 12:16:19.676880 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:19.677755 18961 tablet_replica.cc:333] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.678874 18961 raft_consensus.cc:2243] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:19.680166 18961 raft_consensus.cc:2272] T 4783a101c3e64eccaf31160acf9614be P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.683126 18961 tablet_replica.cc:333] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.683794 18961 raft_consensus.cc:2243] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:19.684263 18961 raft_consensus.cc:2272] T 175512c7a06742a99e93ebad63b41cf6 P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.686154 18961 tablet_replica.cc:333] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.686668 18961 raft_consensus.cc:2243] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:19.687110 18961 raft_consensus.cc:2272] T 38976202940b4a6597bcee5d9d6fc4ad P 7a1e43cba24a409aa172566e8f55b4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.689128 18961 tablet_replica.cc:333] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.689730 18961 raft_consensus.cc:2243] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:19.690151 18961 raft_consensus.cc:2272] T cc235deec39a42aba7f1b38bceafc3c0 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.692052 18961 tablet_replica.cc:333] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.692607 18961 raft_consensus.cc:2243] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:19.693933 18961 raft_consensus.cc:2272] T 489547a53e9f42039075714ed2b34dab P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.695940 18961 tablet_replica.cc:333] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.696442 18961 raft_consensus.cc:2243] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:19.696929 18961 raft_consensus.cc:2272] T c984a5b3b9ec4b5fb7f5d55721a9279f P 7a1e43cba24a409aa172566e8f55b4c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.698761 18961 tablet_replica.cc:333] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.699276 18961 raft_consensus.cc:2243] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:19.699746 18961 raft_consensus.cc:2272] T 1dbe561003b14b75b4a8f3393823b452 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.701556 18961 tablet_replica.cc:333] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.702059 18961 raft_consensus.cc:2243] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:19.702503 18961 raft_consensus.cc:2272] T 4a8636526b9645ec8121c2c5c7014769 P 7a1e43cba24a409aa172566e8f55b4c4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:19.704793 18961 tablet_replica.cc:333] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4: stopping tablet replica
I20260709 12:16:19.705248 18961 raft_consensus.cc:2243] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:19.706089 18961 raft_consensus.cc:2272] T 933d759bff134734adbfe59134116005 P 7a1e43cba24a409aa172566e8f55b4c4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:19.710472 19136 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:16:19.729894 19136 consensus_peers.cc:597] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.735110 19210 consensus_peers.cc:597] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.935473 19136 consensus_peers.cc:597] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:19.982334 19117 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 18964
W20260709 12:16:19.983208 19117 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 19027
W20260709 12:16:19.984258 19117 debug-util.cc:398] Leaking SignalData structure 0x7b0800041f40 after lost signal to thread 19120
W20260709 12:16:19.985270 19117 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1b40 after lost signal to thread 19195
W20260709 12:16:19.986364 19117 debug-util.cc:398] Leaking SignalData structure 0x7b08001caa60 after lost signal to thread 19269
W20260709 12:16:19.990926 19136 consensus_peers.cc:597] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:20.043700 19210 consensus_peers.cc:597] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:20.086908 19210 consensus_peers.cc:597] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:20.811702 18961 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19117)
I20260709 12:16:20.854636 19494 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:20.855405 19494 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:20.862016 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:16:20.865435 19494 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
W20260709 12:16:20.869242 19136 leader_election.cc:336] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:20.870357 19136 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e; no voters: 7a1e43cba24a409aa172566e8f55b4c4, f894d45a70a94c4e9092d26943e2a058
I20260709 12:16:20.871318 19493 raft_consensus.cc:2749] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:20.905686 19496 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:20.906316 19496 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:20.910247 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:16:20.910938 19171 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 4.
I20260709 12:16:20.912619 19211 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:20.913695 19482 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:16:20.913770 19210 leader_election.cc:336] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:20.914117 19482 raft_consensus.cc:493] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:20.914501 19482 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:20.914512 19496 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:16:20.924397 19482 raft_consensus.cc:515] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:20.926986 19482 leader_election.cc:290] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:16:20.928369 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933d759bff134734adbfe59134116005" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e"
I20260709 12:16:20.929154 19171 raft_consensus.cc:3060] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:20.933187 19210 leader_election.cc:336] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:20.936494 19171 raft_consensus.cc:2468] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f894d45a70a94c4e9092d26943e2a058 in term 5.
I20260709 12:16:20.937747 19211 leader_election.cc:304] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:16:20.938488 19482 raft_consensus.cc:2804] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:20.939044 19482 raft_consensus.cc:697] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 5 LEADER]: Becoming Leader. State: Replica: f894d45a70a94c4e9092d26943e2a058, State: Running, Role: LEADER
I20260709 12:16:20.939811 19496 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:20.940400 19496 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:20.940791 19482 consensus_queue.cc:237] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
W20260709 12:16:20.949640 19210 leader_election.cc:336] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:20.952343 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:16:20.953989 19211 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:20.954907 19496 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:16:20.955391 19497 raft_consensus.cc:2749] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:20.958192 18992 catalog_manager.cc:5697] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 reported cstate change: term changed from 4 to 5, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to f894d45a70a94c4e9092d26943e2a058 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "f894d45a70a94c4e9092d26943e2a058" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.967337 19496 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:20.968034 19496 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
W20260709 12:16:20.975694 19210 leader_election.cc:336] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:20.978230 19171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "f894d45a70a94c4e9092d26943e2a058" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" is_pre_election: true
I20260709 12:16:20.979856 19211 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4, ee3bc233cb5b4745adbf37caf5834d0e
I20260709 12:16:20.980717 19482 raft_consensus.cc:2749] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:20.981798 19496 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66:42039)
I20260709 12:16:21.002306 19493 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:21.002859 19493 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:21.005103 19493 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:21.007582 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
I20260709 12:16:21.008229 19245 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 4.
I20260709 12:16:21.009676 19134 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 
I20260709 12:16:21.010617 19494 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:21.010970 19494 raft_consensus.cc:493] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:21.011349 19494 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:21.012337 19136 leader_election.cc:336] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:21.013356 19493 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:21.013885 19493 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:21.016016 19493 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:21.017274 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058" is_pre_election: true
W20260709 12:16:21.021225 19136 leader_election.cc:336] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:21.021806 19245 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 3.
I20260709 12:16:21.021018 19494 raft_consensus.cc:515] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:21.023087 19134 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:16:21.024200 19493 raft_consensus.cc:2804] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:21.024638 19493 raft_consensus.cc:493] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7a1e43cba24a409aa172566e8f55b4c4)
I20260709 12:16:21.025080 19493 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:21.028177 19136 leader_election.cc:336] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:21.029634 19494 leader_election.cc:290] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:21.030249 19245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783a101c3e64eccaf31160acf9614be" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:21.030833 19245 raft_consensus.cc:3060] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:21.033226 19493 raft_consensus.cc:515] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:21.038102 19245 raft_consensus.cc:2468] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 5.
I20260709 12:16:21.039319 19134 leader_election.cc:304] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4
W20260709 12:16:21.039953 19136 leader_election.cc:336] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111)
I20260709 12:16:21.040391 19494 raft_consensus.cc:2804] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:21.040970 19493 leader_election.cc:290] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 4 election: Requested vote from peers 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479), f894d45a70a94c4e9092d26943e2a058 (127.18.132.67:42585)
I20260709 12:16:21.042145 19243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489547a53e9f42039075714ed2b34dab" candidate_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f894d45a70a94c4e9092d26943e2a058"
I20260709 12:16:21.042800 19243 raft_consensus.cc:3060] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:21.051870 19243 raft_consensus.cc:2468] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3bc233cb5b4745adbf37caf5834d0e in term 4.
I20260709 12:16:21.053542 19134 leader_election.cc:304] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee3bc233cb5b4745adbf37caf5834d0e, f894d45a70a94c4e9092d26943e2a058; no voters: 7a1e43cba24a409aa172566e8f55b4c4
I20260709 12:16:21.054936 19493 raft_consensus.cc:2804] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:21.055528 19493 raft_consensus.cc:697] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 4 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:21.056016 19494 raft_consensus.cc:697] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 5 LEADER]: Becoming Leader. State: Replica: ee3bc233cb5b4745adbf37caf5834d0e, State: Running, Role: LEADER
I20260709 12:16:21.056718 19493 consensus_queue.cc:237] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:21.056937 19494 consensus_queue.cc:237] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } }
I20260709 12:16:21.073091 18992 catalog_manager.cc:5697] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 4 to 5, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 5 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.085410 18992 catalog_manager.cc:5697] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e reported cstate change: term changed from 3 to 4, leader changed from 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65) to ee3bc233cb5b4745adbf37caf5834d0e (127.18.132.66). New cstate: current_term: 4 leader_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a1e43cba24a409aa172566e8f55b4c4" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 43479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.423146 19171 raft_consensus.cc:1275] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Refusing update from remote peer f894d45a70a94c4e9092d26943e2a058: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:21.424940 19496 consensus_queue.cc:1048] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3bc233cb5b4745adbf37caf5834d0e" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:16:21.447762 19210 consensus_peers.cc:597] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:21.500208 19136 consensus_peers.cc:597] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:21.526684 19243 raft_consensus.cc:1275] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:21.528294 19494 consensus_queue.cc:1048] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:21.562647 19243 raft_consensus.cc:1275] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Refusing update from remote peer ee3bc233cb5b4745adbf37caf5834d0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:16:21.562696 19136 consensus_peers.cc:597] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:21.564343 19503 consensus_queue.cc:1048] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f894d45a70a94c4e9092d26943e2a058" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:16:21.812291 18961 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19117)
W20260709 12:16:22.084522 19136 consensus_peers.cc:597] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.336287 19136 consensus_peers.cc:597] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.350967 19210 consensus_peers.cc:597] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.407166 19210 consensus_peers.cc:597] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:22.596309 19136 consensus_peers.cc:597] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:22.694830 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
I20260709 12:16:22.716636 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
I20260709 12:16:22.744537 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.745298 18961 tablet_replica.cc:333] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.745966 18961 raft_consensus.cc:2243] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.746791 18961 raft_consensus.cc:2272] T 489547a53e9f42039075714ed2b34dab P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.749001 18961 tablet_replica.cc:333] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.749776 18961 raft_consensus.cc:2243] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.750600 18961 raft_consensus.cc:2272] T 4a8636526b9645ec8121c2c5c7014769 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.753042 18961 tablet_replica.cc:333] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.753544 18961 raft_consensus.cc:2243] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.753925 18961 raft_consensus.cc:2272] T 933d759bff134734adbfe59134116005 P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.755434 18961 tablet_replica.cc:333] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.756001 18961 raft_consensus.cc:2243] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.756439 18961 raft_consensus.cc:2272] T cc235deec39a42aba7f1b38bceafc3c0 P ee3bc233cb5b4745adbf37caf5834d0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.758201 18961 tablet_replica.cc:333] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.758723 18961 raft_consensus.cc:2243] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.759125 18961 raft_consensus.cc:2272] T 175512c7a06742a99e93ebad63b41cf6 P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.761049 18961 tablet_replica.cc:333] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.761555 18961 raft_consensus.cc:2243] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.762272 18961 raft_consensus.cc:2272] T 38976202940b4a6597bcee5d9d6fc4ad P ee3bc233cb5b4745adbf37caf5834d0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.764053 18961 tablet_replica.cc:333] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.764549 18961 raft_consensus.cc:2243] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.765331 18961 raft_consensus.cc:2272] T 4783a101c3e64eccaf31160acf9614be P ee3bc233cb5b4745adbf37caf5834d0e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.767006 18961 tablet_replica.cc:333] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.767488 18961 raft_consensus.cc:2243] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.767968 18961 raft_consensus.cc:2272] T c984a5b3b9ec4b5fb7f5d55721a9279f P ee3bc233cb5b4745adbf37caf5834d0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.769570 18961 tablet_replica.cc:333] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e: stopping tablet replica
I20260709 12:16:22.770035 18961 raft_consensus.cc:2243] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.770783 18961 raft_consensus.cc:2272] T 1dbe561003b14b75b4a8f3393823b452 P ee3bc233cb5b4745adbf37caf5834d0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.800823 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
I20260709 12:16:22.820966 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
W20260709 12:16:22.839607 19210 consensus_peers.cc:597] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 -> Peer 7a1e43cba24a409aa172566e8f55b4c4 (127.18.132.65:43479): Couldn't send request to peer 7a1e43cba24a409aa172566e8f55b4c4. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:43479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:22.850162 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.850884 18961 tablet_replica.cc:333] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.851533 18961 raft_consensus.cc:2243] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.852133 18961 raft_consensus.cc:2272] T 4783a101c3e64eccaf31160acf9614be P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.854028 18961 tablet_replica.cc:333] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.854575 18961 raft_consensus.cc:2243] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.855010 18961 raft_consensus.cc:2272] T 4a8636526b9645ec8121c2c5c7014769 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.856704 18961 tablet_replica.cc:333] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.857240 18961 raft_consensus.cc:2243] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.858034 18961 raft_consensus.cc:2272] T cc235deec39a42aba7f1b38bceafc3c0 P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.859881 18961 tablet_replica.cc:333] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.860455 18961 raft_consensus.cc:2243] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.861217 18961 raft_consensus.cc:2272] T 175512c7a06742a99e93ebad63b41cf6 P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.863106 18961 tablet_replica.cc:333] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.863672 18961 raft_consensus.cc:2243] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.864075 18961 raft_consensus.cc:2272] T 38976202940b4a6597bcee5d9d6fc4ad P f894d45a70a94c4e9092d26943e2a058 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.865672 18961 tablet_replica.cc:333] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.866161 18961 raft_consensus.cc:2243] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.866583 18961 raft_consensus.cc:2272] T 489547a53e9f42039075714ed2b34dab P f894d45a70a94c4e9092d26943e2a058 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.868697 18961 tablet_replica.cc:333] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.869326 18961 raft_consensus.cc:2243] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.870417 18961 raft_consensus.cc:2272] T 933d759bff134734adbfe59134116005 P f894d45a70a94c4e9092d26943e2a058 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.872251 18961 tablet_replica.cc:333] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.872736 18961 raft_consensus.cc:2243] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.873476 18961 raft_consensus.cc:2272] T c984a5b3b9ec4b5fb7f5d55721a9279f P f894d45a70a94c4e9092d26943e2a058 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.875090 18961 tablet_replica.cc:333] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058: stopping tablet replica
I20260709 12:16:22.875638 18961 raft_consensus.cc:2243] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.876080 18961 raft_consensus.cc:2272] T 1dbe561003b14b75b4a8f3393823b452 P f894d45a70a94c4e9092d26943e2a058 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.920805 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
I20260709 12:16:22.942230 18961 master.cc:562] Master@127.18.132.126:39517 shutting down...
I20260709 12:16:23.083530 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:23.084270 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:23.084646 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P 365eb3c8958d40ba9e3818c477dd08ff: stopping tablet replica
I20260709 12:16:23.104965 18961 master.cc:584] Master@127.18.132.126:39517 shutdown complete.
7a1e43cba24a409aa172566e8f55b4c4  4
ee3bc233cb5b4745adbf37caf5834d0e  4
f894d45a70a94c4e9092d26943e2a058  1
7a1e43cba24a409aa172566e8f55b4c4  3
ee3bc233cb5b4745adbf37caf5834d0e  3
f894d45a70a94c4e9092d26943e2a058  3
7a1e43cba24a409aa172566e8f55b4c4  0
ee3bc233cb5b4745adbf37caf5834d0e  8
f894d45a70a94c4e9092d26943e2a058  1
7a1e43cba24a409aa172566e8f55b4c4  3
ee3bc233cb5b4745adbf37caf5834d0e  3
f894d45a70a94c4e9092d26943e2a058  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (34417 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:16:23.150254 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:36225
I20260709 12:16:23.151480 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.157511 19512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.157807 19513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.160498 18961 server_base.cc:1061] running on GCE node
W20260709 12:16:23.160779 19515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.161943 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.162127 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.162245 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599383162233 us; error 0 us; skew 500 ppm
I20260709 12:16:23.162703 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.165342 18961 webserver.cc:533] Webserver started at http://127.18.132.126:36155/ using document root <none> and password file <none>
I20260709 12:16:23.165802 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.165951 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.166157 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.167244 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "39057c8edd6948ef82c10a669c19019f"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.172072 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:16:23.175489 19520 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.176419 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:23.176641 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "39057c8edd6948ef82c10a669c19019f"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.176887 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.190353 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.191552 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.233837 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:36225
I20260709 12:16:23.233956 19571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:36225 every 8 connection(s)
I20260709 12:16:23.238138 19572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.248206 19572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f: Bootstrap starting.
I20260709 12:16:23.253440 19572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.257917 19572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f: No bootstrap required, opened a new log
I20260709 12:16:23.260233 19572 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39057c8edd6948ef82c10a669c19019f" member_type: VOTER }
I20260709 12:16:23.260661 19572 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.260921 19572 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39057c8edd6948ef82c10a669c19019f, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.261595 19572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39057c8edd6948ef82c10a669c19019f" member_type: VOTER }
I20260709 12:16:23.262090 19572 raft_consensus.cc:399] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:23.262319 19572 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:23.262609 19572 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.266808 19572 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39057c8edd6948ef82c10a669c19019f" member_type: VOTER }
I20260709 12:16:23.267338 19572 leader_election.cc:304] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39057c8edd6948ef82c10a669c19019f; no voters: 
I20260709 12:16:23.268623 19572 leader_election.cc:290] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:23.268960 19575 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.270416 19575 raft_consensus.cc:697] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 1 LEADER]: Becoming Leader. State: Replica: 39057c8edd6948ef82c10a669c19019f, State: Running, Role: LEADER
I20260709 12:16:23.271133 19575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39057c8edd6948ef82c10a669c19019f" member_type: VOTER }
I20260709 12:16:23.271838 19572 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:23.275622 19577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39057c8edd6948ef82c10a669c19019f. Latest consensus state: current_term: 1 leader_uuid: "39057c8edd6948ef82c10a669c19019f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39057c8edd6948ef82c10a669c19019f" member_type: VOTER } }
I20260709 12:16:23.276849 19577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:23.276345 19576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39057c8edd6948ef82c10a669c19019f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39057c8edd6948ef82c10a669c19019f" member_type: VOTER } }
I20260709 12:16:23.278225 19576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:23.278952 19582 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:23.285912 19582 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:23.288200 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:23.294667 19582 catalog_manager.cc:1383] Generated new cluster ID: 3f02a43f5aa54c58b9f34aec8e309e2f
I20260709 12:16:23.294926 19582 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:23.312723 19582 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:23.313962 19582 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:23.326879 19582 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f: Generated new TSK 0
I20260709 12:16:23.327409 19582 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:23.354671 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.371759 19593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.371739 19594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.374258 19596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.376143 18961 server_base.cc:1061] running on GCE node
I20260709 12:16:23.377202 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.377445 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.377661 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599383377620 us; error 0 us; skew 500 ppm
I20260709 12:16:23.378254 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.381081 18961 webserver.cc:533] Webserver started at http://127.18.132.65:33005/ using document root <none> and password file <none>
I20260709 12:16:23.381605 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.381806 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.382133 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.383476 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "cb1e34aa1d654226ba812e11773b0d16"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.388294 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:16:23.391924 19601 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.392892 18961 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:16:23.393199 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "cb1e34aa1d654226ba812e11773b0d16"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.393505 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.428853 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.430265 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.432052 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.434751 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.434989 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.435243 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.435446 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.480509 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:45191
I20260709 12:16:23.480608 19663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:45191 every 8 connection(s)
I20260709 12:16:23.485884 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.493834 19668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.494570 19669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.498970 18961 server_base.cc:1061] running on GCE node
W20260709 12:16:23.499547 19672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.500463 19664 heartbeater.cc:344] Connected to a master server at 127.18.132.126:36225
I20260709 12:16:23.500519 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.500881 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.500921 19664 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.501119 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599383501079 us; error 0 us; skew 500 ppm
I20260709 12:16:23.501740 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.501780 19664 heartbeater.cc:507] Master 127.18.132.126:36225 requested a full tablet report, sending...
I20260709 12:16:23.504220 19537 ts_manager.cc:194] Registered new tserver with Master: cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191)
I20260709 12:16:23.504915 18961 webserver.cc:533] Webserver started at http://127.18.132.66:32769/ using document root <none> and password file <none>
I20260709 12:16:23.505576 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.505842 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.506183 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.506803 19537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35020
I20260709 12:16:23.507848 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "999d051f57e6430abe44a22bd846d3b2"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.512336 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:23.515475 19676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.516271 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:23.516561 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "999d051f57e6430abe44a22bd846d3b2"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.516878 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.528795 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.530036 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.531533 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.533862 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.534096 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.534384 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.534575 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.577775 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:36253
I20260709 12:16:23.577872 19738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:36253 every 8 connection(s)
I20260709 12:16:23.583007 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.590934 19742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.593204 19743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.594424 19745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.595902 18961 server_base.cc:1061] running on GCE node
I20260709 12:16:23.596920 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.597177 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.597390 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599383597367 us; error 0 us; skew 500 ppm
I20260709 12:16:23.597462 19739 heartbeater.cc:344] Connected to a master server at 127.18.132.126:36225
I20260709 12:16:23.597908 19739 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.598052 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.598754 19739 heartbeater.cc:507] Master 127.18.132.126:36225 requested a full tablet report, sending...
I20260709 12:16:23.601004 18961 webserver.cc:533] Webserver started at http://127.18.132.67:45441/ using document root <none> and password file <none>
I20260709 12:16:23.601337 19537 ts_manager.cc:194] Registered new tserver with Master: 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:23.601568 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.601867 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.602146 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.602974 19537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35022
I20260709 12:16:23.603400 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.608198 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:23.611442 19750 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.612282 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:23.612577 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-xbvc"
I20260709 12:16:23.612886 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.626549 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.628077 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.629674 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.632068 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.632313 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.632586 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.632795 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.677235 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:33145
I20260709 12:16:23.677363 19812 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:33145 every 8 connection(s)
I20260709 12:16:23.692591 19813 heartbeater.cc:344] Connected to a master server at 127.18.132.126:36225
I20260709 12:16:23.693033 19813 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.693836 19813 heartbeater.cc:507] Master 127.18.132.126:36225 requested a full tablet report, sending...
I20260709 12:16:23.695996 19537 ts_manager.cc:194] Registered new tserver with Master: 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:23.696667 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015508074s
I20260709 12:16:23.697476 19537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35034
I20260709 12:16:23.725952 19537 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35050:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:23.729282 19537 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:23.810287 19778 tablet_service.cc:1511] Processing CreateTablet for tablet d580daa2890245119bc48db0dad3c808 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:23.811944 19778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d580daa2890245119bc48db0dad3c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.814510 19704 tablet_service.cc:1511] Processing CreateTablet for tablet d580daa2890245119bc48db0dad3c808 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:23.814706 19777 tablet_service.cc:1511] Processing CreateTablet for tablet 813d4b1c7e8c47f2b78a197067bec7a1 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:23.815949 19704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d580daa2890245119bc48db0dad3c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.816296 19777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813d4b1c7e8c47f2b78a197067bec7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.819190 19703 tablet_service.cc:1511] Processing CreateTablet for tablet 813d4b1c7e8c47f2b78a197067bec7a1 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:23.820607 19703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813d4b1c7e8c47f2b78a197067bec7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.821540 19776 tablet_service.cc:1511] Processing CreateTablet for tablet ec3d30a89a8f4679a6a3ada78cd389a9 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:23.822921 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3d30a89a8f4679a6a3ada78cd389a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.824602 19700 tablet_service.cc:1511] Processing CreateTablet for tablet 83d4a8d14ed94bdea7688388ab8b8583 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:23.825928 19700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d4a8d14ed94bdea7688388ab8b8583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.828871 19702 tablet_service.cc:1511] Processing CreateTablet for tablet ec3d30a89a8f4679a6a3ada78cd389a9 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:23.829528 19699 tablet_service.cc:1511] Processing CreateTablet for tablet e890ece149e64599b68ecc9d90bf49da (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:23.830199 19702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3d30a89a8f4679a6a3ada78cd389a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.830883 19699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e890ece149e64599b68ecc9d90bf49da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.832382 19701 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae9b05db1774a84a17e1fdee7f5644e (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:23.833647 19701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae9b05db1774a84a17e1fdee7f5644e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.837260 19775 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae9b05db1774a84a17e1fdee7f5644e (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:23.840188 19774 tablet_service.cc:1511] Processing CreateTablet for tablet 83d4a8d14ed94bdea7688388ab8b8583 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:23.840560 19629 tablet_service.cc:1511] Processing CreateTablet for tablet d580daa2890245119bc48db0dad3c808 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:23.841889 19629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d580daa2890245119bc48db0dad3c808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.842876 19775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae9b05db1774a84a17e1fdee7f5644e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.844434 19774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d4a8d14ed94bdea7688388ab8b8583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.853689 19628 tablet_service.cc:1511] Processing CreateTablet for tablet 813d4b1c7e8c47f2b78a197067bec7a1 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:23.854061 19627 tablet_service.cc:1511] Processing CreateTablet for tablet ec3d30a89a8f4679a6a3ada78cd389a9 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:23.855960 19626 tablet_service.cc:1511] Processing CreateTablet for tablet 8ae9b05db1774a84a17e1fdee7f5644e (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:23.856339 19773 tablet_service.cc:1511] Processing CreateTablet for tablet e890ece149e64599b68ecc9d90bf49da (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:23.857672 19773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e890ece149e64599b68ecc9d90bf49da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.857972 19625 tablet_service.cc:1511] Processing CreateTablet for tablet 83d4a8d14ed94bdea7688388ab8b8583 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:23.859596 19628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813d4b1c7e8c47f2b78a197067bec7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.860096 19624 tablet_service.cc:1511] Processing CreateTablet for tablet e890ece149e64599b68ecc9d90bf49da (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:23.861166 19772 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8f230c2c0549e5937975b5dbf8ed99 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:23.862563 19772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8f230c2c0549e5937975b5dbf8ed99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.863945 19698 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8f230c2c0549e5937975b5dbf8ed99 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:23.865510 19698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8f230c2c0549e5937975b5dbf8ed99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.867915 19622 tablet_service.cc:1511] Processing CreateTablet for tablet 884eea6089a441fb99fb24d77cde1f73 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:23.869899 19697 tablet_service.cc:1511] Processing CreateTablet for tablet 884eea6089a441fb99fb24d77cde1f73 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:23.862167 19623 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8f230c2c0549e5937975b5dbf8ed99 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:23.874488 19621 tablet_service.cc:1511] Processing CreateTablet for tablet e05f489f6c3a431ebe008229ff96d101 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:23.875998 19771 tablet_service.cc:1511] Processing CreateTablet for tablet 884eea6089a441fb99fb24d77cde1f73 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:23.876879 19697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884eea6089a441fb99fb24d77cde1f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.877482 19771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884eea6089a441fb99fb24d77cde1f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.875347 19696 tablet_service.cc:1511] Processing CreateTablet for tablet e05f489f6c3a431ebe008229ff96d101 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:23.879925 19696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05f489f6c3a431ebe008229ff96d101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.876343 19626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae9b05db1774a84a17e1fdee7f5644e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.888146 19621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05f489f6c3a431ebe008229ff96d101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.898049 19625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83d4a8d14ed94bdea7688388ab8b8583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.897320 19770 tablet_service.cc:1511] Processing CreateTablet for tablet e05f489f6c3a431ebe008229ff96d101 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:23.900249 19620 tablet_service.cc:1511] Processing CreateTablet for tablet bba2218cfa55471f9c824fcf1e579678 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:23.900921 19770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05f489f6c3a431ebe008229ff96d101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.901731 19620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba2218cfa55471f9c824fcf1e579678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.903981 19623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8f230c2c0549e5937975b5dbf8ed99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.905053 19627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3d30a89a8f4679a6a3ada78cd389a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.908823 19695 tablet_service.cc:1511] Processing CreateTablet for tablet bba2218cfa55471f9c824fcf1e579678 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:23.910246 19695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba2218cfa55471f9c824fcf1e579678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.911420 19776 tablet_service.cc:1511] Processing CreateTablet for tablet bba2218cfa55471f9c824fcf1e579678 (DEFAULT_TABLE table=test-workload [id=07cc1a1f85534693b5a472eede885e3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:23.912714 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba2218cfa55471f9c824fcf1e579678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.915444 19622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 884eea6089a441fb99fb24d77cde1f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.916106 19624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e890ece149e64599b68ecc9d90bf49da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.988458 19829 tablet_bootstrap.cc:492] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.023200 19830 tablet_bootstrap.cc:492] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.028270 19829 tablet_bootstrap.cc:654] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.036132 19828 tablet_bootstrap.cc:492] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.041603 19830 tablet_bootstrap.cc:654] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.046557 19829 tablet_bootstrap.cc:492] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.047056 19829 ts_tablet_manager.cc:1403] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 12:16:24.048249 19828 tablet_bootstrap.cc:654] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.048658 19830 tablet_bootstrap.cc:492] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.049083 19830 ts_tablet_manager.cc:1403] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 12:16:24.050185 19829 raft_consensus.cc:359] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.050992 19829 raft_consensus.cc:385] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.051373 19829 raft_consensus.cc:740] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.051458 19830 raft_consensus.cc:359] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.052336 19830 raft_consensus.cc:385] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.052836 19830 raft_consensus.cc:740] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.052315 19829 consensus_queue.cc:260] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.053577 19830 consensus_queue.cc:260] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.054330 19828 tablet_bootstrap.cc:492] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.054826 19828 ts_tablet_manager.cc:1403] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 12:16:24.055315 19739 heartbeater.cc:499] Master 127.18.132.126:36225 was elected leader, sending a full tablet report...
I20260709 12:16:24.055680 19829 ts_tablet_manager.cc:1434] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 12:16:24.056743 19829 tablet_bootstrap.cc:492] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.057840 19828 raft_consensus.cc:359] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.058521 19828 raft_consensus.cc:385] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.058794 19828 raft_consensus.cc:740] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.059742 19828 consensus_queue.cc:260] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.065220 19829 tablet_bootstrap.cc:654] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.070650 19830 ts_tablet_manager.cc:1434] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.010s
I20260709 12:16:24.071820 19830 tablet_bootstrap.cc:492] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.071815 19664 heartbeater.cc:499] Master 127.18.132.126:36225 was elected leader, sending a full tablet report...
I20260709 12:16:24.079370 19830 tablet_bootstrap.cc:654] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:24.084129 19740 tablet.cc:2406] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:24.085400 19829 tablet_bootstrap.cc:492] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.085951 19829 ts_tablet_manager.cc:1403] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.009s
I20260709 12:16:24.089259 19829 raft_consensus.cc:359] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.090163 19829 raft_consensus.cc:385] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.090378 19813 heartbeater.cc:499] Master 127.18.132.126:36225 was elected leader, sending a full tablet report...
I20260709 12:16:24.090504 19829 raft_consensus.cc:740] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.091423 19828 ts_tablet_manager.cc:1434] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.036s	user 0.020s	sys 0.003s
I20260709 12:16:24.091603 19830 tablet_bootstrap.cc:492] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.091495 19829 consensus_queue.cc:260] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.092275 19830 ts_tablet_manager.cc:1403] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 12:16:24.092626 19828 tablet_bootstrap.cc:492] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.094147 19829 ts_tablet_manager.cc:1434] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:24.095209 19829 tablet_bootstrap.cc:492] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.095887 19830 raft_consensus.cc:359] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.096823 19830 raft_consensus.cc:385] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.097208 19830 raft_consensus.cc:740] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.098146 19830 consensus_queue.cc:260] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.099521 19828 tablet_bootstrap.cc:654] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.100562 19830 ts_tablet_manager.cc:1434] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:24.101675 19830 tablet_bootstrap.cc:492] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.103238 19829 tablet_bootstrap.cc:654] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.109880 19836 raft_consensus.cc:493] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.110037 19830 tablet_bootstrap.cc:654] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.110411 19836 raft_consensus.cc:515] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.111683 19828 tablet_bootstrap.cc:492] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.112175 19828 ts_tablet_manager.cc:1403] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:16:24.112367 19829 tablet_bootstrap.cc:492] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.112830 19829 ts_tablet_manager.cc:1403] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:16:24.115473 19828 raft_consensus.cc:359] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.116204 19828 raft_consensus.cc:385] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.116494 19828 raft_consensus.cc:740] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.116730 19829 raft_consensus.cc:359] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.117261 19828 consensus_queue.cc:260] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.117661 19829 raft_consensus.cc:385] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.118218 19829 raft_consensus.cc:740] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.119488 19829 consensus_queue.cc:260] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.122859 19829 ts_tablet_manager.cc:1434] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:16:24.126202 19830 tablet_bootstrap.cc:492] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.126384 19836 leader_election.cc:290] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:24.126770 19830 ts_tablet_manager.cc:1403] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.012s
I20260709 12:16:24.130014 19830 raft_consensus.cc:359] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.130790 19830 raft_consensus.cc:385] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.131131 19830 raft_consensus.cc:740] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.132004 19830 consensus_queue.cc:260] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.134663 19830 ts_tablet_manager.cc:1434] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:24.135403 19829 tablet_bootstrap.cc:492] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.135757 19830 tablet_bootstrap.cc:492] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.142393 19830 tablet_bootstrap.cc:654] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.144220 19828 ts_tablet_manager.cc:1434] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.032s	user 0.019s	sys 0.013s
I20260709 12:16:24.145287 19828 tablet_bootstrap.cc:492] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.142393 19829 tablet_bootstrap.cc:654] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.152175 19828 tablet_bootstrap.cc:654] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.154026 19639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
W20260709 12:16:24.157370 19753 leader_election.cc:343] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.172889 19828 tablet_bootstrap.cc:492] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.173480 19828 ts_tablet_manager.cc:1403] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.015s
I20260709 12:16:24.176756 19828 raft_consensus.cc:359] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.177650 19828 raft_consensus.cc:385] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.178005 19828 raft_consensus.cc:740] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.178937 19828 consensus_queue.cc:260] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.172622 19714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.181270 19828 ts_tablet_manager.cc:1434] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:16:24.181484 19754 leader_election.cc:343] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.181946 19754 leader_election.cc:304] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c; no voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.182363 19828 tablet_bootstrap.cc:492] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.183410 19842 raft_consensus.cc:2749] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.189724 19828 tablet_bootstrap.cc:654] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.193868 19829 tablet_bootstrap.cc:492] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.194041 19830 tablet_bootstrap.cc:492] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.194437 19829 ts_tablet_manager.cc:1403] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.037s
I20260709 12:16:24.194730 19830 ts_tablet_manager.cc:1403] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.022s
I20260709 12:16:24.197783 19829 raft_consensus.cc:359] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.198736 19829 raft_consensus.cc:385] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.199105 19829 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.199131 19830 raft_consensus.cc:359] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.200326 19830 raft_consensus.cc:385] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.200304 19829 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.200959 19830 raft_consensus.cc:740] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.202185 19830 consensus_queue.cc:260] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.204834 19829 ts_tablet_manager.cc:1434] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:16:24.205714 19828 tablet_bootstrap.cc:492] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.205919 19829 tablet_bootstrap.cc:492] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.206244 19828 ts_tablet_manager.cc:1403] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 12:16:24.207304 19830 ts_tablet_manager.cc:1434] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:16:24.208343 19830 tablet_bootstrap.cc:492] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.209288 19828 raft_consensus.cc:359] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.210047 19828 raft_consensus.cc:385] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.210381 19828 raft_consensus.cc:740] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.211283 19828 consensus_queue.cc:260] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.213323 19829 tablet_bootstrap.cc:654] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.215812 19830 tablet_bootstrap.cc:654] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.216212 19828 ts_tablet_manager.cc:1434] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:24.217279 19828 tablet_bootstrap.cc:492] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.217449 19835 raft_consensus.cc:493] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.218181 19835 raft_consensus.cc:515] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.225031 19828 tablet_bootstrap.cc:654] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.231477 19835 leader_election.cc:290] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.246039 19828 tablet_bootstrap.cc:492] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.246680 19828 ts_tablet_manager.cc:1403] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 12:16:24.250002 19828 raft_consensus.cc:359] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.250846 19828 raft_consensus.cc:385] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.251245 19828 raft_consensus.cc:740] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.252080 19828 consensus_queue.cc:260] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.254369 19828 ts_tablet_manager.cc:1434] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:24.255486 19828 tablet_bootstrap.cc:492] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.262355 19828 tablet_bootstrap.cc:654] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.264365 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.265295 19788 raft_consensus.cc:2468] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.267341 19604 leader_election.cc:304] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.268584 19835 raft_consensus.cc:2804] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.269058 19835 raft_consensus.cc:493] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.269470 19835 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.270447 19830 tablet_bootstrap.cc:492] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.271114 19830 ts_tablet_manager.cc:1403] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.004s
I20260709 12:16:24.276716 19830 raft_consensus.cc:359] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.279914 19835 raft_consensus.cc:515] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.281884 19828 tablet_bootstrap.cc:492] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.282227 19829 tablet_bootstrap.cc:492] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.282548 19828 ts_tablet_manager.cc:1403] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.016s
I20260709 12:16:24.282740 19829 ts_tablet_manager.cc:1403] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.077s	user 0.031s	sys 0.038s
I20260709 12:16:24.283962 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.284545 19788 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.286321 19714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.286088 19829 raft_consensus.cc:359] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
W20260709 12:16:24.286578 19585 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:24.286851 19829 raft_consensus.cc:385] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.280380 19830 raft_consensus.cc:385] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.287189 19829 raft_consensus.cc:740] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.287326 19830 raft_consensus.cc:740] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.287725 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:24.288173 19829 consensus_queue.cc:260] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.288343 19830 consensus_queue.cc:260] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
W20260709 12:16:24.289557 19605 leader_election.cc:343] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:24.290696 19605 leader_election.cc:343] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.289631 19835 leader_election.cc:290] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.297417 19835 raft_consensus.cc:493] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.296097 19829 ts_tablet_manager.cc:1434] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:16:24.293504 19788 raft_consensus.cc:2468] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.299038 19829 tablet_bootstrap.cc:492] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.297210 19828 raft_consensus.cc:359] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.299927 19604 leader_election.cc:304] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.300619 19828 raft_consensus.cc:385] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.300963 19828 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.301728 19828 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.302089 19855 raft_consensus.cc:2804] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.298293 19835 raft_consensus.cc:515] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.305016 19830 ts_tablet_manager.cc:1434] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.034s	user 0.019s	sys 0.004s
I20260709 12:16:24.305104 19834 raft_consensus.cc:493] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.305697 19834 raft_consensus.cc:515] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.306237 19830 tablet_bootstrap.cc:492] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.310653 19828 ts_tablet_manager.cc:1434] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:16:24.310766 19834 leader_election.cc:290] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.309432 19855 raft_consensus.cc:697] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.313319 19834 raft_consensus.cc:493] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.316315 19828 tablet_bootstrap.cc:492] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.314950 19834 raft_consensus.cc:515] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.314152 19855 consensus_queue.cc:237] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.321061 19834 leader_election.cc:290] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.321554 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.322410 19713 raft_consensus.cc:2468] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.328281 19605 leader_election.cc:304] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.329712 19854 raft_consensus.cc:2804] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.330084 19854 raft_consensus.cc:493] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.330432 19854 raft_consensus.cc:3060] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.333725 19830 tablet_bootstrap.cc:654] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.341048 19828 tablet_bootstrap.cc:654] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.346861 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.344600 19537 catalog_manager.cc:5697] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:24.348464 19604 leader_election.cc:343] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.352149 19835 leader_election.cc:290] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.355118 19829 tablet_bootstrap.cc:654] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.358224 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
I20260709 12:16:24.358260 19639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
W20260709 12:16:24.360798 19679 leader_election.cc:343] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.350507 19854 raft_consensus.cc:515] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.363276 19638 raft_consensus.cc:2393] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 999d051f57e6430abe44a22bd846d3b2 in current term 1: Already voted for candidate cb1e34aa1d654226ba812e11773b0d16 in this term.
I20260709 12:16:24.362159 19830 tablet_bootstrap.cc:492] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.368649 19830 ts_tablet_manager.cc:1403] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.015s
I20260709 12:16:24.371865 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.372735 19788 raft_consensus.cc:2468] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 0.
I20260709 12:16:24.374491 19679 leader_election.cc:304] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.374924 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.375429 19834 raft_consensus.cc:2804] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.375851 19834 raft_consensus.cc:493] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.372753 19830 raft_consensus.cc:359] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.376315 19834 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:24.376387 19679 leader_election.cc:343] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.376626 19828 tablet_bootstrap.cc:492] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.376724 19830 raft_consensus.cc:385] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.376892 19679 leader_election.cc:304] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2; no voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.377228 19828 ts_tablet_manager.cc:1403] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.018s
I20260709 12:16:24.377189 19830 raft_consensus.cc:740] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.378162 19830 consensus_queue.cc:260] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.380160 19854 leader_election.cc:290] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.380340 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:24.380924 19713 raft_consensus.cc:3060] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.382161 19830 ts_tablet_manager.cc:1434] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:16:24.384233 19830 tablet_bootstrap.cc:492] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.384796 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
W20260709 12:16:24.388581 19604 leader_election.cc:343] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.388729 19834 raft_consensus.cc:515] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.389567 19828 raft_consensus.cc:359] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.390306 19828 raft_consensus.cc:385] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.390605 19828 raft_consensus.cc:740] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.391356 19828 consensus_queue.cc:260] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.392388 19713 raft_consensus.cc:2468] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.391388 19834 leader_election.cc:290] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.393745 19834 raft_consensus.cc:2749] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.394111 19828 ts_tablet_manager.cc:1434] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:16:24.395294 19828 tablet_bootstrap.cc:492] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.396561 19829 tablet_bootstrap.cc:492] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.397123 19829 ts_tablet_manager.cc:1403] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.012s
I20260709 12:16:24.399333 19830 tablet_bootstrap.cc:654] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.400303 19829 raft_consensus.cc:359] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.401127 19829 raft_consensus.cc:385] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.401490 19829 raft_consensus.cc:740] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.401736 19854 raft_consensus.cc:493] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.402223 19854 raft_consensus.cc:515] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.402622 19829 consensus_queue.cc:260] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.404399 19854 leader_election.cc:290] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.406417 19714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.407435 19829 ts_tablet_manager.cc:1434] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:24.408752 19829 tablet_bootstrap.cc:492] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
W20260709 12:16:24.412314 19605 leader_election.cc:343] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.416079 19830 tablet_bootstrap.cc:492] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.416630 19830 ts_tablet_manager.cc:1403] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.006s
I20260709 12:16:24.417259 19828 tablet_bootstrap.cc:654] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.418946 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.419704 19788 raft_consensus.cc:2468] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.420608 19830 raft_consensus.cc:359] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.421195 19604 leader_election.cc:304] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.421538 19830 raft_consensus.cc:385] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.421813 19829 tablet_bootstrap.cc:654] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.421975 19830 raft_consensus.cc:740] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.422853 19854 raft_consensus.cc:2804] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.422983 19830 consensus_queue.cc:260] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.423388 19854 raft_consensus.cc:493] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.423976 19854 raft_consensus.cc:3060] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:24.424310 19679 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:33145, user_credentials={real_user=slave}} blocked reactor thread for 47905.2us
I20260709 12:16:24.426618 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:24.430030 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.430879 19788 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.439800 19854 raft_consensus.cc:515] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.443595 19830 ts_tablet_manager.cc:1434] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:16:24.449550 19830 tablet_bootstrap.cc:492] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.451185 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:24.451804 19605 leader_election.cc:304] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:24.453135 19835 raft_consensus.cc:2804] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.453719 19835 raft_consensus.cc:697] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.447880 19854 leader_election.cc:290] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.450033 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.455895 19787 raft_consensus.cc:3060] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.457675 19828 tablet_bootstrap.cc:492] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.458148 19828 ts_tablet_manager.cc:1403] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.010s
I20260709 12:16:24.458730 19788 raft_consensus.cc:2468] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 1.
I20260709 12:16:24.459388 19830 tablet_bootstrap.cc:654] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.461077 19828 raft_consensus.cc:359] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.454775 19835 consensus_queue.cc:237] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.462500 19829 tablet_bootstrap.cc:492] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.463153 19829 ts_tablet_manager.cc:1403] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.005s
W20260709 12:16:24.444329 19679 leader_election.cc:343] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.464035 19679 leader_election.cc:304] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.467975 19828 raft_consensus.cc:385] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.468050 19863 raft_consensus.cc:2804] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.468783 19828 raft_consensus.cc:740] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.469038 19863 raft_consensus.cc:697] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:24.470227 19863 consensus_queue.cc:237] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
W20260709 12:16:24.469774 19605 leader_election.cc:343] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.469552 19828 consensus_queue.cc:260] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.475145 19787 raft_consensus.cc:2468] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.476380 19604 leader_election.cc:304] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.477582 19854 raft_consensus.cc:2804] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.477771 19842 raft_consensus.cc:493] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.477875 19834 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.478091 19854 raft_consensus.cc:697] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.478307 19842 raft_consensus.cc:515] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.478569 19834 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.479058 19854 consensus_queue.cc:237] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.480705 19842 leader_election.cc:290] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:24.481257 19834 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.482452 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
I20260709 12:16:24.483736 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
W20260709 12:16:24.484246 19753 leader_election.cc:343] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.484524 19788 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 0.
I20260709 12:16:24.485416 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
I20260709 12:16:24.486073 19679 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:24.486788 19828 ts_tablet_manager.cc:1434] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
W20260709 12:16:24.487268 19679 leader_election.cc:343] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.487772 19834 raft_consensus.cc:2804] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.491689 19834 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.492139 19834 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.488601 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.488798 19829 raft_consensus.cc:359] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.496317 19835 raft_consensus.cc:493] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.496567 19829 raft_consensus.cc:385] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.496994 19829 raft_consensus.cc:740] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
W20260709 12:16:24.497421 19754 leader_election.cc:343] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.497979 19754 leader_election.cc:304] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c; no voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.498083 19829 consensus_queue.cc:260] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.500196 19842 raft_consensus.cc:2749] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.502573 19828 tablet_bootstrap.cc:492] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.501677 19835 raft_consensus.cc:515] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.514197 19835 leader_election.cc:290] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:24.515388 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.516099 19787 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.518021 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.518656 19713 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.520074 19604 leader_election.cc:304] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.522818 19834 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.524295 19863 raft_consensus.cc:493] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.524389 19855 raft_consensus.cc:493] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.524936 19855 raft_consensus.cc:515] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.523473 19537 catalog_manager.cc:5697] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.527699 19835 raft_consensus.cc:2804] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.528101 19855 leader_election.cc:290] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.530819 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.528102 19835 raft_consensus.cc:493] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.532243 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.532688 19835 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:24.533775 19604 leader_election.cc:343] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.501088 19535 catalog_manager.cc:5697] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.537293 19828 tablet_bootstrap.cc:654] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.536993 19863 raft_consensus.cc:515] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.538753 19713 raft_consensus.cc:2468] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.540686 19605 leader_election.cc:304] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:24.543088 19855 raft_consensus.cc:2804] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.544176 19855 raft_consensus.cc:493] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.544615 19855 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.548523 19834 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.550552 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:24.550836 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.551378 19787 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:24.552105 19679 leader_election.cc:343] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.558140 19835 raft_consensus.cc:515] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.561939 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.562100 19863 leader_election.cc:290] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.562541 19788 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.562963 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:24.563537 19713 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.564879 19787 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 1.
I20260709 12:16:24.566341 19829 ts_tablet_manager.cc:1434] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.103s	user 0.025s	sys 0.021s
I20260709 12:16:24.567456 19829 tablet_bootstrap.cc:492] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.568749 19679 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.570518 19713 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.571069 19863 raft_consensus.cc:2804] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.572158 19605 leader_election.cc:304] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.572719 19863 raft_consensus.cc:697] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:24.573705 19863 consensus_queue.cc:237] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.574277 19829 tablet_bootstrap.cc:654] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.578639 19830 tablet_bootstrap.cc:492] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.574539 19788 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.579262 19830 ts_tablet_manager.cc:1403] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.130s	user 0.045s	sys 0.042s
I20260709 12:16:24.575215 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.575800 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
I20260709 12:16:24.579422 19535 catalog_manager.cc:5697] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.576530 19854 raft_consensus.cc:2804] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.584074 19830 raft_consensus.cc:359] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.584772 19830 raft_consensus.cc:385] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.585098 19830 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.585865 19830 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.576854 19835 leader_election.cc:290] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
W20260709 12:16:24.590443 19679 leader_election.cc:343] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.590780 19829 tablet_bootstrap.cc:492] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.591249 19829 ts_tablet_manager.cc:1403] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:16:24.594590 19829 raft_consensus.cc:359] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.578177 19855 raft_consensus.cc:515] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.597093 19638 raft_consensus.cc:2393] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 999d051f57e6430abe44a22bd846d3b2 in current term 1: Already voted for candidate cb1e34aa1d654226ba812e11773b0d16 in this term.
I20260709 12:16:24.595665 19829 raft_consensus.cc:385] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.597513 19829 raft_consensus.cc:740] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.598333 19829 consensus_queue.cc:260] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.598973 19679 leader_election.cc:304] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2; no voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.599432 19828 tablet_bootstrap.cc:492] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.602138 19863 raft_consensus.cc:493] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.600085 19830 ts_tablet_manager.cc:1434] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:16:24.600780 19854 raft_consensus.cc:697] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.602859 19873 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.602607 19863 raft_consensus.cc:515] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.603374 19854 consensus_queue.cc:237] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:24.604902 19863 leader_election.cc:290] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.602581 19828 ts_tablet_manager.cc:1403] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.010s
I20260709 12:16:24.605545 19535 catalog_manager.cc:5697] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.607029 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.607919 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
W20260709 12:16:24.608374 19604 leader_election.cc:343] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.609136 19855 leader_election.cc:290] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.608176 19828 raft_consensus.cc:359] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.609826 19828 raft_consensus.cc:385] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.609944 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
I20260709 12:16:24.610181 19828 raft_consensus.cc:740] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.610613 19638 raft_consensus.cc:2468] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 0.
I20260709 12:16:24.611527 19830 tablet_bootstrap.cc:492] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.611129 19828 consensus_queue.cc:260] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.612741 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.612850 19679 leader_election.cc:304] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.614251 19863 raft_consensus.cc:2804] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.614609 19863 raft_consensus.cc:493] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.614943 19863 raft_consensus.cc:3060] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.617528 19873 raft_consensus.cc:2749] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:24.618873 19679 leader_election.cc:343] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.620414 19828 ts_tablet_manager.cc:1434] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:24.621340 19828 tablet_bootstrap.cc:492] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c: Bootstrap starting.
I20260709 12:16:24.625212 19713 raft_consensus.cc:2468] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.627012 19605 leader_election.cc:304] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:24.625738 19863 raft_consensus.cc:515] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.630782 19829 ts_tablet_manager.cc:1434] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:16:24.629879 19855 raft_consensus.cc:2804] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.641580 19855 raft_consensus.cc:697] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.642905 19828 tablet_bootstrap.cc:654] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.642544 19855 consensus_queue.cc:237] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.643478 19829 tablet_bootstrap.cc:492] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.653069 19829 tablet_bootstrap.cc:654] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.657083 19828 tablet_bootstrap.cc:492] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c: No bootstrap required, opened a new log
I20260709 12:16:24.656769 19537 catalog_manager.cc:5697] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.657744 19828 ts_tablet_manager.cc:1403] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.007s
I20260709 12:16:24.663676 19828 raft_consensus.cc:359] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.664316 19828 raft_consensus.cc:385] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.664742 19828 raft_consensus.cc:740] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.665464 19828 consensus_queue.cc:260] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.666886 19829 tablet_bootstrap.cc:492] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.667382 19829 ts_tablet_manager.cc:1403] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.006s
I20260709 12:16:24.667537 19828 ts_tablet_manager.cc:1434] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:24.657550 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:24.668303 19638 raft_consensus.cc:3060] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.670251 19829 raft_consensus.cc:359] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.660219 19830 tablet_bootstrap.cc:654] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.670972 19829 raft_consensus.cc:385] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.671272 19829 raft_consensus.cc:740] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.672101 19829 consensus_queue.cc:260] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.658725 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.673467 19787 raft_consensus.cc:3060] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.674042 19829 ts_tablet_manager.cc:1434] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:24.675120 19829 tablet_bootstrap.cc:492] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2: Bootstrap starting.
I20260709 12:16:24.658181 19863 leader_election.cc:290] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.675323 19535 catalog_manager.cc:5697] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.681455 19829 tablet_bootstrap.cc:654] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.687243 19829 tablet_bootstrap.cc:492] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2: No bootstrap required, opened a new log
I20260709 12:16:24.687768 19829 ts_tablet_manager.cc:1403] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:16:24.690555 19829 raft_consensus.cc:359] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.691198 19829 raft_consensus.cc:385] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.691486 19829 raft_consensus.cc:740] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.692258 19829 consensus_queue.cc:260] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.692925 19787 raft_consensus.cc:2468] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 1.
I20260709 12:16:24.694103 19829 ts_tablet_manager.cc:1434] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:24.695999 19679 leader_election.cc:304] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:24.697239 19863 raft_consensus.cc:2804] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.697683 19863 raft_consensus.cc:697] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:24.698105 19638 raft_consensus.cc:2468] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 1.
I20260709 12:16:24.698365 19863 consensus_queue.cc:237] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.701247 19830 tablet_bootstrap.cc:492] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.701696 19830 ts_tablet_manager.cc:1403] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.090s	user 0.004s	sys 0.008s
I20260709 12:16:24.704689 19830 raft_consensus.cc:359] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.705261 19830 raft_consensus.cc:385] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.705529 19830 raft_consensus.cc:740] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.706197 19830 consensus_queue.cc:260] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.708243 19830 ts_tablet_manager.cc:1434] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:16:24.709215 19830 tablet_bootstrap.cc:492] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: Bootstrap starting.
I20260709 12:16:24.708524 19534 catalog_manager.cc:5697] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.715791 19830 tablet_bootstrap.cc:654] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.720378 19830 tablet_bootstrap.cc:492] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: No bootstrap required, opened a new log
I20260709 12:16:24.720861 19830 ts_tablet_manager.cc:1403] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 12:16:24.723011 19830 raft_consensus.cc:359] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.723496 19830 raft_consensus.cc:385] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.723812 19830 raft_consensus.cc:740] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.724400 19830 consensus_queue.cc:260] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.726197 19830 ts_tablet_manager.cc:1434] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:24.732435 19855 raft_consensus.cc:493] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.732933 19855 raft_consensus.cc:515] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.734728 19855 leader_election.cc:290] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.735679 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.735889 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.736275 19713 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.736605 19787 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.737330 19605 leader_election.cc:304] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.738137 19854 raft_consensus.cc:2804] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.738420 19854 raft_consensus.cc:493] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.738729 19854 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.740696 19855 consensus_queue.cc:1048] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.746131 19854 raft_consensus.cc:515] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.747921 19854 leader_election.cc:290] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.748494 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:24.748962 19713 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.752306 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.752902 19787 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.758199 19713 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.760020 19787 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.760327 19605 leader_election.cc:304] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.761350 19877 raft_consensus.cc:2804] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.761838 19877 raft_consensus.cc:697] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.762672 19877 consensus_queue.cc:237] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.765805 19713 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.771329 19534 catalog_manager.cc:5697] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.772480 19877 consensus_queue.cc:1048] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.813138 19877 raft_consensus.cc:493] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.813664 19877 raft_consensus.cc:515] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.815483 19842 raft_consensus.cc:493] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.816102 19877 leader_election.cc:290] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.816045 19842 raft_consensus.cc:515] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.816464 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.816824 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.817174 19713 raft_consensus.cc:2468] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.817428 19787 raft_consensus.cc:2468] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 0.
I20260709 12:16:24.818313 19842 leader_election.cc:290] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:24.818408 19605 leader_election.cc:304] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.819068 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb1e34aa1d654226ba812e11773b0d16" is_pre_election: true
I20260709 12:16:24.819361 19877 raft_consensus.cc:2804] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.819828 19877 raft_consensus.cc:493] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.819969 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.820189 19877 raft_consensus.cc:3060] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.820736 19713 raft_consensus.cc:2393] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20dfa7a2de9d44839dd78dcaef9b090c in current term 1: Already voted for candidate cb1e34aa1d654226ba812e11773b0d16 in this term.
I20260709 12:16:24.821703 19754 leader_election.cc:304] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c; no voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.822470 19842 raft_consensus.cc:3060] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.826171 19877 raft_consensus.cc:515] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.827849 19842 raft_consensus.cc:2749] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.829056 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:24.829128 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:24.829299 19877 leader_election.cc:290] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.829777 19787 raft_consensus.cc:3060] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.829746 19713 raft_consensus.cc:3060] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.836977 19713 raft_consensus.cc:2468] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.836977 19787 raft_consensus.cc:2468] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 1.
I20260709 12:16:24.838346 19604 leader_election.cc:304] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:24.839205 19877 raft_consensus.cc:2804] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.839639 19877 raft_consensus.cc:697] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:24.840525 19877 consensus_queue.cc:237] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.847838 19535 catalog_manager.cc:5697] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.883538 19877 consensus_queue.cc:1048] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.894222 19713 raft_consensus.cc:3060] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.902896 19854 consensus_queue.cc:1048] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.928577 19713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:55114
I20260709 12:16:24.929198 19713 raft_consensus.cc:606] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:24.941941 19854 raft_consensus.cc:493] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.942425 19854 raft_consensus.cc:515] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.944662 19854 leader_election.cc:290] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.945436 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.946096 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.946151 19638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:34828
I20260709 12:16:24.946790 19638 raft_consensus.cc:606] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.946888 19787 raft_consensus.cc:2393] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb1e34aa1d654226ba812e11773b0d16 in current term 1: Already voted for candidate 999d051f57e6430abe44a22bd846d3b2 in this term.
I20260709 12:16:24.948153 19604 leader_election.cc:304] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb1e34aa1d654226ba812e11773b0d16; no voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.948937 19854 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.955245 19854 raft_consensus.cc:2749] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.956489 19639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:34828
I20260709 12:16:24.957001 19639 raft_consensus.cc:606] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.958936 19863 consensus_queue.cc:1048] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.962054 19639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:34828
I20260709 12:16:24.962618 19639 raft_consensus.cc:606] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:24.974052 19873 consensus_queue.cc:1048] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.975685 19873 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.985730 19854 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.986217 19854 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:24.986961 19874 consensus_queue.cc:1048] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.988385 19854 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:24.989511 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" is_pre_election: true
I20260709 12:16:24.990010 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999d051f57e6430abe44a22bd846d3b2" is_pre_election: true
I20260709 12:16:24.991402 19605 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb1e34aa1d654226ba812e11773b0d16; no voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:24.992237 19854 raft_consensus.cc:2749] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.999030 19638 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.005367 19874 raft_consensus.cc:993] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:25.006306 19874 raft_consensus.cc:1081] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:25.008390 19713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:55108
I20260709 12:16:25.008836 19834 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.009006 19713 raft_consensus.cc:493] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.009502 19713 raft_consensus.cc:3060] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.015717 19854 consensus_queue.cc:1048] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.017063 19713 raft_consensus.cc:515] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.024840 19834 raft_consensus.cc:993] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:25.025305 19873 raft_consensus.cc:1081] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:25.027321 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34812
I20260709 12:16:25.029460 19638 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.029888 19638 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.030056 19639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:25.030603 19713 leader_election.cc:290] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 2 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:25.030859 19639 raft_consensus.cc:3055] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.030829 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05f489f6c3a431ebe008229ff96d101" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:25.031378 19639 raft_consensus.cc:740] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:25.032259 19639 consensus_queue.cc:260] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.033191 19639 raft_consensus.cc:3060] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.037731 19638 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.041461 19639 raft_consensus.cc:2468] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 2.
I20260709 12:16:25.043255 19787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:25.043439 19679 leader_election.cc:304] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:25.043979 19787 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.044368 19834 raft_consensus.cc:2804] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.044741 19638 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 2 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:25.044844 19834 raft_consensus.cc:697] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:25.047797 19834 consensus_queue.cc:237] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.044780 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:25.051064 19713 raft_consensus.cc:3055] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.051337 19787 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 2.
I20260709 12:16:25.051419 19713 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:25.052536 19604 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:25.052383 19713 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.053284 19854 raft_consensus.cc:2804] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.053740 19713 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.053769 19854 raft_consensus.cc:697] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:25.054951 19854 consensus_queue.cc:237] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.055950 19535 catalog_manager.cc:5697] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.060629 19713 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 2.
I20260709 12:16:25.063339 19854 consensus_queue.cc:1048] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.063077 19534 catalog_manager.cc:5697] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 1 to 2, leader changed from 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.070513 19874 raft_consensus.cc:993] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:25.070971 19874 raft_consensus.cc:1081] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:25.072741 19713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:55108
I20260709 12:16:25.073628 19713 raft_consensus.cc:493] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.074009 19713 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.075191 19787 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.082360 19713 raft_consensus.cc:515] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.083431 19714 raft_consensus.cc:1240] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Rejecting Update request from peer cb1e34aa1d654226ba812e11773b0d16 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:25.084605 19713 leader_election.cc:290] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 2 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:25.085479 19874 consensus_queue.cc:1048] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.085721 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:25.086007 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:25.086263 19788 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.086236 19855 consensus_queue.cc:1059] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.087410 19638 raft_consensus.cc:3055] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.087797 19638 raft_consensus.cc:740] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:25.088661 19638 consensus_queue.cc:260] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.089855 19638 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.092579 19788 raft_consensus.cc:2468] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 2.
I20260709 12:16:25.093354 19787 raft_consensus.cc:1240] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Rejecting Update request from peer cb1e34aa1d654226ba812e11773b0d16 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:16:25.093662 19679 leader_election.cc:304] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:25.094530 19834 raft_consensus.cc:2804] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.095007 19834 raft_consensus.cc:697] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:25.095882 19834 consensus_queue.cc:237] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.096457 19638 raft_consensus.cc:2468] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 2.
W20260709 12:16:25.099810 19854 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:16:25.103711 19534 catalog_manager.cc:5697] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.142545 19834 consensus_queue.cc:1048] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.153677 19873 consensus_queue.cc:1048] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.158429 19874 consensus_queue.cc:1048] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.162034 19874 consensus_queue.cc:1048] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.198475 19855 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.199142 19854 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.328516 19855 consensus_queue.cc:1048] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.339161 19854 consensus_queue.cc:1048] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.463515 19787 raft_consensus.cc:3060] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.469290 19787 raft_consensus.cc:1275] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.470906 19873 consensus_queue.cc:1048] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.478538 19638 raft_consensus.cc:1275] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.480719 19863 consensus_queue.cc:1048] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.496985 19835 raft_consensus.cc:993] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:25.497452 19854 raft_consensus.cc:1081] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:25.498700 19787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:25.499166 19787 raft_consensus.cc:493] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.499475 19787 raft_consensus.cc:3060] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.504251 19788 raft_consensus.cc:1275] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.505579 19787 raft_consensus.cc:515] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.505766 19863 consensus_queue.cc:1048] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.508347 19638 raft_consensus.cc:1275] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.508884 19787 leader_election.cc:290] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:25.509277 19639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:25.509859 19639 raft_consensus.cc:3055] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.510241 19639 raft_consensus.cc:740] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:25.510455 19863 consensus_queue.cc:1048] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:25.511121 19639 consensus_queue.cc:260] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.512410 19639 raft_consensus.cc:3060] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.516672 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2218cfa55471f9c824fcf1e579678" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:25.517331 19713 raft_consensus.cc:3060] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.528792 19713 raft_consensus.cc:2468] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:25.530131 19754 leader_election.cc:304] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:25.531334 19842 raft_consensus.cc:2804] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.533264 19639 raft_consensus.cc:2468] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:25.537787 19842 raft_consensus.cc:697] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:25.540671 19842 consensus_queue.cc:237] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:25.547978 19536 catalog_manager.cc:5697] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.597688 19713 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.599138 19854 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.608408 19788 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.609899 19835 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.934269 19713 raft_consensus.cc:1275] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.935691 19842 consensus_queue.cc:1048] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.945546 19639 raft_consensus.cc:1275] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.947330 19842 consensus_queue.cc:1048] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:27.996923 18961 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:16:27.997717 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:28.014145 19639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:28.014787 19639 raft_consensus.cc:606] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:28.017261 19639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:28.017834 19639 raft_consensus.cc:606] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:28.019099 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:28.019632 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:28.224298 19855 raft_consensus.cc:993] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:28.225625 19855 raft_consensus.cc:1081] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:28.227854 19788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:28.228621 19788 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.229153 19788 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.262321 19788 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:28.268383 19639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:28.269325 19639 raft_consensus.cc:3055] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:28.269789 19639 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:28.271071 19639 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:28.272677 19639 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.283360 19788 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 3 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:28.284806 19713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:28.286273 19713 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.295658 19713 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 3.
I20260709 12:16:28.297418 19754 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:28.298396 19920 raft_consensus.cc:2804] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:28.310751 19639 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 3.
I20260709 12:16:28.319170 19920 raft_consensus.cc:697] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:28.320247 19920 consensus_queue.cc:237] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.065418 19639 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:29.084153 19714 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:29.087139 19924 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:16:29.128113 19924 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:29.137213 19927 raft_consensus.cc:993] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:29.138453 19927 raft_consensus.cc:1081] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:29.141712 19787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:29.142441 19787 raft_consensus.cc:493] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:29.142877 19787 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.143836 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:29.199849 19535 catalog_manager.cc:5697] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 2 to 3, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 3 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.202731 19787 raft_consensus.cc:515] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.212706 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:29.213487 19638 raft_consensus.cc:3055] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:29.213899 19638 raft_consensus.cc:740] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:29.214164 19787 leader_election.cc:290] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:29.215023 19638 consensus_queue.cc:260] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.216614 19638 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.216471 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:29.217164 19712 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.220304 19639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:29.221212 19639 raft_consensus.cc:606] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:29.225533 19712 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:29.225560 19639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d580daa2890245119bc48db0dad3c808"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:29.225538 19638 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:29.226537 19639 raft_consensus.cc:606] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:29.227388 19753 leader_election.cc:304] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:29.228497 19924 raft_consensus.cc:2804] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:29.229089 19924 raft_consensus.cc:697] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:29.230063 19924 consensus_queue.cc:237] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.231837 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:29.232544 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:29.246495 19534 catalog_manager.cc:5697] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.517856 19932 raft_consensus.cc:993] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:29.518579 19928 raft_consensus.cc:1081] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:29.520232 19787 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:29.520880 19787 raft_consensus.cc:493] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:29.521299 19787 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.526643 19787 raft_consensus.cc:515] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.528162 19787 leader_election.cc:290] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:29.529083 19639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:29.529323 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:29.529712 19639 raft_consensus.cc:3055] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:29.529865 19712 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.530037 19639 raft_consensus.cc:740] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:29.531030 19639 consensus_queue.cc:260] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.532258 19639 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.536722 19712 raft_consensus.cc:2468] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:29.539659 19754 leader_election.cc:304] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:29.540441 19639 raft_consensus.cc:2468] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:29.540660 19924 raft_consensus.cc:2804] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:29.541265 19924 raft_consensus.cc:697] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:29.542339 19924 consensus_queue.cc:237] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:29.550066 19534 catalog_manager.cc:5697] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.620481 19927 raft_consensus.cc:993] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:29.621052 19928 raft_consensus.cc:1081] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:29.622807 19788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d580daa2890245119bc48db0dad3c808"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:29.623267 19788 raft_consensus.cc:493] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:29.623529 19788 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.629110 19788 raft_consensus.cc:515] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:29.630851 19788 leader_election.cc:290] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191)
I20260709 12:16:29.631654 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:29.631954 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:29.632294 19712 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.632498 19638 raft_consensus.cc:3055] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:29.632993 19638 raft_consensus.cc:740] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:29.633905 19638 consensus_queue.cc:260] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:29.635205 19638 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:29.639624 19712 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:29.640815 19754 leader_election.cc:304] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:29.641702 19924 raft_consensus.cc:2804] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:29.642174 19924 raft_consensus.cc:697] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:29.642967 19638 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 2.
I20260709 12:16:29.643129 19924 consensus_queue.cc:237] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:29.649912 19534 catalog_manager.cc:5697] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:29.775265 19712 raft_consensus.cc:1275] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:29.776708 19924 consensus_queue.cc:1048] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:29.788910 19638 raft_consensus.cc:1275] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:29.790344 19924 consensus_queue.cc:1048] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:29.873576 19568 debug-util.cc:398] Leaking SignalData structure 0x7b0800053fe0 after lost signal to thread 18964
W20260709 12:16:29.874610 19568 debug-util.cc:398] Leaking SignalData structure 0x7b08000506c0 after lost signal to thread 19571
W20260709 12:16:29.875662 19568 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecd40 after lost signal to thread 19663
W20260709 12:16:29.876534 19568 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8900 after lost signal to thread 19738
W20260709 12:16:29.877403 19568 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8b00 after lost signal to thread 19812
I20260709 12:16:29.952271 19638 raft_consensus.cc:1275] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:29.953743 19924 consensus_queue.cc:1048] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:29.966966 19712 raft_consensus.cc:1275] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:29.969151 19936 consensus_queue.cc:1048] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:30.077729 19638 raft_consensus.cc:1275] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.079200 19936 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.094322 19712 raft_consensus.cc:1275] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:30.095768 19933 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.234342 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:30.259752 19788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:39078
I20260709 12:16:30.260445 19788 raft_consensus.cc:606] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:30.274314 19712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:47494
I20260709 12:16:30.275040 19712 raft_consensus.cc:606] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:30.276557 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:30.277068 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:30.629480 19924 raft_consensus.cc:993] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:30.630681 19936 raft_consensus.cc:1081] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:30.632704 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34802
I20260709 12:16:30.633433 19638 raft_consensus.cc:493] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:30.633845 19638 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:30.642385 19638 raft_consensus.cc:515] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:30.645345 19638 leader_election.cc:290] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:30.646037 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:30.646026 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813d4b1c7e8c47f2b78a197067bec7a1" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:30.646847 19712 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:30.646888 19788 raft_consensus.cc:3055] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:30.647392 19788 raft_consensus.cc:740] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:30.648309 19788 consensus_queue.cc:260] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:30.649659 19788 raft_consensus.cc:3060] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:30.655895 19712 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:30.657459 19605 leader_election.cc:304] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:30.658277 19788 raft_consensus.cc:2468] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:30.658329 19960 raft_consensus.cc:2804] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:30.662364 19960 raft_consensus.cc:697] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:30.663607 19960 consensus_queue.cc:237] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:30.673825 19536 catalog_manager.cc:5697] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 2 to 3, leader changed from 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:30.743862 19940 raft_consensus.cc:993] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:30.744589 19966 raft_consensus.cc:1081] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:30.746227 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34812
I20260709 12:16:30.746745 19638 raft_consensus.cc:493] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:30.747062 19638 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.752276 19638 raft_consensus.cc:515] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:30.754256 19638 leader_election.cc:290] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 2 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:30.754742 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:30.754884 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:30.755443 19712 raft_consensus.cc:3055] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:30.755462 19788 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.755878 19712 raft_consensus.cc:740] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:30.758116 19712 consensus_queue.cc:260] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:30.759649 19712 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.761843 19788 raft_consensus.cc:2468] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 2.
I20260709 12:16:30.763119 19604 leader_election.cc:304] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:30.763948 19960 raft_consensus.cc:2804] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.764468 19960 raft_consensus.cc:697] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:30.765321 19960 consensus_queue.cc:237] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:30.768683 19712 raft_consensus.cc:2468] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 2.
I20260709 12:16:30.773620 19536 catalog_manager.cc:5697] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 1 to 2, leader changed from 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.118475 19712 raft_consensus.cc:1275] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:31.119791 19960 consensus_queue.cc:1048] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:31.133522 19788 raft_consensus.cc:1275] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:31.135525 19961 consensus_queue.cc:1048] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:31.177273 19712 raft_consensus.cc:1275] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.178867 19960 consensus_queue.cc:1048] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.192292 19788 raft_consensus.cc:1275] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.193997 19960 consensus_queue.cc:1048] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.278453 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:31.287978 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:31.288573 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:32.289687 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:32.295288 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:32.295740 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:33.296813 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:33.302223 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:33.302636 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:34.303714 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:34.309945 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:34.310544 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:35.311494 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:35.317171 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:35.317570 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:36.318562 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:36.324605 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:36.325028 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:37.326146 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:37.332804 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:37.333262 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:38.362046 18961 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:16:38.375521 19788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d580daa2890245119bc48db0dad3c808"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:16:38.376106 19788 raft_consensus.cc:606] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:38.385524 19788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:16:38.386034 19788 raft_consensus.cc:606] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:38.390318 19788 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:16:38.390787 19788 raft_consensus.cc:606] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:38.397756 19712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:55114
I20260709 12:16:38.398224 19712 raft_consensus.cc:606] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:38.402451 19712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
mode: GRACEFUL
new_leader_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:55114
I20260709 12:16:38.402901 19712 raft_consensus.cc:606] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Received request to transfer leadership to TS cb1e34aa1d654226ba812e11773b0d16
I20260709 12:16:38.643189 19982 raft_consensus.cc:993] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.643692 19979 raft_consensus.cc:1081] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.645048 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34802
I20260709 12:16:38.645457 19638 raft_consensus.cc:493] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.645684 19638 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.650413 19638 raft_consensus.cc:515] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.651968 19638 leader_election.cc:290] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:38.652844 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:38.653062 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ae9b05db1774a84a17e1fdee7f5644e" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:38.653370 19712 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.653635 19788 raft_consensus.cc:3055] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:38.653906 19788 raft_consensus.cc:740] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:38.654567 19788 consensus_queue.cc:260] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.655432 19788 raft_consensus.cc:3060] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.658448 19712 raft_consensus.cc:2468] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:38.659612 19605 leader_election.cc:304] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:38.660410 19960 raft_consensus.cc:2804] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:38.661401 19788 raft_consensus.cc:2468] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:38.662024 19960 raft_consensus.cc:697] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:38.663003 19960 consensus_queue.cc:237] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.669981 19536 catalog_manager.cc:5697] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 2 to 3, leader changed from 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.717984 19982 raft_consensus.cc:993] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.718457 19979 raft_consensus.cc:1081] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.719799 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34802
I20260709 12:16:38.720201 19638 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.720425 19638 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.725082 19638 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.726434 19638 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 4 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:38.727203 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:38.727510 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:38.727763 19712 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.728083 19788 raft_consensus.cc:3055] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:38.728394 19788 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:38.729033 19788 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.729995 19788 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.732475 19712 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 4.
I20260709 12:16:38.733349 19605 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:38.733983 19960 raft_consensus.cc:2804] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:38.734454 19960 raft_consensus.cc:697] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:38.735553 19788 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 4.
I20260709 12:16:38.735291 19960 consensus_queue.cc:237] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.742661 19536 catalog_manager.cc:5697] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 3 to 4, leader changed from 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.774535 19978 raft_consensus.cc:993] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.774981 19993 raft_consensus.cc:1081] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.776398 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34812
I20260709 12:16:38.776892 19638 raft_consensus.cc:493] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.777197 19638 raft_consensus.cc:3060] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.781934 19638 raft_consensus.cc:515] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.783385 19638 leader_election.cc:290] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 2 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:38.784411 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:38.784571 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "884eea6089a441fb99fb24d77cde1f73" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:38.784937 19712 raft_consensus.cc:3055] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.785142 19788 raft_consensus.cc:3060] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.785295 19712 raft_consensus.cc:740] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:38.786078 19712 consensus_queue.cc:260] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.786974 19712 raft_consensus.cc:3060] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.790303 19788 raft_consensus.cc:2468] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 2.
I20260709 12:16:38.791325 19604 leader_election.cc:304] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:38.792217 19960 raft_consensus.cc:2804] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.792619 19960 raft_consensus.cc:697] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:38.793506 19712 raft_consensus.cc:2468] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 2.
I20260709 12:16:38.793432 19960 consensus_queue.cc:237] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.800477 19536 catalog_manager.cc:5697] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 1 to 2, leader changed from 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.837602 19978 raft_consensus.cc:993] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.838116 19993 raft_consensus.cc:1081] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.839613 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34812
I20260709 12:16:38.840103 19638 raft_consensus.cc:493] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.840397 19638 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.844964 19638 raft_consensus.cc:515] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.846557 19638 leader_election.cc:290] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Requested vote from peers 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:38.847270 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:38.847630 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8f230c2c0549e5937975b5dbf8ed99" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:38.847888 19712 raft_consensus.cc:3055] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:38.848136 19788 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.848220 19712 raft_consensus.cc:740] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:38.849026 19712 consensus_queue.cc:260] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.850194 19712 raft_consensus.cc:3060] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.854827 19788 raft_consensus.cc:2468] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:38.855907 19604 leader_election.cc:304] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:38.856693 19960 raft_consensus.cc:2804] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:38.856688 19712 raft_consensus.cc:2468] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:38.857414 19960 raft_consensus.cc:697] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:38.858299 19960 consensus_queue.cc:237] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:38.865072 19536 catalog_manager.cc:5697] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 2 to 3, leader changed from 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.901508 19982 raft_consensus.cc:993] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: : Instructing follower cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.901968 19979 raft_consensus.cc:1081] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Signalling peer cb1e34aa1d654226ba812e11773b0d16 to start an election
I20260709 12:16:38.903316 19638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d580daa2890245119bc48db0dad3c808"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
 from {username='slave'} at 127.0.0.1:34802
I20260709 12:16:38.903823 19638 raft_consensus.cc:493] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.904089 19638 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.908577 19638 raft_consensus.cc:515] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:38.910068 19638 leader_election.cc:290] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Requested vote from peers 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:38.911006 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:38.910969 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "cb1e34aa1d654226ba812e11773b0d16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:38.911713 19712 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.911762 19788 raft_consensus.cc:3055] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:38.912130 19788 raft_consensus.cc:740] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:38.912774 19788 consensus_queue.cc:260] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:38.913627 19788 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.916270 19712 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:38.917085 19605 leader_election.cc:304] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999d051f57e6430abe44a22bd846d3b2, cb1e34aa1d654226ba812e11773b0d16; no voters: 
I20260709 12:16:38.917711 19960 raft_consensus.cc:2804] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:38.918069 19960 raft_consensus.cc:697] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Becoming Leader. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:38.918322 19788 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb1e34aa1d654226ba812e11773b0d16 in term 3.
I20260709 12:16:38.918768 19960 consensus_queue.cc:237] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:38.925050 19536 catalog_manager.cc:5697] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 reported cstate change: term changed from 2 to 3, leader changed from 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67) to cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "cb1e34aa1d654226ba812e11773b0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.071787 19712 raft_consensus.cc:1275] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.073505 19960 consensus_queue.cc:1048] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:39.077745 19788 raft_consensus.cc:1275] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.079358 19960 consensus_queue.cc:1048] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:39.213439 19788 raft_consensus.cc:1275] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:39.214738 19985 consensus_queue.cc:1048] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:39.224686 19712 raft_consensus.cc:1275] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:39.226980 20004 consensus_queue.cc:1048] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:39.290679 19712 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 4 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:39.291991 20004 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.302322 19788 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:39.303772 19985 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.324601 19788 raft_consensus.cc:1275] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.325673 19985 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.335008 19712 raft_consensus.cc:1275] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.336862 19985 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.367229 19712 raft_consensus.cc:1275] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.368374 19960 consensus_queue.cc:1048] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.378877 19788 raft_consensus.cc:1275] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Refusing update from remote peer cb1e34aa1d654226ba812e11773b0d16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.380306 19960 consensus_queue.cc:1048] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:41.437745 18961 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:16:41.438503 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:41.446799 19638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:41.447407 19638 raft_consensus.cc:606] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:41.449688 19638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d580daa2890245119bc48db0dad3c808"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:41.450151 19638 raft_consensus.cc:606] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Received request to transfer leadership to TS 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:41.452138 19638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:41.452556 19638 raft_consensus.cc:606] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Received request to transfer leadership to TS 20dfa7a2de9d44839dd78dcaef9b090c
I20260709 12:16:41.454542 19638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9"
dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
mode: GRACEFUL
new_leader_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:46336
I20260709 12:16:41.454955 19638 raft_consensus.cc:606] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Received request to transfer leadership to TS 999d051f57e6430abe44a22bd846d3b2
I20260709 12:16:41.455897 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:41.456359 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:41.720153 20015 raft_consensus.cc:993] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:41.720800 20016 raft_consensus.cc:1081] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:41.722447 19788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:41.722980 19788 raft_consensus.cc:493] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.723292 19788 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.729135 19788 raft_consensus.cc:515] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.731196 19788 leader_election.cc:290] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 3 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:41.732379 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:41.732435 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e890ece149e64599b68ecc9d90bf49da" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:41.733141 19638 raft_consensus.cc:3055] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:41.733165 19712 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.733616 19638 raft_consensus.cc:740] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:41.734475 19638 consensus_queue.cc:260] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.735517 19638 raft_consensus.cc:3060] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.739842 19712 raft_consensus.cc:2468] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 3.
I20260709 12:16:41.740958 19754 leader_election.cc:304] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:41.741250 19638 raft_consensus.cc:2468] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 3.
I20260709 12:16:41.741818 19979 raft_consensus.cc:2804] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:41.743021 19979 raft_consensus.cc:697] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:41.744042 19979 consensus_queue.cc:237] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.751897 19535 catalog_manager.cc:5697] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 2 to 3, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 3 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:41.770815 20015 raft_consensus.cc:993] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:41.771303 20016 raft_consensus.cc:1081] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 LEADER]: Signalling peer 20dfa7a2de9d44839dd78dcaef9b090c to start an election
I20260709 12:16:41.772738 19788 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583"
dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
 from {username='slave'} at 127.0.0.1:32832
I20260709 12:16:41.773188 19788 raft_consensus.cc:493] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.773478 19788 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:41.778427 19788 raft_consensus.cc:515] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.780098 19788 leader_election.cc:290] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 5 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66:36253)
I20260709 12:16:41.780901 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:41.781164 19712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83d4a8d14ed94bdea7688388ab8b8583" candidate_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
I20260709 12:16:41.781417 19638 raft_consensus.cc:3055] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:41.781690 19712 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:41.781719 19638 raft_consensus.cc:740] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:41.782563 19638 consensus_queue.cc:260] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.783483 19638 raft_consensus.cc:3060] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:41.786520 19712 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 5.
I20260709 12:16:41.787523 19754 leader_election.cc:304] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:41.788333 19979 raft_consensus.cc:2804] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:41.788388 19638 raft_consensus.cc:2468] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20dfa7a2de9d44839dd78dcaef9b090c in term 5.
I20260709 12:16:41.788892 19979 raft_consensus.cc:697] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 5 LEADER]: Becoming Leader. State: Replica: 20dfa7a2de9d44839dd78dcaef9b090c, State: Running, Role: LEADER
I20260709 12:16:41.789844 19979 consensus_queue.cc:237] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.797084 19535 catalog_manager.cc:5697] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c reported cstate change: term changed from 4 to 5, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67). New cstate: current_term: 5 leader_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:41.826048 20015 raft_consensus.cc:993] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:41.826529 20016 raft_consensus.cc:1081] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Signalling peer 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:41.828045 19712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d580daa2890245119bc48db0dad3c808"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:55108
I20260709 12:16:41.828500 19712 raft_consensus.cc:493] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.828797 19712 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:41.833354 19712 raft_consensus.cc:515] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:41.835317 19712 leader_election.cc:290] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 4 election: Requested vote from peers 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145), cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191)
I20260709 12:16:41.836287 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:41.836395 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d580daa2890245119bc48db0dad3c808" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:41.836930 19788 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:41.836988 19638 raft_consensus.cc:3055] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:41.837361 19638 raft_consensus.cc:740] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:41.838069 19638 consensus_queue.cc:260] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:41.838977 19638 raft_consensus.cc:3060] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:41.841593 19788 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 4.
I20260709 12:16:41.842712 19679 leader_election.cc:304] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:41.843386 20014 raft_consensus.cc:2804] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:41.843668 19638 raft_consensus.cc:2468] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 4.
I20260709 12:16:41.844777 20014 raft_consensus.cc:697] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 4 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:41.845728 20014 consensus_queue.cc:237] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } }
I20260709 12:16:41.852752 19535 catalog_manager.cc:5697] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 3 to 4, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.924857 20015 raft_consensus.cc:993] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: : Instructing follower 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:41.925325 20016 raft_consensus.cc:1081] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Signalling peer 999d051f57e6430abe44a22bd846d3b2 to start an election
I20260709 12:16:41.926786 19712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9"
dest_uuid: "999d051f57e6430abe44a22bd846d3b2"
 from {username='slave'} at 127.0.0.1:55108
I20260709 12:16:41.927248 19712 raft_consensus.cc:493] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.927502 19712 raft_consensus.cc:3060] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.932521 19712 raft_consensus.cc:515] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.933995 19712 leader_election.cc:290] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 2 election: Requested vote from peers cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65:45191), 20dfa7a2de9d44839dd78dcaef9b090c (127.18.132.67:33145)
I20260709 12:16:41.934769 19638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb1e34aa1d654226ba812e11773b0d16"
I20260709 12:16:41.934974 19788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3d30a89a8f4679a6a3ada78cd389a9" candidate_uuid: "999d051f57e6430abe44a22bd846d3b2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20dfa7a2de9d44839dd78dcaef9b090c"
I20260709 12:16:41.935274 19638 raft_consensus.cc:3055] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:41.935508 19788 raft_consensus.cc:3060] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.935649 19638 raft_consensus.cc:740] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb1e34aa1d654226ba812e11773b0d16, State: Running, Role: LEADER
I20260709 12:16:41.936436 19638 consensus_queue.cc:260] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.937333 19638 raft_consensus.cc:3060] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:41.940259 19788 raft_consensus.cc:2468] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 2.
I20260709 12:16:41.941162 19679 leader_election.cc:304] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20dfa7a2de9d44839dd78dcaef9b090c, 999d051f57e6430abe44a22bd846d3b2; no voters: 
I20260709 12:16:41.941835 20014 raft_consensus.cc:2804] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:41.942027 19638 raft_consensus.cc:2468] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999d051f57e6430abe44a22bd846d3b2 in term 2.
I20260709 12:16:41.942286 20014 raft_consensus.cc:697] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Becoming Leader. State: Replica: 999d051f57e6430abe44a22bd846d3b2, State: Running, Role: LEADER
I20260709 12:16:41.943336 20014 consensus_queue.cc:237] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } }
I20260709 12:16:41.951421 19535 catalog_manager.cc:5697] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 reported cstate change: term changed from 1 to 2, leader changed from cb1e34aa1d654226ba812e11773b0d16 (127.18.132.65) to 999d051f57e6430abe44a22bd846d3b2 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "999d051f57e6430abe44a22bd846d3b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.180794 19712 raft_consensus.cc:1275] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.182121 19979 consensus_queue.cc:1048] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.192543 19638 raft_consensus.cc:1275] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.194228 20018 consensus_queue.cc:1048] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.225529 19712 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 5 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:42.226895 20018 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "999d051f57e6430abe44a22bd846d3b2" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:42.236028 19638 raft_consensus.cc:1275] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 5 FOLLOWER]: Refusing update from remote peer 20dfa7a2de9d44839dd78dcaef9b090c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:42.237521 20017 consensus_queue.cc:1048] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:42.255019 19638 raft_consensus.cc:1275] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:42.256247 20014 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.264761 19788 raft_consensus.cc:1275] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:42.266737 20036 consensus_queue.cc:1048] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:42.421828 19788 raft_consensus.cc:1275] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:42.423059 20036 consensus_queue.cc:1048] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20dfa7a2de9d44839dd78dcaef9b090c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 33145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:42.431435 19638 raft_consensus.cc:1275] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Refusing update from remote peer 999d051f57e6430abe44a22bd846d3b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:42.432961 20014 consensus_queue.cc:1048] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb1e34aa1d654226ba812e11773b0d16" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 45191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:42.457494 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:42.463799 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:42.464403 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:43.465361 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:43.470960 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:43.471493 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:44.472577 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:44.478578 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:44.479128 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.480110 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.485651 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:45.486123 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:46.487193 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.494163 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.494714 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.495714 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.501384 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.501823 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.502755 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.508663 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.509088 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.510409 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.516346 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.516746 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.517769 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.523144 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.523654 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.556468 18961 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:16:51.557036 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
I20260709 12:16:51.594511 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:51.595412 18961 tablet_replica.cc:333] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.596239 18961 raft_consensus.cc:2243] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.596858 18961 raft_consensus.cc:2272] T 83d4a8d14ed94bdea7688388ab8b8583 P cb1e34aa1d654226ba812e11773b0d16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.599125 18961 tablet_replica.cc:333] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.599756 18961 raft_consensus.cc:2243] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.600644 18961 raft_consensus.cc:2272] T 884eea6089a441fb99fb24d77cde1f73 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.602649 18961 tablet_replica.cc:333] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.603307 18961 raft_consensus.cc:2243] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.604307 18961 raft_consensus.cc:2272] T 8ae9b05db1774a84a17e1fdee7f5644e P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.606277 18961 tablet_replica.cc:333] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.606853 18961 raft_consensus.cc:2243] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.607242 18961 raft_consensus.cc:2272] T bba2218cfa55471f9c824fcf1e579678 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.609373 18961 tablet_replica.cc:333] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.609880 18961 raft_consensus.cc:2243] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.610747 18961 raft_consensus.cc:2272] T 1e8f230c2c0549e5937975b5dbf8ed99 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.612761 18961 tablet_replica.cc:333] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.613245 18961 raft_consensus.cc:2243] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.613655 18961 raft_consensus.cc:2272] T ec3d30a89a8f4679a6a3ada78cd389a9 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.615731 18961 tablet_replica.cc:333] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.616261 18961 raft_consensus.cc:2243] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.616691 18961 raft_consensus.cc:2272] T e890ece149e64599b68ecc9d90bf49da P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.618428 18961 tablet_replica.cc:333] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.618911 18961 raft_consensus.cc:2243] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.619434 18961 raft_consensus.cc:2272] T e05f489f6c3a431ebe008229ff96d101 P cb1e34aa1d654226ba812e11773b0d16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.621246 18961 tablet_replica.cc:333] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.621737 18961 raft_consensus.cc:2243] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.622689 18961 raft_consensus.cc:2272] T 813d4b1c7e8c47f2b78a197067bec7a1 P cb1e34aa1d654226ba812e11773b0d16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.624500 18961 tablet_replica.cc:333] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16: stopping tablet replica
I20260709 12:16:51.624995 18961 raft_consensus.cc:2243] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.625460 18961 raft_consensus.cc:2272] T d580daa2890245119bc48db0dad3c808 P cb1e34aa1d654226ba812e11773b0d16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.658229 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
I20260709 12:16:51.682780 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
I20260709 12:16:51.711087 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:51.711933 18961 tablet_replica.cc:333] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.712843 18961 raft_consensus.cc:2243] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.713573 18961 raft_consensus.cc:2272] T 813d4b1c7e8c47f2b78a197067bec7a1 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.716203 18961 tablet_replica.cc:333] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.717033 18961 raft_consensus.cc:2243] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.717567 18961 raft_consensus.cc:2272] T 8ae9b05db1774a84a17e1fdee7f5644e P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.719870 18961 tablet_replica.cc:333] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.720434 18961 raft_consensus.cc:2243] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.721282 18961 raft_consensus.cc:2272] T d580daa2890245119bc48db0dad3c808 P 999d051f57e6430abe44a22bd846d3b2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.723419 18961 tablet_replica.cc:333] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.723973 18961 raft_consensus.cc:2243] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.724463 18961 raft_consensus.cc:2272] T 83d4a8d14ed94bdea7688388ab8b8583 P 999d051f57e6430abe44a22bd846d3b2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.726281 18961 tablet_replica.cc:333] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.726791 18961 raft_consensus.cc:2243] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.727248 18961 raft_consensus.cc:2272] T 884eea6089a441fb99fb24d77cde1f73 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.729089 18961 tablet_replica.cc:333] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.729594 18961 raft_consensus.cc:2243] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.730568 18961 raft_consensus.cc:2272] T ec3d30a89a8f4679a6a3ada78cd389a9 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.732504 18961 tablet_replica.cc:333] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.733023 18961 raft_consensus.cc:2243] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.733479 18961 raft_consensus.cc:2272] T e890ece149e64599b68ecc9d90bf49da P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.735335 18961 tablet_replica.cc:333] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.735901 18961 raft_consensus.cc:2243] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.736690 18961 raft_consensus.cc:2272] T e05f489f6c3a431ebe008229ff96d101 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.738440 18961 tablet_replica.cc:333] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.738935 18961 raft_consensus.cc:2243] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.739374 18961 raft_consensus.cc:2272] T bba2218cfa55471f9c824fcf1e579678 P 999d051f57e6430abe44a22bd846d3b2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.741094 18961 tablet_replica.cc:333] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2: stopping tablet replica
I20260709 12:16:51.741550 18961 raft_consensus.cc:2243] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.742005 18961 raft_consensus.cc:2272] T 1e8f230c2c0549e5937975b5dbf8ed99 P 999d051f57e6430abe44a22bd846d3b2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.772153 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
I20260709 12:16:51.795620 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
I20260709 12:16:51.823117 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:51.824051 18961 tablet_replica.cc:333] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.824738 18961 raft_consensus.cc:2243] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.825309 18961 raft_consensus.cc:2272] T 884eea6089a441fb99fb24d77cde1f73 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.827435 18961 tablet_replica.cc:333] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.828068 18961 raft_consensus.cc:2243] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.828495 18961 raft_consensus.cc:2272] T d580daa2890245119bc48db0dad3c808 P 20dfa7a2de9d44839dd78dcaef9b090c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.830284 18961 tablet_replica.cc:333] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.830755 18961 raft_consensus.cc:2243] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.831671 18961 raft_consensus.cc:2272] T 83d4a8d14ed94bdea7688388ab8b8583 P 20dfa7a2de9d44839dd78dcaef9b090c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.833570 18961 tablet_replica.cc:333] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.834276 18961 raft_consensus.cc:2243] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.834728 18961 raft_consensus.cc:2272] T 1e8f230c2c0549e5937975b5dbf8ed99 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.836552 18961 tablet_replica.cc:333] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.837076 18961 raft_consensus.cc:2243] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.837898 18961 raft_consensus.cc:2272] T bba2218cfa55471f9c824fcf1e579678 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.839941 18961 tablet_replica.cc:333] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.840471 18961 raft_consensus.cc:2243] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.840910 18961 raft_consensus.cc:2272] T 8ae9b05db1774a84a17e1fdee7f5644e P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.842551 18961 tablet_replica.cc:333] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.843047 18961 raft_consensus.cc:2243] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.843490 18961 raft_consensus.cc:2272] T e05f489f6c3a431ebe008229ff96d101 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.845243 18961 tablet_replica.cc:333] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.845731 18961 raft_consensus.cc:2243] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.846560 18961 raft_consensus.cc:2272] T e890ece149e64599b68ecc9d90bf49da P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.848294 18961 tablet_replica.cc:333] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.848764 18961 raft_consensus.cc:2243] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.849174 18961 raft_consensus.cc:2272] T ec3d30a89a8f4679a6a3ada78cd389a9 P 20dfa7a2de9d44839dd78dcaef9b090c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.850813 18961 tablet_replica.cc:333] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c: stopping tablet replica
I20260709 12:16:51.851269 18961 raft_consensus.cc:2243] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.851753 18961 raft_consensus.cc:2272] T 813d4b1c7e8c47f2b78a197067bec7a1 P 20dfa7a2de9d44839dd78dcaef9b090c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.883708 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
I20260709 12:16:51.906787 18961 master.cc:562] Master@127.18.132.126:36225 shutting down...
I20260709 12:16:51.934803 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.935491 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.935920 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P 39057c8edd6948ef82c10a669c19019f: stopping tablet replica
I20260709 12:16:51.976785 18961 master.cc:584] Master@127.18.132.126:36225 shutdown complete.
20dfa7a2de9d44839dd78dcaef9b090c  1
999d051f57e6430abe44a22bd846d3b2  4
cb1e34aa1d654226ba812e11773b0d16  5
20dfa7a2de9d44839dd78dcaef9b090c  4
999d051f57e6430abe44a22bd846d3b2  3
cb1e34aa1d654226ba812e11773b0d16  3
20dfa7a2de9d44839dd78dcaef9b090c  1
999d051f57e6430abe44a22bd846d3b2  1
cb1e34aa1d654226ba812e11773b0d16  8
20dfa7a2de9d44839dd78dcaef9b090c  3
999d051f57e6430abe44a22bd846d3b2  3
cb1e34aa1d654226ba812e11773b0d16  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28874 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:16:52.024088 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:44843
I20260709 12:16:52.025357 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.031724 20053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.031930 20054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.032661 20056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.032979 18961 server_base.cc:1061] running on GCE node
I20260709 12:16:52.034037 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.034264 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.034439 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599412034418 us; error 0 us; skew 500 ppm
I20260709 12:16:52.035205 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.037765 18961 webserver.cc:533] Webserver started at http://127.18.132.126:40493/ using document root <none> and password file <none>
I20260709 12:16:52.038291 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.038496 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.038794 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.040135 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "b336d660a2b34362b3d4d9e44ca2179d"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.044677 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:52.048255 20061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.048957 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:52.049245 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "b336d660a2b34362b3d4d9e44ca2179d"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.049546 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.062534 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.064042 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.106887 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:44843
I20260709 12:16:52.106998 20112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:44843 every 8 connection(s)
I20260709 12:16:52.111307 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.122504 20113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Bootstrap starting.
I20260709 12:16:52.128082 20113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.132771 20113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: No bootstrap required, opened a new log
I20260709 12:16:52.135141 20113 raft_consensus.cc:359] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b336d660a2b34362b3d4d9e44ca2179d" member_type: VOTER }
I20260709 12:16:52.135604 20113 raft_consensus.cc:385] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.135902 20113 raft_consensus.cc:740] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b336d660a2b34362b3d4d9e44ca2179d, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.136483 20113 consensus_queue.cc:260] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b336d660a2b34362b3d4d9e44ca2179d" member_type: VOTER }
I20260709 12:16:52.136965 20113 raft_consensus.cc:399] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:52.137192 20113 raft_consensus.cc:493] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:52.137511 20113 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.141916 20113 raft_consensus.cc:515] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b336d660a2b34362b3d4d9e44ca2179d" member_type: VOTER }
I20260709 12:16:52.142433 20113 leader_election.cc:304] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b336d660a2b34362b3d4d9e44ca2179d; no voters: 
I20260709 12:16:52.143769 20113 leader_election.cc:290] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:52.144212 20116 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:52.145731 20116 raft_consensus.cc:697] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 1 LEADER]: Becoming Leader. State: Replica: b336d660a2b34362b3d4d9e44ca2179d, State: Running, Role: LEADER
I20260709 12:16:52.146504 20116 consensus_queue.cc:237] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b336d660a2b34362b3d4d9e44ca2179d" member_type: VOTER }
I20260709 12:16:52.146807 20113 sys_catalog.cc:565] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:52.151502 20117 sys_catalog.cc:455] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b336d660a2b34362b3d4d9e44ca2179d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b336d660a2b34362b3d4d9e44ca2179d" member_type: VOTER } }
I20260709 12:16:52.151739 20118 sys_catalog.cc:455] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b336d660a2b34362b3d4d9e44ca2179d. Latest consensus state: current_term: 1 leader_uuid: "b336d660a2b34362b3d4d9e44ca2179d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b336d660a2b34362b3d4d9e44ca2179d" member_type: VOTER } }
I20260709 12:16:52.152364 20117 sys_catalog.cc:458] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:52.152616 20118 sys_catalog.cc:458] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:52.160800 20123 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:52.165953 20123 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:52.166949 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:52.175457 20123 catalog_manager.cc:1383] Generated new cluster ID: 008e09a2ab1b4bbb9eb1315676c418f9
I20260709 12:16:52.175796 20123 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:52.199944 20123 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:52.201351 20123 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:52.215946 20123 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Generated new TSK 0
I20260709 12:16:52.216600 20123 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:52.233764 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.240857 20134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.241096 20135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.244234 18961 server_base.cc:1061] running on GCE node
W20260709 12:16:52.244251 20137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.245646 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.245843 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.245970 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599412245957 us; error 0 us; skew 500 ppm
I20260709 12:16:52.246451 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.248967 18961 webserver.cc:533] Webserver started at http://127.18.132.65:44969/ using document root <none> and password file <none>
I20260709 12:16:52.249439 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.249600 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.249821 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.251046 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "f5c544fad8874e818acaad733a9d14f1"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.255779 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:52.259039 20142 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.259872 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:52.260211 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "f5c544fad8874e818acaad733a9d14f1"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.260668 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.290941 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.292385 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.293977 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.296465 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.296684 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.296923 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.297124 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.342352 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:39563
I20260709 12:16:52.342473 20204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:39563 every 8 connection(s)
I20260709 12:16:52.347887 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.355957 20209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.357268 20210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.359320 20212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.360558 18961 server_base.cc:1061] running on GCE node
I20260709 12:16:52.362501 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.362818 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.362995 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599412362979 us; error 0 us; skew 500 ppm
I20260709 12:16:52.363461 20205 heartbeater.cc:344] Connected to a master server at 127.18.132.126:44843
I20260709 12:16:52.363706 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.363993 20205 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:52.364892 20205 heartbeater.cc:507] Master 127.18.132.126:44843 requested a full tablet report, sending...
I20260709 12:16:52.366568 18961 webserver.cc:533] Webserver started at http://127.18.132.66:36683/ using document root <none> and password file <none>
I20260709 12:16:52.367187 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.367421 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.367590 20078 ts_manager.cc:194] Registered new tserver with Master: f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:16:52.367748 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.369095 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "e929b30888874ed59248f1229cecd3c6"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.369598 20078 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55652
I20260709 12:16:52.373929 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:52.377472 20217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.378208 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:52.378499 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "e929b30888874ed59248f1229cecd3c6"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.378801 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.399518 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.400859 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.402465 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.404807 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.405037 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.405298 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.405481 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.449326 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:37765
I20260709 12:16:52.449443 20280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:37765 every 8 connection(s)
I20260709 12:16:52.454617 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.462605 20284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.464195 20285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.467231 20287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.468158 20281 heartbeater.cc:344] Connected to a master server at 127.18.132.126:44843
I20260709 12:16:52.468161 18961 server_base.cc:1061] running on GCE node
I20260709 12:16:52.468672 20281 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:52.469291 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.469545 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.469483 20281 heartbeater.cc:507] Master 127.18.132.126:44843 requested a full tablet report, sending...
I20260709 12:16:52.469897 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599412469872 us; error 0 us; skew 500 ppm
I20260709 12:16:52.470520 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.472014 20078 ts_manager.cc:194] Registered new tserver with Master: e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:52.473270 18961 webserver.cc:533] Webserver started at http://127.18.132.67:43343/ using document root <none> and password file <none>
I20260709 12:16:52.473688 20078 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55658
I20260709 12:16:52.473829 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.474134 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.474426 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.475827 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "85fa447fc35d4f88ab7c85630749ec78"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.480494 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:52.483927 20292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.484699 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:52.485006 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "85fa447fc35d4f88ab7c85630749ec78"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-xbvc"
I20260709 12:16:52.485299 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.516464 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.517889 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.519524 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.521893 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.522110 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.522382 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.522552 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.567466 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:46619
I20260709 12:16:52.567687 20354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:46619 every 8 connection(s)
I20260709 12:16:52.583451 20355 heartbeater.cc:344] Connected to a master server at 127.18.132.126:44843
I20260709 12:16:52.584023 20355 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:52.584858 20355 heartbeater.cc:507] Master 127.18.132.126:44843 requested a full tablet report, sending...
I20260709 12:16:52.587109 20078 ts_manager.cc:194] Registered new tserver with Master: 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:52.587496 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015952897s
I20260709 12:16:52.588688 20078 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55664
I20260709 12:16:52.615221 20078 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55676:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:52.622001 20078 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:52.840029 20245 tablet_service.cc:1511] Processing CreateTablet for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:52.841845 20245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.841552 20240 tablet_service.cc:1511] Processing CreateTablet for tablet 98e8de971f5342ac94652edf51dd27ef (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:52.842576 20320 tablet_service.cc:1511] Processing CreateTablet for tablet e89e7906a9724d15951ec300ab3095b6 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:52.843317 20319 tablet_service.cc:1511] Processing CreateTablet for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:52.844103 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89e7906a9724d15951ec300ab3095b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.844240 20244 tablet_service.cc:1511] Processing CreateTablet for tablet 8cacb9a2627045debeb7e4198ce2bcf7 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:52.844545 20246 tablet_service.cc:1511] Processing CreateTablet for tablet e89e7906a9724d15951ec300ab3095b6 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:52.843025 20240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e8de971f5342ac94652edf51dd27ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.845721 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cacb9a2627045debeb7e4198ce2bcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.847298 20241 tablet_service.cc:1511] Processing CreateTablet for tablet 40142d5f54b2446e8c64c73d6fb188fc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:52.848692 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40142d5f54b2446e8c64c73d6fb188fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.852854 20242 tablet_service.cc:1511] Processing CreateTablet for tablet 94d92f1167e6425dbdcc7276bd1de9b7 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:52.854350 20242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d92f1167e6425dbdcc7276bd1de9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.855983 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89e7906a9724d15951ec300ab3095b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.844743 20319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.866231 20318 tablet_service.cc:1511] Processing CreateTablet for tablet 8cacb9a2627045debeb7e4198ce2bcf7 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:52.867748 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cacb9a2627045debeb7e4198ce2bcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.874289 20239 tablet_service.cc:1511] Processing CreateTablet for tablet de701338877c4a78b14dec4df55119c2 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:52.874555 20317 tablet_service.cc:1511] Processing CreateTablet for tablet 94d92f1167e6425dbdcc7276bd1de9b7 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:52.875926 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de701338877c4a78b14dec4df55119c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.875947 20317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d92f1167e6425dbdcc7276bd1de9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.879709 20238 tablet_service.cc:1511] Processing CreateTablet for tablet fc2f9bd02105458eb0ee8e4142956948 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:52.880264 20315 tablet_service.cc:1511] Processing CreateTablet for tablet 98e8de971f5342ac94652edf51dd27ef (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:52.881268 20238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2f9bd02105458eb0ee8e4142956948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.881672 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e8de971f5342ac94652edf51dd27ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.884438 20316 tablet_service.cc:1511] Processing CreateTablet for tablet 40142d5f54b2446e8c64c73d6fb188fc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:52.885830 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40142d5f54b2446e8c64c73d6fb188fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.902974 20314 tablet_service.cc:1511] Processing CreateTablet for tablet de701338877c4a78b14dec4df55119c2 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:52.904574 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de701338877c4a78b14dec4df55119c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.920933 20170 tablet_service.cc:1511] Processing CreateTablet for tablet e89e7906a9724d15951ec300ab3095b6 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:52.921749 20168 tablet_service.cc:1511] Processing CreateTablet for tablet 8cacb9a2627045debeb7e4198ce2bcf7 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:52.922538 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e89e7906a9724d15951ec300ab3095b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.924173 20169 tablet_service.cc:1511] Processing CreateTablet for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:52.924923 20313 tablet_service.cc:1511] Processing CreateTablet for tablet fc2f9bd02105458eb0ee8e4142956948 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:52.925594 20169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.926252 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2f9bd02105458eb0ee8e4142956948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.928078 20168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cacb9a2627045debeb7e4198ce2bcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.928661 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 94a451623b3d4ba9b27eb7e8b56cb47a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:52.929986 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a451623b3d4ba9b27eb7e8b56cb47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.932772 20236 tablet_service.cc:1511] Processing CreateTablet for tablet 56046fd4231240119a75348ab3fc48d3 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:52.934085 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56046fd4231240119a75348ab3fc48d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.937044 20244 tablet_service.cc:1511] Processing CreateTablet for tablet 7d79a5dd3e7e46678ffc3ddc6af43051 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:52.937458 20166 tablet_service.cc:1511] Processing CreateTablet for tablet 40142d5f54b2446e8c64c73d6fb188fc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:52.939368 20165 tablet_service.cc:1511] Processing CreateTablet for tablet 98e8de971f5342ac94652edf51dd27ef (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:52.952740 20166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40142d5f54b2446e8c64c73d6fb188fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.940847 20167 tablet_service.cc:1511] Processing CreateTablet for tablet 94d92f1167e6425dbdcc7276bd1de9b7 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:52.941267 20164 tablet_service.cc:1511] Processing CreateTablet for tablet de701338877c4a78b14dec4df55119c2 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:52.943185 20312 tablet_service.cc:1511] Processing CreateTablet for tablet 94a451623b3d4ba9b27eb7e8b56cb47a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:52.954304 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a451623b3d4ba9b27eb7e8b56cb47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.955415 20246 tablet_service.cc:1511] Processing CreateTablet for tablet 6ebc8da2a63b4daeb972508fd248a6f2 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:52.956110 20370 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:52.943140 20163 tablet_service.cc:1511] Processing CreateTablet for tablet fc2f9bd02105458eb0ee8e4142956948 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:52.945147 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 56046fd4231240119a75348ab3fc48d3 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:52.960685 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56046fd4231240119a75348ab3fc48d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.961714 20239 tablet_service.cc:1511] Processing CreateTablet for tablet de68043269e84d00b62b03a362170cc8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:52.962610 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebc8da2a63b4daeb972508fd248a6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.945178 20162 tablet_service.cc:1511] Processing CreateTablet for tablet 94a451623b3d4ba9b27eb7e8b56cb47a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:52.946444 20161 tablet_service.cc:1511] Processing CreateTablet for tablet 56046fd4231240119a75348ab3fc48d3 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:52.964643 20241 tablet_service.cc:1511] Processing CreateTablet for tablet a633082b519c485f8ea5b7f711895275 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:52.965931 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633082b519c485f8ea5b7f711895275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.955433 20240 tablet_service.cc:1511] Processing CreateTablet for tablet fc3c17581b364b2292ad25402ab6bf57 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:52.971398 20240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3c17581b364b2292ad25402ab6bf57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.977917 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 02f2bc2263db420a815ba46efc7bf818 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:52.978881 20370 tablet_bootstrap.cc:654] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.979387 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f2bc2263db420a815ba46efc7bf818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.982457 20163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2f9bd02105458eb0ee8e4142956948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.984724 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de68043269e84d00b62b03a362170cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.984829 20164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de701338877c4a78b14dec4df55119c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.987401 20165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e8de971f5342ac94652edf51dd27ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.988256 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a451623b3d4ba9b27eb7e8b56cb47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.006076 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d92f1167e6425dbdcc7276bd1de9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.009601 20314 tablet_service.cc:1511] Processing CreateTablet for tablet 6ebc8da2a63b4daeb972508fd248a6f2 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:53.011090 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebc8da2a63b4daeb972508fd248a6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.039986 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56046fd4231240119a75348ab3fc48d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.040653 20313 tablet_service.cc:1511] Processing CreateTablet for tablet de68043269e84d00b62b03a362170cc8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:53.042095 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de68043269e84d00b62b03a362170cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.044070 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d79a5dd3e7e46678ffc3ddc6af43051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.045598 20245 tablet_service.cc:1511] Processing CreateTablet for tablet 9f631101c7754614902057ac50b914e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:53.046876 20245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f631101c7754614902057ac50b914e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.049194 20239 tablet_service.cc:1511] Processing CreateTablet for tablet ce44adc86d94477297f0d6521f9cb48b (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:53.059651 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce44adc86d94477297f0d6521f9cb48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.052552 20165 tablet_service.cc:1511] Processing CreateTablet for tablet 6ebc8da2a63b4daeb972508fd248a6f2 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:53.063457 20165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebc8da2a63b4daeb972508fd248a6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.066838 20320 tablet_service.cc:1511] Processing CreateTablet for tablet a633082b519c485f8ea5b7f711895275 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:53.069821 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 9dedcb24fca34377b036e86f9764e60b (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:53.074783 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633082b519c485f8ea5b7f711895275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.081462 20246 tablet_service.cc:1511] Processing CreateTablet for tablet 937144b407c548958468c2b27f8cd054 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:53.087350 20318 tablet_service.cc:1511] Processing CreateTablet for tablet fc3c17581b364b2292ad25402ab6bf57 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:53.089233 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3c17581b364b2292ad25402ab6bf57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.090082 20170 tablet_service.cc:1511] Processing CreateTablet for tablet fc3c17581b364b2292ad25402ab6bf57 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:53.091850 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3c17581b364b2292ad25402ab6bf57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.092433 20312 tablet_service.cc:1511] Processing CreateTablet for tablet 7d79a5dd3e7e46678ffc3ddc6af43051 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:53.093673 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d79a5dd3e7e46678ffc3ddc6af43051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.098079 20169 tablet_service.cc:1511] Processing CreateTablet for tablet de68043269e84d00b62b03a362170cc8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:53.100199 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 02f2bc2263db420a815ba46efc7bf818 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:53.101918 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f2bc2263db420a815ba46efc7bf818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.125474 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dedcb24fca34377b036e86f9764e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.125665 20169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de68043269e84d00b62b03a362170cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.131697 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937144b407c548958468c2b27f8cd054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.139549 20170 tablet_service.cc:1511] Processing CreateTablet for tablet a633082b519c485f8ea5b7f711895275 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:53.145318 20238 tablet_service.cc:1511] Processing CreateTablet for tablet 5260534c5dcb4fe0a840162b4eb6d460 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:53.146845 20238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5260534c5dcb4fe0a840162b4eb6d460. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:53.160223 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:53.163874 20242 tablet_service.cc:1511] Processing CreateTablet for tablet 5844fde759d84503859902ab6bf69cdc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:53.165954 20242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844fde759d84503859902ab6bf69cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.176087 20371 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:53.176507 20372 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:53.181890 20163 tablet_service.cc:1511] Processing CreateTablet for tablet 02f2bc2263db420a815ba46efc7bf818 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:53.182983 20372 tablet_bootstrap.cc:654] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.188050 20317 tablet_service.cc:1511] Processing CreateTablet for tablet 9f631101c7754614902057ac50b914e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:53.190073 20317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f631101c7754614902057ac50b914e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.176117 20244 tablet_service.cc:1511] Processing CreateTablet for tablet 599fe0ac57224f249385f1d6243cb41a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:53.202142 20241 tablet_service.cc:1511] Processing CreateTablet for tablet 094b66f474ed4806afc377722fa74020 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:53.174917 20315 tablet_service.cc:1511] Processing CreateTablet for tablet ce44adc86d94477297f0d6521f9cb48b (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:53.204892 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce44adc86d94477297f0d6521f9cb48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.210094 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633082b519c485f8ea5b7f711895275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.215886 20163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f2bc2263db420a815ba46efc7bf818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.216549 20167 tablet_service.cc:1511] Processing CreateTablet for tablet 7d79a5dd3e7e46678ffc3ddc6af43051 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:53.230710 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d79a5dd3e7e46678ffc3ddc6af43051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.241155 20371 tablet_bootstrap.cc:654] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.244927 20319 tablet_service.cc:1511] Processing CreateTablet for tablet 9dedcb24fca34377b036e86f9764e60b (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:53.217515 20166 tablet_service.cc:1511] Processing CreateTablet for tablet 9f631101c7754614902057ac50b914e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:53.246261 20319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dedcb24fca34377b036e86f9764e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.239938 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b66f474ed4806afc377722fa74020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.247072 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599fe0ac57224f249385f1d6243cb41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.249642 20164 tablet_service.cc:1511] Processing CreateTablet for tablet 9dedcb24fca34377b036e86f9764e60b (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:53.250859 20166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f631101c7754614902057ac50b914e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.232991 20236 tablet_service.cc:1511] Processing CreateTablet for tablet 78812bac55564850a870dc75f26b8b9a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:53.261015 20240 tablet_service.cc:1511] Processing CreateTablet for tablet 64230d63b49741d69bace479cb6508f1 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:53.239259 20162 tablet_service.cc:1511] Processing CreateTablet for tablet ce44adc86d94477297f0d6521f9cb48b (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:53.267220 20240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64230d63b49741d69bace479cb6508f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.261353 20312 tablet_service.cc:1511] Processing CreateTablet for tablet 094b66f474ed4806afc377722fa74020 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:53.269294 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b66f474ed4806afc377722fa74020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.270777 20164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dedcb24fca34377b036e86f9764e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.272418 20318 tablet_service.cc:1511] Processing CreateTablet for tablet 5260534c5dcb4fe0a840162b4eb6d460 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:53.273160 20245 tablet_service.cc:1511] Processing CreateTablet for tablet e9c1aa13628842369b17a21768c9a5e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:53.273729 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5260534c5dcb4fe0a840162b4eb6d460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.277037 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce44adc86d94477297f0d6521f9cb48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.280055 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78812bac55564850a870dc75f26b8b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.285918 20316 tablet_service.cc:1511] Processing CreateTablet for tablet 5844fde759d84503859902ab6bf69cdc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:53.291668 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844fde759d84503859902ab6bf69cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.292289 20245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c1aa13628842369b17a21768c9a5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.285925 20314 tablet_service.cc:1511] Processing CreateTablet for tablet 599fe0ac57224f249385f1d6243cb41a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:53.299216 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599fe0ac57224f249385f1d6243cb41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.309160 20169 tablet_service.cc:1511] Processing CreateTablet for tablet 5260534c5dcb4fe0a840162b4eb6d460 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:53.310575 20169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5260534c5dcb4fe0a840162b4eb6d460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.318091 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 78812bac55564850a870dc75f26b8b9a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:53.319602 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78812bac55564850a870dc75f26b8b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.333290 20239 tablet_service.cc:1511] Processing CreateTablet for tablet 2810bc1c814f432184fd2110cf8b6e45 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:53.334774 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2810bc1c814f432184fd2110cf8b6e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.374625 20205 heartbeater.cc:499] Master 127.18.132.126:44843 was elected leader, sending a full tablet report...
I20260709 12:16:53.385286 20316 tablet_service.cc:1511] Processing CreateTablet for tablet 64230d63b49741d69bace479cb6508f1 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:53.386787 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64230d63b49741d69bace479cb6508f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.387739 20168 tablet_service.cc:1511] Processing CreateTablet for tablet 5844fde759d84503859902ab6bf69cdc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:53.402046 20165 tablet_service.cc:1511] Processing CreateTablet for tablet 599fe0ac57224f249385f1d6243cb41a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:53.403004 20161 tablet_service.cc:1511] Processing CreateTablet for tablet 094b66f474ed4806afc377722fa74020 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:53.403558 20165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599fe0ac57224f249385f1d6243cb41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.405217 20370 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:53.405896 20370 ts_tablet_manager.cc:1403] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.450s	user 0.020s	sys 0.000s
I20260709 12:16:53.409301 20370 raft_consensus.cc:359] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.412607 20238 tablet_service.cc:1511] Processing CreateTablet for tablet 0d378f8e2f934dcc8adcad8d5c71b573 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:53.414151 20313 tablet_service.cc:1511] Processing CreateTablet for tablet 937144b407c548958468c2b27f8cd054 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:53.414916 20316 tablet_service.cc:1511] Processing CreateTablet for tablet e9c1aa13628842369b17a21768c9a5e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:53.418679 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094b66f474ed4806afc377722fa74020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.417450 20370 raft_consensus.cc:385] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.429847 20372 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:53.429580 20162 tablet_service.cc:1511] Processing CreateTablet for tablet 78812bac55564850a870dc75f26b8b9a (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:53.430292 20168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844fde759d84503859902ab6bf69cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.430373 20372 ts_tablet_manager.cc:1403] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.033s
I20260709 12:16:53.431059 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78812bac55564850a870dc75f26b8b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.431612 20238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d378f8e2f934dcc8adcad8d5c71b573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.433650 20372 raft_consensus.cc:359] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.434430 20372 raft_consensus.cc:385] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.434747 20372 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.437093 20371 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:53.427438 20370 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.437603 20371 ts_tablet_manager.cc:1403] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.263s	user 0.017s	sys 0.006s
I20260709 12:16:53.438284 20370 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.440789 20371 raft_consensus.cc:359] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.442791 20371 raft_consensus.cc:385] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.442521 20372 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.443167 20371 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.444205 20371 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.446798 20167 tablet_service.cc:1511] Processing CreateTablet for tablet 937144b407c548958468c2b27f8cd054 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:53.455663 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937144b407c548958468c2b27f8cd054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.457674 20320 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d6b71b9e74e4e84fa04048ad9b6f4 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:53.459619 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d6b71b9e74e4e84fa04048ad9b6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.465408 20319 tablet_service.cc:1511] Processing CreateTablet for tablet 812122fe309946b0a0eebf7bc2214d12 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:53.467283 20319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812122fe309946b0a0eebf7bc2214d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.472546 20311 tablet_service.cc:1511] Processing CreateTablet for tablet b58bdb95474c4f788fec380b260dc1be (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:53.474426 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58bdb95474c4f788fec380b260dc1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.476289 20281 heartbeater.cc:499] Master 127.18.132.126:44843 was elected leader, sending a full tablet report...
I20260709 12:16:53.479547 20315 tablet_service.cc:1511] Processing CreateTablet for tablet 766b995bcec04c62a05a9d91c572f494 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:53.480971 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b995bcec04c62a05a9d91c572f494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.484161 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937144b407c548958468c2b27f8cd054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.485509 20318 tablet_service.cc:1511] Processing CreateTablet for tablet 0d378f8e2f934dcc8adcad8d5c71b573 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:53.486896 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d378f8e2f934dcc8adcad8d5c71b573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.487890 20317 tablet_service.cc:1511] Processing CreateTablet for tablet 2810bc1c814f432184fd2110cf8b6e45 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:53.489257 20317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2810bc1c814f432184fd2110cf8b6e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.493000 20170 tablet_service.cc:1511] Processing CreateTablet for tablet 64230d63b49741d69bace479cb6508f1 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:53.494611 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64230d63b49741d69bace479cb6508f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.496117 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c1aa13628842369b17a21768c9a5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.491698 20244 tablet_service.cc:1511] Processing CreateTablet for tablet b58bdb95474c4f788fec380b260dc1be (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:53.499346 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58bdb95474c4f788fec380b260dc1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.501132 20314 tablet_service.cc:1511] Processing CreateTablet for tablet 463ac757068e4382abd72beef4bbf682 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:53.532796 20355 heartbeater.cc:499] Master 127.18.132.126:44843 was elected leader, sending a full tablet report...
I20260709 12:16:53.533978 20379 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.534499 20379 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.532933 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463ac757068e4382abd72beef4bbf682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.537762 20370 ts_tablet_manager.cc:1434] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.006s
I20260709 12:16:53.541162 20372 ts_tablet_manager.cc:1434] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.110s	user 0.016s	sys 0.029s
I20260709 12:16:53.544130 20372 tablet_bootstrap.cc:492] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:53.551224 20372 tablet_bootstrap.cc:654] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.559607 20371 ts_tablet_manager.cc:1434] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.010s
I20260709 12:16:53.560675 20371 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:53.566643 20315 tablet_service.cc:1511] Processing CreateTablet for tablet 34e43fd47bc14908b8da11134e6fd1d6 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:53.568090 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e43fd47bc14908b8da11134e6fd1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.577721 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 812122fe309946b0a0eebf7bc2214d12 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:53.579166 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812122fe309946b0a0eebf7bc2214d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.581542 20379 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:53.567394 20312 tablet_service.cc:1511] Processing CreateTablet for tablet 99f5ffbc4fe542b3996e60bb26ee1c35 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:53.596964 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f5ffbc4fe542b3996e60bb26ee1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.580992 20163 tablet_service.cc:1511] Processing CreateTablet for tablet e9c1aa13628842369b17a21768c9a5e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:53.610857 20378 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.611449 20378 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.614233 20378 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:53.630497 20244 tablet_service.cc:1511] Processing CreateTablet for tablet 463ac757068e4382abd72beef4bbf682 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:53.616998 20370 tablet_bootstrap.cc:492] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:53.644670 20241 tablet_service.cc:1511] Processing CreateTablet for tablet 766b995bcec04c62a05a9d91c572f494 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:53.596480 20164 tablet_service.cc:1511] Processing CreateTablet for tablet 2810bc1c814f432184fd2110cf8b6e45 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:53.653607 20163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c1aa13628842369b17a21768c9a5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.673573 20245 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d6b71b9e74e4e84fa04048ad9b6f4 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:53.675688 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463ac757068e4382abd72beef4bbf682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.683195 20164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2810bc1c814f432184fd2110cf8b6e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.684770 20236 tablet_service.cc:1511] Processing CreateTablet for tablet a145c5f943d84d5eade056f80c775a0e (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:53.697938 20371 tablet_bootstrap.cc:654] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.699884 20240 tablet_service.cc:1511] Processing CreateTablet for tablet 99f5ffbc4fe542b3996e60bb26ee1c35 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:53.701050 20245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d6b71b9e74e4e84fa04048ad9b6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.706449 20161 tablet_service.cc:1511] Processing CreateTablet for tablet b58bdb95474c4f788fec380b260dc1be (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:53.709513 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58bdb95474c4f788fec380b260dc1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.712227 20169 tablet_service.cc:1511] Processing CreateTablet for tablet 812122fe309946b0a0eebf7bc2214d12 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:53.671068 20166 tablet_service.cc:1511] Processing CreateTablet for tablet 0d378f8e2f934dcc8adcad8d5c71b573 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:53.708113 20246 tablet_service.cc:1511] Processing CreateTablet for tablet 34e43fd47bc14908b8da11134e6fd1d6 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:53.720151 20240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f5ffbc4fe542b3996e60bb26ee1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.723960 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b995bcec04c62a05a9d91c572f494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.726300 20314 tablet_service.cc:1511] Processing CreateTablet for tablet ae0621ca652d416d9284323ec7eb2363 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:53.731012 20320 tablet_service.cc:1511] Processing CreateTablet for tablet bc70b6f5a049439b939f85c3a096fb9d (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:53.736073 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0621ca652d416d9284323ec7eb2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.739796 20372 tablet_bootstrap.cc:492] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:53.739804 20239 tablet_service.cc:1511] Processing CreateTablet for tablet ae0621ca652d416d9284323ec7eb2363 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:53.740504 20372 ts_tablet_manager.cc:1403] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.197s	user 0.012s	sys 0.013s
I20260709 12:16:53.743727 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a145c5f943d84d5eade056f80c775a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.744383 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0621ca652d416d9284323ec7eb2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.695456 20242 tablet_service.cc:1511] Processing CreateTablet for tablet bc70b6f5a049439b939f85c3a096fb9d (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:53.747041 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e43fd47bc14908b8da11134e6fd1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.746622 20372 raft_consensus.cc:359] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.747465 20372 raft_consensus.cc:385] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.747880 20372 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.748854 20372 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.749614 20370 tablet_bootstrap.cc:654] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.752214 20315 tablet_service.cc:1511] Processing CreateTablet for tablet a145c5f943d84d5eade056f80c775a0e (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:53.756660 20242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b6f5a049439b939f85c3a096fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.758976 20168 tablet_service.cc:1511] Processing CreateTablet for tablet 766b995bcec04c62a05a9d91c572f494 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:53.761670 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a145c5f943d84d5eade056f80c775a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.759377 20238 tablet_service.cc:1511] Processing CreateTablet for tablet bd163d5722084caaae2c38bdcf1e7698 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:53.764725 20312 tablet_service.cc:1511] Processing CreateTablet for tablet bd163d5722084caaae2c38bdcf1e7698 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:53.766489 20317 tablet_service.cc:1511] Processing CreateTablet for tablet 75d963e0e1da434f887fc330570683e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:53.767970 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b6f5a049439b939f85c3a096fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.769881 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:53.777390 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:53.778389 20376 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.778923 20376 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.779176 20295 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:53.770879 20316 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc39a197f2d41e4bc3e1f92594e8baa (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:53.780277 20379 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:53.780565 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc39a197f2d41e4bc3e1f92594e8baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.780709 20379 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.781173 20379 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.772526 20318 tablet_service.cc:1511] Processing CreateTablet for tablet bddbf42869844c6f9ae72ceaefc93ea8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:53.781847 20376 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:53.782425 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbf42869844c6f9ae72ceaefc93ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.774178 20238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd163d5722084caaae2c38bdcf1e7698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.774245 20313 tablet_service.cc:1511] Processing CreateTablet for tablet d8a3c653acbd4849b4107b058ac2f753 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:53.784938 20169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812122fe309946b0a0eebf7bc2214d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.802291 20317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d963e0e1da434f887fc330570683e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.812875 20372 ts_tablet_manager.cc:1434] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.004s
I20260709 12:16:53.819167 20166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d378f8e2f934dcc8adcad8d5c71b573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.842736 20379 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.844201 20165 tablet_service.cc:1511] Processing CreateTablet for tablet 463ac757068e4382abd72beef4bbf682 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:53.846004 20319 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfc71bca12d482b9f153b0596eba41f (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:53.846045 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:53.850785 20144 leader_election.cc:343] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.856817 20244 tablet_service.cc:1511] Processing CreateTablet for tablet 75d963e0e1da434f887fc330570683e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:53.858202 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d963e0e1da434f887fc330570683e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.831673 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a3c653acbd4849b4107b058ac2f753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.868988 20371 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:53.869544 20371 ts_tablet_manager.cc:1403] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.309s	user 0.016s	sys 0.001s
I20260709 12:16:53.872689 20167 tablet_service.cc:1511] Processing CreateTablet for tablet 34e43fd47bc14908b8da11134e6fd1d6 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:53.875799 20379 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:53.876840 20162 tablet_service.cc:1511] Processing CreateTablet for tablet 99f5ffbc4fe542b3996e60bb26ee1c35 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:53.878392 20319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71bca12d482b9f153b0596eba41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.881119 20165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 463ac757068e4382abd72beef4bbf682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.882476 20241 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc39a197f2d41e4bc3e1f92594e8baa (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:53.882716 20314 tablet_service.cc:1511] Processing CreateTablet for tablet f979d38c94754ec998f38fd4e97c3ab9 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:53.885869 20246 tablet_service.cc:1511] Processing CreateTablet for tablet bddbf42869844c6f9ae72ceaefc93ea8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:53.886355 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc39a197f2d41e4bc3e1f92594e8baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.887188 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbf42869844c6f9ae72ceaefc93ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.887868 20168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766b995bcec04c62a05a9d91c572f494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.889871 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd163d5722084caaae2c38bdcf1e7698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.893304 20170 tablet_service.cc:1511] Processing CreateTablet for tablet a145c5f943d84d5eade056f80c775a0e (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:53.894575 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a145c5f943d84d5eade056f80c775a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.896787 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979d38c94754ec998f38fd4e97c3ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.897312 20379 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.899295 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4b4e64b7f442968c110b5d746e4b14 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:53.900636 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4b4e64b7f442968c110b5d746e4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.901456 20372 tablet_bootstrap.cc:492] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:53.891289 20164 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d6b71b9e74e4e84fa04048ad9b6f4 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:53.898372 20379 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.903887 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e43fd47bc14908b8da11134e6fd1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.916424 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:53.917124 20180 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:53.922268 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:53.926342 20220 leader_election.cc:343] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.929100 20161 tablet_service.cc:1511] Processing CreateTablet for tablet bc70b6f5a049439b939f85c3a096fb9d (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:53.936514 20371 raft_consensus.cc:359] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.937423 20371 raft_consensus.cc:385] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.937806 20371 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.938730 20371 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:53.945003 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f5ffbc4fe542b3996e60bb26ee1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.946820 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b6f5a049439b939f85c3a096fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.950058 20239 tablet_service.cc:1511] Processing CreateTablet for tablet d8a3c653acbd4849b4107b058ac2f753 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:53.960314 20316 tablet_service.cc:1511] Processing CreateTablet for tablet fbb68e81778549dc97b899388fd918fc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:53.961766 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb68e81778549dc97b899388fd918fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.962553 20164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d6b71b9e74e4e84fa04048ad9b6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.958122 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a3c653acbd4849b4107b058ac2f753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.971647 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:53.974856 20295 leader_election.cc:343] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.980690 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:53.982632 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:53.984769 20219 leader_election.cc:343] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.985435 20219 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:53.986620 20376 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:53.984735 20295 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:53.987932 20377 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:53.988585 20170 tablet_service.cc:1511] Processing CreateTablet for tablet ae0621ca652d416d9284323ec7eb2363 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:53.990309 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0621ca652d416d9284323ec7eb2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.980690 20370 tablet_bootstrap.cc:492] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.002254 20370 ts_tablet_manager.cc:1403] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.409s	user 0.006s	sys 0.014s
I20260709 12:16:54.003114 20371 ts_tablet_manager.cc:1434] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.005s
I20260709 12:16:54.005491 20370 raft_consensus.cc:359] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.010499 20370 raft_consensus.cc:385] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.012856 20370 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.013907 20371 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.012442 20372 tablet_bootstrap.cc:654] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.992635 20245 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4b4e64b7f442968c110b5d746e4b14 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:54.019481 20379 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:54.023216 20245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4b4e64b7f442968c110b5d746e4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.011510 20240 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfc71bca12d482b9f153b0596eba41f (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:54.026501 20240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71bca12d482b9f153b0596eba41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.040284 20241 tablet_service.cc:1511] Processing CreateTablet for tablet f979d38c94754ec998f38fd4e97c3ab9 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:54.040737 20318 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe31035391b450ebd3c369e9917f7aa (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:54.042018 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979d38c94754ec998f38fd4e97c3ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.039377 20163 tablet_service.cc:1511] Processing CreateTablet for tablet bd163d5722084caaae2c38bdcf1e7698 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:54.042685 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe31035391b450ebd3c369e9917f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.043443 20163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd163d5722084caaae2c38bdcf1e7698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.045454 20244 tablet_service.cc:1511] Processing CreateTablet for tablet fbb68e81778549dc97b899388fd918fc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:54.047034 20244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb68e81778549dc97b899388fd918fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.050352 20237 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:54.065078 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.073264 20370 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.075315 20376 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.076532 20376 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.079712 20376 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:16:54.081491 20165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 32) took 1032 ms. Trace:
I20260709 12:16:54.081975 20165 rpcz_store.cc:276] 0709 12:16:53.049124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.814082 (+764958us) service_pool.cc:224] Handling call
0709 12:16:53.849753 (+ 35671us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.849858 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:53.921184 (+ 71326us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.080909 (+159725us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.081423 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.084069 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:54.085650 20220 leader_election.cc:343] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.089165 20166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 28) took 1058 ms. Trace:
I20260709 12:16:54.092103 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.093631 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:54.095185 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.101787 20377 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:54.104166 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.125872 20238 tablet_service.cc:1511] Processing CreateTablet for tablet 53fc708954624727a65ab4485d1a2285 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:54.120808 20165 tablet_service.cc:1511] Processing CreateTablet for tablet 75d963e0e1da434f887fc330570683e5 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:54.130897 20242 tablet_service.cc:1511] Processing CreateTablet for tablet dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:16:54.103885 20063 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 76647.9us
I20260709 12:16:54.133095 20311 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:54.133853 20236 tablet_service.cc:1511] Processing CreateTablet for tablet 674ae039bae9486b8fa77a2493757981 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:16:54.134752 20206 tablet.cc:2406] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:54.136951 20370 ts_tablet_manager.cc:1434] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.134s	user 0.006s	sys 0.006s
I20260709 12:16:54.142963 20164 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 35) took 1080 ms. Trace:
W20260709 12:16:54.143157 20294 leader_election.cc:343] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.120282 20315 tablet_service.cc:1511] Processing CreateTablet for tablet 674ae039bae9486b8fa77a2493757981 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:54.116173 20246 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe31035391b450ebd3c369e9917f7aa (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:54.150077 20246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe31035391b450ebd3c369e9917f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.149843 20377 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.151841 20236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674ae039bae9486b8fa77a2493757981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.153374 20242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4c01fd2da34b0e9fb9ba3d8b2bd4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.153461 20168 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 31) took 1109 ms. Trace:
I20260709 12:16:54.162413 20238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc708954624727a65ab4485d1a2285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.153884 20168 rpcz_store.cc:276] 0709 12:16:53.044251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.735852 (+691601us) service_pool.cc:224] Handling call
0709 12:16:53.827125 (+ 91273us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff2c831 00007f5ddff09ac3 00007f5ddfeb8400 00007f5dd933daf4 00007f5dd933da82 00007f5dd933d9b1
0709 12:16:53.831245 (+  4120us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.849446 (+ 18201us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:53.994196 (+144750us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.075387 (+ 81191us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.153378 (+ 77991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52270464}
W20260709 12:16:54.164111 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:16:54.164862 20294 leader_election.cc:343] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.165560 20169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 30) took 1126 ms. Trace:
W20260709 12:16:54.165786 20294 leader_election.cc:343] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.166256 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.166083 20169 rpcz_store.cc:276] 0709 12:16:53.039218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.711197 (+671979us) service_pool.cc:224] Handling call
0709 12:16:53.735963 (+ 24766us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.770491 (+ 34528us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:53.973315 (+202824us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.164880 (+191565us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.165483 (+   603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.167261 20394 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.170544 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.173595 20320 tablet_service.cc:1511] Processing CreateTablet for tablet 53fc708954624727a65ab4485d1a2285 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:54.175138 20320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc708954624727a65ab4485d1a2285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.176033 20311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.177484 20167 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 33) took 1123 ms. Trace:
I20260709 12:16:54.177860 20167 rpcz_store.cc:276] 0709 12:16:53.053626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.871730 (+818104us) service_pool.cc:224] Handling call
0709 12:16:53.873529 (+  1799us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.873632 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.116726 (+243094us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.176928 (+ 60202us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.177421 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.165809 20168 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc39a197f2d41e4bc3e1f92594e8baa (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:54.148799 20164 rpcz_store.cc:276] 0709 12:16:53.062461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.890361 (+827900us) service_pool.cc:224] Handling call
0709 12:16:53.905129 (+ 14768us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.905227 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.077944 (+172717us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.142439 (+ 64495us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.142897 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.181658 20167 tablet_service.cc:1511] Processing CreateTablet for tablet d8a3c653acbd4849b4107b058ac2f753 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:54.184898 20315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674ae039bae9486b8fa77a2493757981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.185185 20164 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfc71bca12d482b9f153b0596eba41f (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:54.187219 20372 tablet_bootstrap.cc:492] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.188957 20372 ts_tablet_manager.cc:1403] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.288s	user 0.011s	sys 0.020s
I20260709 12:16:54.189280 20314 tablet_service.cc:1511] Processing CreateTablet for tablet dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:54.179944 20169 tablet_service.cc:1511] Processing CreateTablet for tablet bddbf42869844c6f9ae72ceaefc93ea8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:54.190531 20314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4c01fd2da34b0e9fb9ba3d8b2bd4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.192263 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:54.168423 20165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d963e0e1da434f887fc330570683e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.196983 20168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc39a197f2d41e4bc3e1f92594e8baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.197120 20378 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.198745 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8a3c653acbd4849b4107b058ac2f753. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:54.194581 20219 leader_election.cc:343] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.200938 20239 tablet_service.cc:1511] Processing CreateTablet for tablet ff822ba5f5ad4f8c87f6018de9072cfb (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:54.201474 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.202641 20239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff822ba5f5ad4f8c87f6018de9072cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.203325 20395 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.200965 20312 tablet_service.cc:1511] Processing CreateTablet for tablet ff822ba5f5ad4f8c87f6018de9072cfb (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:54.207433 20312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff822ba5f5ad4f8c87f6018de9072cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.213958 20371 tablet_bootstrap.cc:654] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.204149 20169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbf42869844c6f9ae72ceaefc93ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.216586 20164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71bca12d482b9f153b0596eba41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.139194 20166 rpcz_store.cc:276] 0709 12:16:53.030331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.670037 (+639706us) service_pool.cc:224] Handling call
0709 12:16:53.757472 (+ 87435us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff2c831 00007f5ddff09ac3 00007f5ddfeb8400 00007f5dd933daf4 00007f5dd933da82 00007f5dd933d9b1
0709 12:16:53.771143 (+ 13671us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.771248 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:53.976336 (+205088us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.088619 (+112283us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.089094 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3147136}
I20260709 12:16:54.217536 20370 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:54.218807 20166 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4b4e64b7f442968c110b5d746e4b14 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:54.236383 20372 raft_consensus.cc:359] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.237216 20372 raft_consensus.cc:385] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.237522 20372 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.242234 20166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4b4e64b7f442968c110b5d746e4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.251583 20161 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 37) took 1090 ms. Trace:
I20260709 12:16:54.252020 20161 rpcz_store.cc:276] 0709 12:16:53.161141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.928031 (+766890us) service_pool.cc:224] Handling call
0709 12:16:53.944501 (+ 16470us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.944664 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.126820 (+182156us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.195357 (+ 68537us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.251475 (+ 56118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.254671 20161 tablet_service.cc:1511] Processing CreateTablet for tablet f979d38c94754ec998f38fd4e97c3ab9 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:54.256040 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979d38c94754ec998f38fd4e97c3ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.262706 20163 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 39) took 1036 ms. Trace:
I20260709 12:16:54.263919 20163 rpcz_store.cc:276] 0709 12:16:53.226463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.014649 (+788186us) service_pool.cc:224] Handling call
0709 12:16:54.042843 (+ 28194us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.042985 (+   142us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.192710 (+149725us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.257699 (+ 64989us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.262630 (+  4931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.264766 20316 tablet_service.cc:1511] Processing CreateTablet for tablet dda77defaf824b5c9cc9505346d7080c (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:54.266110 20318 tablet_service.cc:1511] Processing CreateTablet for tablet 04d32aa1a8cf46979742c1fb0beb8b2c (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:54.266873 20372 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.276497 20316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda77defaf824b5c9cc9505346d7080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.278548 20245 tablet_service.cc:1511] Processing CreateTablet for tablet e8aaa749694d4c0c9f5af38eeb53fe12 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:54.282513 20319 tablet_service.cc:1511] Processing CreateTablet for tablet 8271323bedc7421a87f787fc100b6efe (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:54.284101 20317 tablet_service.cc:1511] Processing CreateTablet for tablet e8aaa749694d4c0c9f5af38eeb53fe12 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:54.294267 20163 tablet_service.cc:1511] Processing CreateTablet for tablet fbb68e81778549dc97b899388fd918fc (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:54.283262 20237 tablet_service.cc:1511] Processing CreateTablet for tablet dda77defaf824b5c9cc9505346d7080c (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:54.290612 20370 tablet_bootstrap.cc:654] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.299021 20163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb68e81778549dc97b899388fd918fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.294636 20241 tablet_service.cc:1511] Processing CreateTablet for tablet 04d32aa1a8cf46979742c1fb0beb8b2c (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:54.300761 20394 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.302399 20394 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.304766 20394 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:54.305192 20245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8aaa749694d4c0c9f5af38eeb53fe12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.306595 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:54.308166 20295 leader_election.cc:343] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.309886 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:54.311450 20294 leader_election.cc:343] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.311944 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.313124 20394 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.314426 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d32aa1a8cf46979742c1fb0beb8b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.320813 20372 ts_tablet_manager.cc:1434] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.000s
I20260709 12:16:54.324779 20313 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5dfa3335ec44bcb98beeec64591f01 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:54.332525 20241 tablet_service.cc:1511] Processing CreateTablet for tablet 8271323bedc7421a87f787fc100b6efe (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:54.333900 20241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8271323bedc7421a87f787fc100b6efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.336174 20163 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:54.337522 20163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.338632 20237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda77defaf824b5c9cc9505346d7080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.340222 20162 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 34) took 1282 ms. Trace:
I20260709 12:16:54.340664 20162 rpcz_store.cc:276] 0709 12:16:53.057567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.875916 (+818349us) service_pool.cc:224] Handling call
0709 12:16:53.877661 (+  1745us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.877759 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.131020 (+253261us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.301498 (+170478us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.340157 (+ 38659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.342485 20319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8271323bedc7421a87f787fc100b6efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.346287 20076 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.355526 20162 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe31035391b450ebd3c369e9917f7aa (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:54.356947 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe31035391b450ebd3c369e9917f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.355557 20372 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.360564 20317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8aaa749694d4c0c9f5af38eeb53fe12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.363871 20318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d32aa1a8cf46979742c1fb0beb8b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.365485 20371 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.366034 20371 ts_tablet_manager.cc:1403] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.352s	user 0.019s	sys 0.007s
I20260709 12:16:54.367861 20313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5dfa3335ec44bcb98beeec64591f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.376830 20371 raft_consensus.cc:359] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.379802 20240 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5dfa3335ec44bcb98beeec64591f01 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:54.383251 20170 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 38) took 1193 ms. Trace:
I20260709 12:16:54.383757 20167 tablet_service.cc:1511] Processing CreateTablet for tablet 674ae039bae9486b8fa77a2493757981 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:54.384373 20165 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 40) took 1102 ms. Trace:
I20260709 12:16:54.388049 20371 raft_consensus.cc:385] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.392752 20170 rpcz_store.cc:276] 0709 12:16:53.189562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.987459 (+797897us) service_pool.cc:224] Handling call
0709 12:16:53.989640 (+  2181us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:53.989782 (+   142us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.297686 (+307904us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.382725 (+ 85039us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.383183 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.400118 20240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5dfa3335ec44bcb98beeec64591f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.400647 20170 tablet_service.cc:1511] Processing CreateTablet for tablet 53fc708954624727a65ab4485d1a2285 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:54.408182 20372 tablet_bootstrap.cc:654] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.395550 20371 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.394863 20165 rpcz_store.cc:276] 0709 12:16:53.256803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.119780 (+862977us) service_pool.cc:224] Handling call
0709 12:16:54.147585 (+ 27805us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.147712 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.259014 (+111302us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.359058 (+100044us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.359526 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.412490 20371 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.417637 20370 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.418139 20370 ts_tablet_manager.cc:1403] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.003s
I20260709 12:16:54.413957 20164 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 44) took 1025 ms. Trace:
I20260709 12:16:54.414292 20165 tablet_service.cc:1511] Processing CreateTablet for tablet dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:54.415158 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674ae039bae9486b8fa77a2493757981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.415777 20169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 42) took 1089 ms. Trace:
I20260709 12:16:54.425532 20169 rpcz_store.cc:276] 0709 12:16:53.326656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.178892 (+852236us) service_pool.cc:224] Handling call
0709 12:16:54.195870 (+ 16978us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.195994 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.259047 (+ 63053us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.393863 (+134816us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.415715 (+ 21852us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319168}
I20260709 12:16:54.428476 20169 tablet_service.cc:1511] Processing CreateTablet for tablet ff822ba5f5ad4f8c87f6018de9072cfb (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:54.421305 20164 rpcz_store.cc:276] 0709 12:16:53.388279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.184226 (+795947us) service_pool.cc:224] Handling call
0709 12:16:54.185972 (+  1746us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.186075 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.332344 (+146269us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.413470 (+ 81126us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.413894 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1974}
I20260709 12:16:54.431409 20370 raft_consensus.cc:359] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.432227 20370 raft_consensus.cc:385] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.432540 20370 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.434047 20371 ts_tablet_manager.cc:1434] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:16:54.437042 20370 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.438434 20378 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.439383 20164 tablet_service.cc:1511] Processing CreateTablet for tablet e8aaa749694d4c0c9f5af38eeb53fe12 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:54.440943 20166 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 45) took 1048 ms. Trace:
I20260709 12:16:54.441902 20165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc4c01fd2da34b0e9fb9ba3d8b2bd4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.445395 20378 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.453500 20169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff822ba5f5ad4f8c87f6018de9072cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.454779 20378 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.455945 20170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc708954624727a65ab4485d1a2285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.444554 20166 rpcz_store.cc:276] 0709 12:16:53.392958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.217457 (+824499us) service_pool.cc:224] Handling call
0709 12:16:54.240106 (+ 22649us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.241850 (+  1744us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.271256 (+ 29406us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.411443 (+140187us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.440879 (+ 29436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:54.458788 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.459162 20164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8aaa749694d4c0c9f5af38eeb53fe12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.459457 20254 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:54.462942 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.463315 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:54.464244 20378 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.464586 20378 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.464942 20378 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:54.465293 20144 leader_election.cc:343] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.472352 20378 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.472780 20371 tablet_bootstrap.cc:492] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.473064 20168 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45116 (request call id 41) took 1158 ms. Trace:
I20260709 12:16:54.473431 20168 rpcz_store.cc:276] 0709 12:16:53.314358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.163873 (+849515us) service_pool.cc:224] Handling call
0709 12:16:54.180249 (+ 16376us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.180340 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.308191 (+127851us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.425118 (+116927us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.440528 (+ 15410us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd41a2 00007f5de0d15889 00007f5ddfe46d88 00007f5ddff0d973 00007f5ddff0970f 00007f5ddff09ecd 00007f5ddfeb8400 00007f5dd933daf4 00007f5dd933da82
0709 12:16:54.472994 (+ 32466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9379584}
I20260709 12:16:54.482431 20166 tablet_service.cc:1511] Processing CreateTablet for tablet dda77defaf824b5c9cc9505346d7080c (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:54.483852 20166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda77defaf824b5c9cc9505346d7080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.480101 20371 tablet_bootstrap.cc:654] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.492669 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:54.493341 20254 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.494175 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:54.495308 20161 tablet_service.cc:1511] Processing CreateTablet for tablet 8271323bedc7421a87f787fc100b6efe (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:16:54.495700 20144 leader_election.cc:343] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.496320 20378 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.496763 20161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8271323bedc7421a87f787fc100b6efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.496815 20372 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.490994 20162 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5dfa3335ec44bcb98beeec64591f01 (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:54.497866 20372 ts_tablet_manager.cc:1403] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.007s
I20260709 12:16:54.498281 20162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5dfa3335ec44bcb98beeec64591f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.502167 20370 ts_tablet_manager.cc:1434] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 12:16:54.503991 20370 tablet_bootstrap.cc:492] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:54.504454 20372 raft_consensus.cc:359] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.518029 20372 raft_consensus.cc:385] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.518391 20372 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.505887 20254 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:54.520237 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:16:54.521103 20378 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.475535 20168 tablet_service.cc:1511] Processing CreateTablet for tablet 04d32aa1a8cf46979742c1fb0beb8b2c (DEFAULT_TABLE table=test-workload [id=de5952fc08474ab1a16a9522bfe34b08]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:54.525266 20168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d32aa1a8cf46979742c1fb0beb8b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.515729 20371 tablet_bootstrap.cc:492] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.527207 20371 ts_tablet_manager.cc:1403] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 12:16:54.547870 20378 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:54.557950 20378 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.559594 20371 raft_consensus.cc:359] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.560388 20371 raft_consensus.cc:385] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.560698 20371 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.561465 20371 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.544766 20372 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.572165 20372 ts_tablet_manager.cc:1434] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.007s
I20260709 12:16:54.573649 20407 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.574203 20407 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.576146 20076 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.583860 20372 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.588229 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.589025 20371 ts_tablet_manager.cc:1434] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.013s
W20260709 12:16:54.589852 20144 leader_election.cc:343] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.590395 20371 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.595068 20372 tablet_bootstrap.cc:654] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:54.595477 20294 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:54.597625 20371 tablet_bootstrap.cc:654] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.597620 20370 tablet_bootstrap.cc:654] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.600714 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:54.602276 20144 leader_election.cc:343] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.602766 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:54.603741 20409 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.609840 20394 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.604696 20407 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.618676 20372 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.619302 20372 ts_tablet_manager.cc:1403] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.020s
I20260709 12:16:54.622696 20372 raft_consensus.cc:359] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.623483 20372 raft_consensus.cc:385] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.623871 20372 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.624843 20372 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.627436 20372 ts_tablet_manager.cc:1434] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:54.637969 20372 tablet_bootstrap.cc:492] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.646122 20372 tablet_bootstrap.cc:654] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.646557 20370 tablet_bootstrap.cc:492] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.647091 20370 ts_tablet_manager.cc:1403] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.039s
I20260709 12:16:54.652185 20371 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.652751 20371 ts_tablet_manager.cc:1403] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.016s
I20260709 12:16:54.655803 20371 raft_consensus.cc:359] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.656699 20371 raft_consensus.cc:385] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.657013 20371 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.658948 20372 tablet_bootstrap.cc:492] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.658857 20370 raft_consensus.cc:359] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.659629 20372 ts_tablet_manager.cc:1403] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:16:54.659793 20370 raft_consensus.cc:385] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.660183 20370 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.661096 20370 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.663131 20372 raft_consensus.cc:359] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.664141 20372 raft_consensus.cc:385] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.664575 20370 ts_tablet_manager.cc:1434] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 12:16:54.664609 20372 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.665799 20370 tablet_bootstrap.cc:492] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:54.666159 20372 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.662175 20371 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.668457 20407 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.669369 20372 ts_tablet_manager.cc:1434] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:16:54.668910 20407 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.669900 20371 ts_tablet_manager.cc:1434] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:54.671142 20407 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.673441 20372 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.673557 20371 tablet_bootstrap.cc:492] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.675992 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:54.678010 20144 leader_election.cc:343] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.675385 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:54.680540 20144 leader_election.cc:343] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.681197 20372 tablet_bootstrap.cc:654] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.681141 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:54.683964 20371 tablet_bootstrap.cc:654] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.685918 20370 tablet_bootstrap.cc:654] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.699484 20378 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.700377 20370 tablet_bootstrap.cc:492] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.700453 20372 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.700894 20371 tablet_bootstrap.cc:492] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.701030 20370 ts_tablet_manager.cc:1403] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.006s
I20260709 12:16:54.701257 20372 ts_tablet_manager.cc:1403] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 12:16:54.701366 20371 ts_tablet_manager.cc:1403] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.012s
I20260709 12:16:54.704465 20370 raft_consensus.cc:359] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.704731 20371 raft_consensus.cc:359] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.705272 20370 raft_consensus.cc:385] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.704924 20372 raft_consensus.cc:359] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.705554 20371 raft_consensus.cc:385] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.705654 20370 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.705958 20372 raft_consensus.cc:385] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.705958 20371 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.706571 20372 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.706661 20370 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.706980 20371 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.707698 20372 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.709722 20371 ts_tablet_manager.cc:1434] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:54.710214 20372 ts_tablet_manager.cc:1434] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:54.710809 20371 tablet_bootstrap.cc:492] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.711936 20372 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.716892 20414 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.717381 20414 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.718027 20371 tablet_bootstrap.cc:654] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.719604 20372 tablet_bootstrap.cc:654] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.721016 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:54.722584 20295 leader_election.cc:343] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.725226 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.725927 20254 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:54.726822 20372 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.727439 20372 ts_tablet_manager.cc:1403] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 12:16:54.727512 20370 ts_tablet_manager.cc:1434] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 12:16:54.731637 20370 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:54.731805 20414 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:54.731456 20372 raft_consensus.cc:359] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.736528 20372 raft_consensus.cc:385] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.736886 20372 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.727349 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.738008 20371 tablet_bootstrap.cc:492] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.738528 20371 ts_tablet_manager.cc:1403] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 12:16:54.738490 20414 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.739104 20414 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.739602 20414 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.741483 20370 tablet_bootstrap.cc:654] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.741904 20371 raft_consensus.cc:359] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.742631 20371 raft_consensus.cc:385] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.742929 20371 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.737643 20372 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.743654 20371 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.745203 20372 ts_tablet_manager.cc:1434] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:16:54.745846 20371 ts_tablet_manager.cc:1434] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:54.749687 20370 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.749868 20414 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.750272 20370 ts_tablet_manager.cc:1403] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:16:54.752512 20371 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.752806 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:16:54.754172 20295 leader_election.cc:343] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.754106 20370 raft_consensus.cc:359] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.755115 20370 raft_consensus.cc:385] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.755512 20370 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.756397 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:54.757149 20254 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.756413 20370 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.764038 20372 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.765092 20254 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:54.766373 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.767326 20377 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.767802 20371 tablet_bootstrap.cc:654] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.767831 20370 ts_tablet_manager.cc:1434] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:16:54.767877 20377 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:54.769130 20377 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.770795 20372 tablet_bootstrap.cc:654] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.774300 20414 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:54.778029 20370 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:54.779914 20371 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.780503 20371 ts_tablet_manager.cc:1403] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:16:54.783301 20371 raft_consensus.cc:359] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.783979 20371 raft_consensus.cc:385] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.784256 20371 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.785080 20371 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.785753 20078 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.789024 20377 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.789683 20370 tablet_bootstrap.cc:654] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.789495 20377 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.794219 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:54.795769 20295 leader_election.cc:343] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.796625 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.797147 20377 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:16:54.797844 20294 leader_election.cc:343] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.798339 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.794293 20395 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.799144 20377 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.797967 20372 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.799650 20395 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.800557 20372 ts_tablet_manager.cc:1403] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.020s
I20260709 12:16:54.801479 20370 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.802007 20370 ts_tablet_manager.cc:1403] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.001s
I20260709 12:16:54.802042 20395 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.803839 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.803794 20372 raft_consensus.cc:359] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.804575 20372 raft_consensus.cc:385] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.804522 20330 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:54.804916 20372 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.805198 20370 raft_consensus.cc:359] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.805969 20370 raft_consensus.cc:385] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.805732 20372 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.805823 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:54.806442 20370 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.806805 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:54.807672 20371 ts_tablet_manager.cc:1434] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:16:54.807780 20372 ts_tablet_manager.cc:1434] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:54.807526 20370 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.808260 20378 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.808698 20372 tablet_bootstrap.cc:492] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.811741 20371 tablet_bootstrap.cc:492] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.815299 20372 tablet_bootstrap.cc:654] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.808727 20378 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.819773 20407 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.819947 20378 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.820305 20407 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.822376 20407 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.822314 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.823068 20254 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:54.823371 20371 tablet_bootstrap.cc:654] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.805856 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:54.831728 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:54.832283 20372 tablet_bootstrap.cc:492] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.832885 20372 ts_tablet_manager.cc:1403] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.012s
I20260709 12:16:54.833510 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.834157 20330 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:54.835153 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.836783 20370 ts_tablet_manager.cc:1434] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:16:54.836570 20372 raft_consensus.cc:359] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.837340 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:54.837491 20372 raft_consensus.cc:385] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.837881 20372 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.837961 20254 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:54.839370 20395 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.838824 20372 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.839804 20395 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.840188 20395 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.842947 20372 ts_tablet_manager.cc:1434] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:16:54.843822 20407 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.844199 20407 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.844208 20372 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.845430 20370 tablet_bootstrap.cc:492] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
W20260709 12:16:54.846787 20144 leader_election.cc:343] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.844653 20407 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.848874 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:16:54.850059 20378 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.850462 20378 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.850848 20378 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.851692 20372 tablet_bootstrap.cc:654] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.861369 20370 tablet_bootstrap.cc:654] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.873206 20370 tablet_bootstrap.cc:492] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:54.873726 20370 ts_tablet_manager.cc:1403] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 12:16:54.875289 20395 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.876606 20370 raft_consensus.cc:359] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.880816 20370 raft_consensus.cc:385] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.881122 20370 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.881970 20370 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.883507 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:54.884415 20180 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.878324 20407 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.895473 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:54.896703 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:54.897290 20254 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.897392 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:54.879999 20378 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.893580 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:54.899063 20395 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.900313 20329 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.904323 20370 ts_tablet_manager.cc:1434] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.009s
I20260709 12:16:54.910305 20395 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.920733 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:54.921409 20330 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.911298 20395 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:54.923115 20254 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:54.924274 20378 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.925361 20395 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.926832 20329 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:54.918545 20407 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.928560 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:54.930763 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:54.931061 20407 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.931380 20329 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.932680 20407 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:54.932852 20370 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:54.933456 20371 tablet_bootstrap.cc:492] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:54.933924 20371 ts_tablet_manager.cc:1403] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.122s	user 0.045s	sys 0.041s
I20260709 12:16:54.934144 20372 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:54.934725 20372 ts_tablet_manager.cc:1403] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.043s
I20260709 12:16:54.932047 20330 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:54.934037 20407 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:16:54.938187 20372 raft_consensus.cc:359] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.938886 20372 raft_consensus.cc:385] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.939180 20372 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.939985 20372 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.940299 20371 raft_consensus.cc:359] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.940919 20371 raft_consensus.cc:385] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.941210 20371 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.942420 20370 tablet_bootstrap.cc:654] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.942948 20371 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.944238 20395 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.944495 20372 ts_tablet_manager.cc:1434] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:16:54.944718 20395 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.945273 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:54.945592 20372 tablet_bootstrap.cc:492] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:54.945850 20254 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.948815 20329 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:54.952772 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:54.959021 20378 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:54.960166 20220 leader_election.cc:343] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.960449 20078 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.961604 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:54.960471 20254 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:54.962983 20409 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.963510 20409 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:54.964627 20409 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.952997 20395 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.954452 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:54.970678 20219 leader_election.cc:343] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.971204 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:54.972396 20395 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.973976 20407 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.974466 20407 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:54.976775 20407 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:54.954706 20372 tablet_bootstrap.cc:654] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.956609 20371 ts_tablet_manager.cc:1434] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:16:54.981603 20371 tablet_bootstrap.cc:492] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:54.981905 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:54.982576 20330 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:54.984087 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:54.985245 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:54.988063 20144 leader_election.cc:343] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.990478 20407 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.991184 20407 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.991653 20407 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.995893 20371 tablet_bootstrap.cc:654] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.995128 20077 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.004819 20370 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.005342 20370 ts_tablet_manager.cc:1403] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.025s
I20260709 12:16:55.008231 20370 raft_consensus.cc:359] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.008934 20370 raft_consensus.cc:385] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.009223 20370 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.009931 20370 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.011019 20330 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.012010 20370 ts_tablet_manager.cc:1434] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:16:55.012987 20370 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.018285 20078 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.019255 20370 tablet_bootstrap.cc:654] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.031332 20370 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.031833 20370 ts_tablet_manager.cc:1403] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:16:55.034758 20370 raft_consensus.cc:359] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.037370 20372 tablet_bootstrap.cc:492] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.037844 20372 ts_tablet_manager.cc:1403] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.000s
I20260709 12:16:55.035524 20370 raft_consensus.cc:385] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.040530 20370 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.040706 20372 raft_consensus.cc:359] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.041375 20372 raft_consensus.cc:385] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.041216 20370 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.043283 20370 ts_tablet_manager.cc:1434] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:16:55.041651 20372 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.044085 20372 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.044216 20407 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.045878 20370 tablet_bootstrap.cc:492] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.046554 20372 ts_tablet_manager.cc:1434] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:55.047089 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:55.048091 20372 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
W20260709 12:16:55.048290 20144 leader_election.cc:343] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.050482 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.051085 20329 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.056015 20372 tablet_bootstrap.cc:654] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.058444 20370 tablet_bootstrap.cc:654] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.063799 20377 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.064297 20377 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.064736 20441 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.065426 20371 tablet_bootstrap.cc:492] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:55.066047 20371 ts_tablet_manager.cc:1403] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.085s	user 0.030s	sys 0.025s
I20260709 12:16:55.066545 20377 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.068156 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.068183 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.074635 20294 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.074971 20329 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:55.070662 20371 raft_consensus.cc:359] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.077083 20371 raft_consensus.cc:385] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.077415 20371 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.080652 20371 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.083485 20371 ts_tablet_manager.cc:1434] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:16:55.083683 20377 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.084509 20371 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:55.089429 20370 tablet_bootstrap.cc:492] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.090817 20370 ts_tablet_manager.cc:1403] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.006s
I20260709 12:16:55.091128 20407 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.094635 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:16:55.095495 20407 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.096143 20372 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.096117 20407 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:55.096688 20372 ts_tablet_manager.cc:1403] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.003s
I20260709 12:16:55.097236 20407 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.098891 20370 raft_consensus.cc:359] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.099123 20372 raft_consensus.cc:359] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.099613 20370 raft_consensus.cc:385] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.099783 20372 raft_consensus.cc:385] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.099923 20370 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.100076 20372 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.100867 20395 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.100972 20372 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.101384 20395 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.102722 20372 ts_tablet_manager.cc:1434] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:55.104172 20377 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.104668 20377 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.100687 20370 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.106360 20254 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.108316 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.108981 20179 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:55.110296 20295 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:55.111160 20414 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.111526 20414 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.111888 20414 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.111935 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.112650 20180 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.114092 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:55.114464 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.115139 20433 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.115505 20433 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.115860 20433 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.117069 20370 ts_tablet_manager.cc:1434] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
W20260709 12:16:55.118026 20294 leader_election.cc:343] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.119685 20377 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.103549 20395 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.120896 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.123943 20329 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.121970 20370 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.125952 20433 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.121970 20414 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.129416 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:55.129962 20180 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.130493 20371 tablet_bootstrap.cc:654] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.131590 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:55.132365 20179 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.103691 20372 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.143100 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.143932 20329 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.148600 20395 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.149230 20395 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.163509 20372 tablet_bootstrap.cc:654] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.166277 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:55.164803 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.165158 20414 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.164636 20370 tablet_bootstrap.cc:654] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:55.169950 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:55.171872 20395 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.172098 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:55.172307 20294 leader_election.cc:343] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.172459 20433 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.172962 20330 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:16:55.173942 20180 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:55.174672 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.175494 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:55.176302 20433 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.176656 20395 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.177592 20395 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:55.178750 20395 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.189726 20329 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:55.191416 20372 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.192224 20372 ts_tablet_manager.cc:1403] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.005s
I20260709 12:16:55.192633 20078 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.143121 20179 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:55.195322 20295 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:16:55.196197 20414 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.196775 20414 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:55.197718 20414 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.195973 20370 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.199815 20370 ts_tablet_manager.cc:1403] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.007s
I20260709 12:16:55.202509 20372 raft_consensus.cc:359] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.203217 20372 raft_consensus.cc:385] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.203480 20372 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.204185 20372 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.206270 20372 ts_tablet_manager.cc:1434] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:16:55.207217 20372 tablet_bootstrap.cc:492] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.212819 20370 raft_consensus.cc:359] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.213714 20370 raft_consensus.cc:385] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.214056 20370 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.214334 20371 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:55.214892 20371 ts_tablet_manager.cc:1403] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.036s
I20260709 12:16:55.215075 20370 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.216490 20433 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.217378 20377 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.217871 20377 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.218305 20370 ts_tablet_manager.cc:1434] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:55.219542 20370 tablet_bootstrap.cc:492] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.220079 20377 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.219853 20076 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.225725 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.226028 20370 tablet_bootstrap.cc:654] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:55.226892 20295 leader_election.cc:343] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.227921 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.228252 20371 raft_consensus.cc:359] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.228965 20371 raft_consensus.cc:385] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.228359 20078 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.229207 20371 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
W20260709 12:16:55.229418 20294 leader_election.cc:343] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.232134 20372 tablet_bootstrap.cc:654] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.232096 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.233000 20414 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.229960 20371 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.237497 20372 tablet_bootstrap.cc:492] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.238003 20372 ts_tablet_manager.cc:1403] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 12:16:55.239523 20371 ts_tablet_manager.cc:1434] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:16:55.240557 20371 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:55.240980 20372 raft_consensus.cc:359] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.241641 20372 raft_consensus.cc:385] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.241950 20372 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.241961 20407 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.242518 20407 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.242719 20372 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.245818 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.246488 20254 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:55.247816 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:55.248220 20370 tablet_bootstrap.cc:492] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.248711 20370 ts_tablet_manager.cc:1403] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 12:16:55.248909 20409 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.249392 20409 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.249752 20409 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.250425 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.251024 20329 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:55.251365 20370 raft_consensus.cc:359] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.252068 20370 raft_consensus.cc:385] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.252315 20370 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.252898 20370 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.254895 20370 ts_tablet_manager.cc:1434] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:55.248973 20407 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.255792 20370 tablet_bootstrap.cc:492] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.256817 20372 ts_tablet_manager.cc:1434] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:55.257745 20372 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.258167 20433 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.258596 20433 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.260916 20433 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.262573 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.263180 20329 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.264668 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:55.265550 20372 tablet_bootstrap.cc:654] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.266862 20433 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.267297 20433 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.267387 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.267725 20433 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:55.269773 20220 leader_election.cc:343] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.272660 20409 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.274683 20370 tablet_bootstrap.cc:654] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.275018 20409 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.280259 20433 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.274720 20371 tablet_bootstrap.cc:654] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.275954 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:55.281819 20254 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.284209 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.284790 20329 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.285120 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.285712 20330 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.287186 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:16:55.288458 20220 leader_election.cc:343] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.292475 20329 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:55.293849 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.294798 20395 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.295258 20395 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:55.295730 20254 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:55.296298 20330 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:55.296415 20395 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.297549 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:55.299532 20409 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.300284 20409 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:55.301385 20409 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.301841 20433 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.309230 20433 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.310547 20372 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.311184 20372 ts_tablet_manager.cc:1403] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.003s
I20260709 12:16:55.314867 20372 raft_consensus.cc:359] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.315773 20372 raft_consensus.cc:385] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.316139 20372 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.318946 20371 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:55.318290 20077 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.319434 20371 ts_tablet_manager.cc:1403] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.003s
I20260709 12:16:55.319623 20370 tablet_bootstrap.cc:492] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.320071 20370 ts_tablet_manager.cc:1403] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.031s
I20260709 12:16:55.317207 20372 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.323019 20370 raft_consensus.cc:359] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.323654 20370 raft_consensus.cc:385] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.323899 20370 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.324185 20372 ts_tablet_manager.cc:1434] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:16:55.324651 20370 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.325322 20371 raft_consensus.cc:359] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.325973 20371 raft_consensus.cc:385] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.326260 20371 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.327549 20370 ts_tablet_manager.cc:1434] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:55.328509 20370 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.333281 20372 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.334831 20370 tablet_bootstrap.cc:654] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.327018 20371 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.342583 20371 ts_tablet_manager.cc:1434] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:16:55.343947 20371 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:55.345628 20076 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.356735 20432 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.357280 20432 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.359071 20409 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.359604 20409 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.359493 20432 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.367166 20414 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.367307 20409 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.367664 20414 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.368464 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.369753 20414 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.371119 20372 tablet_bootstrap.cc:654] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:55.369681 20144 leader_election.cc:343] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.371306 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.371951 20330 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:55.374270 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.374902 20254 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:55.376884 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:55.377444 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.377928 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:16:55.378726 20409 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.379175 20414 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.379230 20409 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.380595 20409 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.380137 20414 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.383788 20414 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:55.382545 20295 leader_election.cc:343] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.388382 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.388777 20407 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.389318 20179 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:16:55.391701 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.391913 20432 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.392477 20432 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.396015 20432 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.394909 20179 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.396785 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.399833 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:16:55.403609 20219 leader_election.cc:343] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.405933 20395 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.408171 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.411134 20377 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.398670 20371 tablet_bootstrap.cc:654] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.414913 20377 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:55.415035 20220 leader_election.cc:343] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.415820 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.416338 20370 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.416862 20370 ts_tablet_manager.cc:1403] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.089s	user 0.025s	sys 0.030s
I20260709 12:16:55.416872 20433 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.419695 20370 raft_consensus.cc:359] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.420373 20370 raft_consensus.cc:385] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.420686 20370 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.421347 20370 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.422035 20433 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.420253 20414 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.426288 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:16:55.427809 20295 leader_election.cc:343] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.428191 20370 ts_tablet_manager.cc:1434] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:55.428773 20414 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.429144 20370 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.432655 20372 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.433388 20372 ts_tablet_manager.cc:1403] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.004s
I20260709 12:16:55.443966 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:55.444802 20255 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.439265 20409 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.456807 20433 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.458701 20433 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.467725 20433 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.467998 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.468820 20178 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:16:55.470767 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.471423 20329 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.472720 20219 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:55.474512 20433 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.474421 20255 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:55.475457 20433 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.476164 20433 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.479688 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.483848 20371 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:55.484355 20371 ts_tablet_manager.cc:1403] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.028s
I20260709 12:16:55.487017 20372 raft_consensus.cc:359] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.487972 20372 raft_consensus.cc:385] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.488085 20414 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.488369 20372 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.488626 20414 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.489028 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:55.490816 20414 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.489737 20372 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.491668 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.494750 20409 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:55.494956 20295 leader_election.cc:343] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.495994 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.496665 20329 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.496600 20371 raft_consensus.cc:359] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.497695 20395 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.497359 20371 raft_consensus.cc:385] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.499995 20371 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.502542 20371 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.505570 20371 ts_tablet_manager.cc:1434] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:16:55.499202 20372 ts_tablet_manager.cc:1434] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:16:55.498826 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.506714 20372 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
W20260709 12:16:55.507490 20294 leader_election.cc:343] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.509369 20294 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.510500 20414 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.498442 20463 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.512020 20409 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.512989 20463 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:55.518242 20371 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:55.519737 20409 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.521659 20463 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.528630 20370 tablet_bootstrap.cc:654] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.527489 20329 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:55.539063 20372 tablet_bootstrap.cc:654] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.540788 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:55.541844 20409 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.542410 20409 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:55.546142 20406 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:55.548156 20433 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.551584 20255 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:16:55.543533 20409 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.554697 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:55.560886 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.561609 20329 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:16:55.562743 20371 tablet_bootstrap.cc:654] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.562624 20219 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.566278 20395 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.563644 20433 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.600448 20377 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.610558 20377 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.614647 20076 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.618209 20377 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.622124 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.623085 20180 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:55.624795 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.628535 20078 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.629467 20295 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:16:55.632066 20294 leader_election.cc:343] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.633442 20370 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.633862 20370 ts_tablet_manager.cc:1403] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.205s	user 0.015s	sys 0.019s
I20260709 12:16:55.634697 20476 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.635113 20476 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.635453 20476 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.639359 20414 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.651552 20370 raft_consensus.cc:359] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.652608 20372 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.653005 20370 raft_consensus.cc:385] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.653246 20372 ts_tablet_manager.cc:1403] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.147s	user 0.027s	sys 0.006s
I20260709 12:16:55.653362 20370 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.654281 20370 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.656095 20372 raft_consensus.cc:359] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.656672 20370 ts_tablet_manager.cc:1434] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.010s
I20260709 12:16:55.656797 20372 raft_consensus.cc:385] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.657188 20372 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.658322 20372 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.659849 20370 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.662631 20372 ts_tablet_manager.cc:1434] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:55.663614 20372 tablet_bootstrap.cc:492] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.666818 20370 tablet_bootstrap.cc:654] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.673938 20371 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:55.674531 20371 ts_tablet_manager.cc:1403] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.003s
I20260709 12:16:55.677663 20371 raft_consensus.cc:359] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.678323 20371 raft_consensus.cc:385] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.678411 20370 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.678637 20371 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.679013 20370 ts_tablet_manager.cc:1403] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:16:55.679358 20371 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.682193 20370 raft_consensus.cc:359] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.683050 20370 raft_consensus.cc:385] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.683386 20370 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.684257 20377 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.684324 20370 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.686906 20370 ts_tablet_manager.cc:1434] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:55.687945 20370 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.693676 20433 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.696967 20476 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.699658 20441 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.700265 20476 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.701215 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:55.701807 20180 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.702199 20370 tablet_bootstrap.cc:654] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.707751 20433 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.708273 20372 tablet_bootstrap.cc:654] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.708386 20433 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.712056 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.713836 20372 tablet_bootstrap.cc:492] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.713922 20370 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.714389 20372 ts_tablet_manager.cc:1403] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.005s
I20260709 12:16:55.714583 20370 ts_tablet_manager.cc:1403] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.012s
I20260709 12:16:55.715138 20395 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.715402 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:55.715626 20395 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.716022 20256 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.713881 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.717331 20372 raft_consensus.cc:359] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.717818 20395 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.718014 20372 raft_consensus.cc:385] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.718344 20372 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.719127 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.719038 20372 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.719856 20329 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.721240 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.721472 20372 ts_tablet_manager.cc:1434] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:55.721325 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:55.722507 20372 tablet_bootstrap.cc:492] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.717721 20328 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:16:55.722987 20220 leader_election.cc:343] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.726353 20219 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.727686 20441 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.728835 20256 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:55.729965 20432 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.722366 20395 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.730518 20395 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.731683 20433 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.730613 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:55.732249 20372 tablet_bootstrap.cc:654] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.731945 20395 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.732532 20476 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.733456 20476 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:55.734414 20476 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.743290 20433 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.753139 20395 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.743326 20370 raft_consensus.cc:359] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.758708 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:55.759011 20370 raft_consensus.cc:385] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.759428 20370 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.758708 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.760296 20329 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.760422 20370 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.761432 20441 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.762437 20441 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.763847 20395 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.764920 20441 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.765204 20370 ts_tablet_manager.cc:1434] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 12:16:55.767148 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:55.768092 20220 leader_election.cc:343] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.768852 20370 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.773902 20329 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
W20260709 12:16:55.774845 20144 leader_election.cc:343] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.775506 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.776904 20395 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.777493 20395 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:55.778564 20395 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.782370 20372 tablet_bootstrap.cc:492] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:55.783007 20372 ts_tablet_manager.cc:1403] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.012s
I20260709 12:16:55.784850 20371 ts_tablet_manager.cc:1434] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:16:55.786099 20371 tablet_bootstrap.cc:492] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:55.786237 20370 tablet_bootstrap.cc:654] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.786922 20372 raft_consensus.cc:359] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.787901 20372 raft_consensus.cc:385] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.788262 20372 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.789179 20372 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.792275 20372 ts_tablet_manager.cc:1434] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:16:55.792850 20180 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:55.793503 20372 tablet_bootstrap.cc:492] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:55.803468 20370 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:55.804106 20370 ts_tablet_manager.cc:1403] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 12:16:55.804744 20433 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.805274 20433 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.811843 20433 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:55.812610 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.813936 20329 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.820552 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:55.843899 20433 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.844502 20433 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.844959 20433 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.848305 20409 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.848874 20409 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.853653 20486 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.854336 20486 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.859306 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:55.860910 20220 leader_election.cc:343] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.866891 20441 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.875658 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.876045 20395 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:55.877049 20220 leader_election.cc:343] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.885620 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.894080 20486 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:55.898574 20144 leader_election.cc:343] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.899061 20371 tablet_bootstrap.cc:654] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.899169 20144 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:55.900590 20441 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.902086 20441 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.906088 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.906728 20328 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:55.907797 20076 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.908895 20409 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:55.909780 20220 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:55.912281 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:55.893045 20370 raft_consensus.cc:359] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.916394 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:55.917380 20372 tablet_bootstrap.cc:654] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.917917 20255 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:16:55.918231 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.919595 20486 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.920091 20486 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.920995 20486 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.921829 20144 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:55.916464 20370 raft_consensus.cc:385] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.924371 20370 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.926422 20370 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.927708 20441 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.928550 20370 ts_tablet_manager.cc:1434] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.000s
I20260709 12:16:55.929314 20370 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:55.938971 20441 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.944389 20433 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.959218 20476 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.959803 20476 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.961927 20476 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:55.964356 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:55.964874 20486 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:55.965974 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:55.969996 20295 leader_election.cc:343] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.971282 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.971943 20327 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.973737 20077 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.982769 20370 tablet_bootstrap.cc:654] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.988116 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:55.988977 20330 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.989065 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:55.972586 20486 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:55.995399 20294 leader_election.cc:343] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.995931 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:55.997839 20476 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.988163 20441 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:16:55.994796 20433 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:56.018435 20220 leader_election.cc:343] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.023711 20476 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.028388 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:56.019202 20327 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:56.054010 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.055153 20433 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.055855 20433 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:56.027401 20476 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.063843 20433 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.065847 20377 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.070619 20372 tablet_bootstrap.cc:492] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.071219 20372 ts_tablet_manager.cc:1403] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.278s	user 0.025s	sys 0.026s
I20260709 12:16:56.070185 20476 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.076345 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:56.081700 20295 leader_election.cc:343] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:56.084074 20498 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:16:56.085184 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:56.088137 20220 leader_election.cc:343] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:56.089473 20294 leader_election.cc:343] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.090478 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.082712 20476 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.092433 20463 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.114519 20370 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.115132 20370 ts_tablet_manager.cc:1403] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.186s	user 0.022s	sys 0.024s
I20260709 12:16:56.125331 20371 tablet_bootstrap.cc:492] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.125910 20371 ts_tablet_manager.cc:1403] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.340s	user 0.033s	sys 0.029s
I20260709 12:16:56.126852 20330 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:56.128386 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.130453 20433 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.131165 20433 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:56.133831 20371 raft_consensus.cc:359] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.138223 20371 raft_consensus.cc:385] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.138526 20371 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.138810 20076 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.139194 20371 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.137440 20433 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.141868 20371 ts_tablet_manager.cc:1434] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:16:56.142786 20371 tablet_bootstrap.cc:492] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.135313 20370 raft_consensus.cc:359] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.143177 20370 raft_consensus.cc:385] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.143473 20370 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.144135 20370 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.136080 20372 raft_consensus.cc:359] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.146236 20372 raft_consensus.cc:385] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.146461 20372 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.149333 20372 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.152053 20372 ts_tablet_manager.cc:1434] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.003s
I20260709 12:16:56.148859 20370 ts_tablet_manager.cc:1434] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.003s
I20260709 12:16:56.153478 20370 tablet_bootstrap.cc:492] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.153713 20372 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.154856 20409 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.156589 20371 tablet_bootstrap.cc:654] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.161645 20372 tablet_bootstrap.cc:654] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.168730 20370 tablet_bootstrap.cc:654] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.169584 20371 tablet_bootstrap.cc:492] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.170147 20371 ts_tablet_manager.cc:1403] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.008s
I20260709 12:16:56.171663 20372 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.172168 20372 ts_tablet_manager.cc:1403] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 12:16:56.175012 20372 raft_consensus.cc:359] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.175841 20372 raft_consensus.cc:385] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.176182 20372 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.177023 20372 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.179183 20372 ts_tablet_manager.cc:1434] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:56.180203 20372 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.186455 20372 tablet_bootstrap.cc:654] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.189630 20371 raft_consensus.cc:359] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.190055 20433 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.189280 20370 tablet_bootstrap.cc:492] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.190395 20371 raft_consensus.cc:385] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.190529 20433 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.192132 20371 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.192304 20370 ts_tablet_manager.cc:1403] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.009s
I20260709 12:16:56.192987 20371 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.193729 20433 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.195529 20370 raft_consensus.cc:359] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.195942 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.196218 20076 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.196256 20370 raft_consensus.cc:385] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.197705 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.197906 20370 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
W20260709 12:16:56.198266 20219 leader_election.cc:343] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.198321 20179 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:56.198613 20370 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.200213 20371 ts_tablet_manager.cc:1434] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.006s
I20260709 12:16:56.199994 20220 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:16:56.200858 20433 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.201179 20371 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.201198 20433 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.201617 20370 ts_tablet_manager.cc:1434] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:16:56.201679 20433 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.202672 20370 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
W20260709 12:16:56.207683 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:56.213225 20377 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.220690 20371 tablet_bootstrap.cc:654] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.227658 20370 tablet_bootstrap.cc:654] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.232455 20371 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.232964 20371 ts_tablet_manager.cc:1403] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.009s
I20260709 12:16:56.234285 20433 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.238047 20371 raft_consensus.cc:359] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.239355 20371 raft_consensus.cc:385] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.239342 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:56.239866 20371 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.240067 20180 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.240233 20377 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.240608 20371 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.245321 20486 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.248208 20180 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:56.249588 20220 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:56.250696 20486 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.251569 20486 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:56.252350 20371 ts_tablet_manager.cc:1434] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:16:56.252539 20486 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.253316 20371 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.256690 20377 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.257344 20377 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.261027 20433 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.261842 20377 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.262302 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:56.262465 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.263082 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.263324 20409 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.263860 20409 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:56.264130 20294 leader_election.cc:343] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.265817 20409 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.267607 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:56.267844 20295 leader_election.cc:343] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.268282 20295 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.269656 20463 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:56.273783 20219 leader_election.cc:343] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.275352 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.276618 20409 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.277129 20409 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.278297 20370 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.278784 20370 ts_tablet_manager.cc:1403] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.002s
I20260709 12:16:56.278605 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:56.279405 20409 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.280109 20501 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.282577 20370 raft_consensus.cc:359] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.283279 20370 raft_consensus.cc:385] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.283550 20370 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.283982 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.286609 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.299892 20370 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.302640 20370 ts_tablet_manager.cc:1434] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:16:56.302464 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:56.303740 20501 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.305981 20370 tablet_bootstrap.cc:492] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.306999 20180 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.314421 20433 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.315094 20433 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.317881 20371 tablet_bootstrap.cc:654] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.345598 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.349284 20372 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.349785 20372 ts_tablet_manager.cc:1403] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.170s	user 0.062s	sys 0.052s
I20260709 12:16:56.334357 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.352744 20372 raft_consensus.cc:359] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.353555 20372 raft_consensus.cc:385] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.353531 20330 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:56.354012 20372 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.354300 20370 tablet_bootstrap.cc:654] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.332734 20433 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.355454 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:16:56.356067 20220 leader_election.cc:343] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.356354 20433 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.356755 20433 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.354802 20372 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.357074 20433 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.358774 20372 ts_tablet_manager.cc:1434] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:56.359753 20372 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.370276 20486 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.366708 20078 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.378055 20371 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.378474 20371 ts_tablet_manager.cc:1403] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.006s
I20260709 12:16:56.384922 20433 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.387075 20433 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.388221 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:56.388795 20330 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.389197 20372 tablet_bootstrap.cc:654] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.391117 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:16:56.392876 20220 leader_election.cc:343] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.394359 20371 raft_consensus.cc:359] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.395058 20371 raft_consensus.cc:385] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.395300 20371 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.395958 20371 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.396270 20330 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:56.397666 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.398151 20371 ts_tablet_manager.cc:1434] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:16:56.398324 20433 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.398833 20433 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:56.399197 20371 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.399791 20433 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.401525 20370 tablet_bootstrap.cc:492] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.401999 20370 ts_tablet_manager.cc:1403] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.012s
I20260709 12:16:56.404946 20370 raft_consensus.cc:359] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.405601 20370 raft_consensus.cc:385] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.405876 20370 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.406322 20371 tablet_bootstrap.cc:654] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.406548 20370 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.408741 20370 ts_tablet_manager.cc:1434] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:56.409621 20370 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.416157 20370 tablet_bootstrap.cc:654] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.416044 20180 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.429318 20370 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.429975 20370 ts_tablet_manager.cc:1403] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:16:56.433765 20370 raft_consensus.cc:359] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.434664 20370 raft_consensus.cc:385] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.435019 20370 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.438336 20370 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.438884 20371 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.439446 20371 ts_tablet_manager.cc:1403] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.008s
I20260709 12:16:56.440832 20370 ts_tablet_manager.cc:1434] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:16:56.442148 20370 tablet_bootstrap.cc:492] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.442337 20371 raft_consensus.cc:359] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.443017 20371 raft_consensus.cc:385] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.443279 20371 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.445693 20371 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.448633 20372 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.453866 20372 ts_tablet_manager.cc:1403] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.094s	user 0.020s	sys 0.005s
I20260709 12:16:56.453701 20414 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.455183 20371 ts_tablet_manager.cc:1434] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:56.454710 20414 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.456784 20372 raft_consensus.cc:359] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.457456 20372 raft_consensus.cc:385] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.457741 20372 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.458320 20372 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.460210 20370 tablet_bootstrap.cc:654] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.465106 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.465734 20180 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:56.465826 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.466722 20253 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:56.467612 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:56.468420 20463 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.468791 20463 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.469128 20463 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.470321 20414 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.471133 20493 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.471619 20493 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.473785 20493 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.474581 20371 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.475920 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.476410 20463 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.477164 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:56.477874 20220 leader_election.cc:343] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:56.479389 20219 leader_election.cc:343] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.479846 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.480615 20433 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.481124 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:56.481703 20180 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.486264 20370 tablet_bootstrap.cc:492] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.486732 20370 ts_tablet_manager.cc:1403] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.002s
I20260709 12:16:56.486732 20077 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.488739 20371 tablet_bootstrap.cc:654] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.489353 20372 ts_tablet_manager.cc:1434] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.035s	user 0.001s	sys 0.005s
I20260709 12:16:56.491820 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:56.492630 20253 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.496277 20372 tablet_bootstrap.cc:492] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.496765 20180 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:56.497187 20463 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.499958 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:56.501499 20370 raft_consensus.cc:359] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.502035 20370 raft_consensus.cc:385] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.502270 20370 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.502871 20370 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.504657 20463 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.505575 20371 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.506047 20371 ts_tablet_manager.cc:1403] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.010s
I20260709 12:16:56.507447 20253 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:56.509268 20463 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:56.509351 20371 raft_consensus.cc:359] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.510063 20371 raft_consensus.cc:385] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.510340 20371 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.510246 20463 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.511240 20371 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.504750 20370 ts_tablet_manager.cc:1434] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:16:56.513720 20372 tablet_bootstrap.cc:654] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.514341 20370 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.520978 20371 ts_tablet_manager.cc:1434] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:16:56.521921 20371 tablet_bootstrap.cc:492] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.522840 20370 tablet_bootstrap.cc:654] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.527213 20433 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.529888 20501 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.530305 20372 tablet_bootstrap.cc:492] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.530345 20501 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.530879 20372 ts_tablet_manager.cc:1403] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.005s
I20260709 12:16:56.533247 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.533702 20372 raft_consensus.cc:359] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.534389 20372 raft_consensus.cc:385] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.534674 20372 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.536144 20371 tablet_bootstrap.cc:654] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.536499 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.537314 20328 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:16:56.538314 20501 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.538769 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:56.535367 20372 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.539611 20501 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.541507 20372 ts_tablet_manager.cc:1434] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:16:56.542475 20372 tablet_bootstrap.cc:492] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.547801 20501 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.550032 20372 tablet_bootstrap.cc:654] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.556048 20371 tablet_bootstrap.cc:492] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.556540 20371 ts_tablet_manager.cc:1403] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
W20260709 12:16:56.557888 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:56.559127 20486 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.561921 20370 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.562387 20370 ts_tablet_manager.cc:1403] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.011s
I20260709 12:16:56.563462 20371 raft_consensus.cc:359] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.564163 20371 raft_consensus.cc:385] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.564406 20371 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.564993 20371 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.568315 20077 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.568912 20370 raft_consensus.cc:359] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.569599 20370 raft_consensus.cc:385] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.569862 20370 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.572183 20371 ts_tablet_manager.cc:1434] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:16:56.573226 20371 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.573917 20370 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.579672 20371 tablet_bootstrap.cc:654] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.586699 20486 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.587419 20486 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.590126 20463 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.591578 20486 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.590801 20463 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.594920 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.595556 20253 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:56.596920 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:56.597787 20414 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.598146 20414 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.598515 20414 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.598590 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.600216 20370 ts_tablet_manager.cc:1434] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:16:56.601226 20370 tablet_bootstrap.cc:492] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.603767 20463 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.603921 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.605136 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:56.608678 20220 leader_election.cc:343] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.608541 20414 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.611310 20370 tablet_bootstrap.cc:654] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.611886 20330 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:16:56.614614 20219 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.615921 20486 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.618786 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:56.619609 20414 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.622155 20371 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.622686 20371 ts_tablet_manager.cc:1403] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.008s
I20260709 12:16:56.626219 20371 raft_consensus.cc:359] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.627022 20371 raft_consensus.cc:385] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.627405 20371 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.628412 20371 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:56.637655 20295 leader_election.cc:343] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.638516 20372 tablet_bootstrap.cc:492] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.639009 20372 ts_tablet_manager.cc:1403] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.011s
I20260709 12:16:56.639753 20486 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.640674 20371 ts_tablet_manager.cc:1434] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:16:56.641737 20371 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.641620 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:56.642300 20372 raft_consensus.cc:359] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.643015 20372 raft_consensus.cc:385] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:56.643441 20295 leader_election.cc:343] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.643313 20372 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.648032 20372 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.650290 20372 ts_tablet_manager.cc:1434] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:56.651257 20372 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.653419 20371 tablet_bootstrap.cc:654] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.660761 20414 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.661350 20414 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.662871 20253 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:56.670070 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.673154 20377 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.673653 20377 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:56.674530 20377 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.676330 20414 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.679432 20414 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.679792 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.680073 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.680059 20414 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:56.682094 20294 leader_election.cc:343] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.682986 20371 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.683465 20371 ts_tablet_manager.cc:1403] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.009s
I20260709 12:16:56.688530 20370 tablet_bootstrap.cc:492] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.689109 20370 ts_tablet_manager.cc:1403] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.030s
I20260709 12:16:56.694186 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.695149 20179 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:16:56.699340 20433 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:56.700129 20295 leader_election.cc:343] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.700647 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.685532 20414 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.707190 20371 raft_consensus.cc:359] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.708160 20371 raft_consensus.cc:385] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.708438 20371 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.706012 20370 raft_consensus.cc:359] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.709236 20370 raft_consensus.cc:385] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.709537 20370 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.710229 20371 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.703270 20414 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.712812 20370 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.715186 20370 ts_tablet_manager.cc:1434] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:16:56.715682 20371 ts_tablet_manager.cc:1434] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:16:56.716809 20371 tablet_bootstrap.cc:492] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.700784 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.720975 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.721362 20372 tablet_bootstrap.cc:654] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.723249 20377 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.724195 20371 tablet_bootstrap.cc:654] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.726795 20370 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.733412 20370 tablet_bootstrap.cc:654] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.732266 20077 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.744577 20377 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.738087 20372 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.750193 20372 ts_tablet_manager.cc:1403] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.007s
I20260709 12:16:56.757099 20495 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.759552 20501 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.760059 20501 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.762081 20501 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.759517 20370 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.764464 20370 ts_tablet_manager.cc:1403] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 12:16:56.764937 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.765775 20328 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:16:56.765585 20372 raft_consensus.cc:359] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.766301 20372 raft_consensus.cc:385] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.767354 20372 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.766769 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.769120 20372 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.769615 20144 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:56.770701 20407 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.770447 20370 raft_consensus.cc:359] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.771102 20370 raft_consensus.cc:385] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.771381 20370 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.772064 20370 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.775139 20371 tablet_bootstrap.cc:492] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.775661 20371 ts_tablet_manager.cc:1403] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.000s
I20260709 12:16:56.778508 20371 raft_consensus.cc:359] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.779192 20371 raft_consensus.cc:385] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.779428 20372 ts_tablet_manager.cc:1434] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:16:56.780982 20370 ts_tablet_manager.cc:1434] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:16:56.781945 20370 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.787415 20371 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.788295 20371 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.779368 20407 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.790884 20371 ts_tablet_manager.cc:1434] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:56.791937 20371 tablet_bootstrap.cc:492] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.797984 20371 tablet_bootstrap.cc:654] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.798650 20433 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.801019 20372 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.801613 20370 tablet_bootstrap.cc:654] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.812561 20372 tablet_bootstrap.cc:654] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.820192 20370 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:56.820745 20370 ts_tablet_manager.cc:1403] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.004s
I20260709 12:16:56.820502 20433 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.823194 20370 raft_consensus.cc:359] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.823891 20370 raft_consensus.cc:385] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.824198 20370 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.824926 20370 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.826273 20433 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.826463 20371 tablet_bootstrap.cc:492] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:56.827078 20371 ts_tablet_manager.cc:1403] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.005s
I20260709 12:16:56.827035 20370 ts_tablet_manager.cc:1434] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:56.826774 20433 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.829309 20433 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.830225 20371 raft_consensus.cc:359] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.831005 20371 raft_consensus.cc:385] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.831409 20371 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.831786 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.830255 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.833788 20180 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:56.835374 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:56.835614 20433 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.836730 20541 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.836298 20433 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.837139 20541 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.837560 20541 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.838919 20433 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.840476 20372 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.840647 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.840953 20372 ts_tablet_manager.cc:1403] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
W20260709 12:16:56.842152 20220 leader_election.cc:343] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.843849 20372 raft_consensus.cc:359] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.844449 20372 raft_consensus.cc:385] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:56.844480 20219 leader_election.cc:343] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.844816 20372 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.845471 20372 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.847270 20372 ts_tablet_manager.cc:1434] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:56.848223 20372 tablet_bootstrap.cc:492] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.848412 20407 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.848894 20407 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.849329 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.850958 20407 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.853781 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.854579 20253 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:16:56.856237 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.857766 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:56.858539 20541 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.859421 20407 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.832597 20371 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.861116 20541 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.861545 20371 ts_tablet_manager.cc:1434] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:16:56.861826 20372 tablet_bootstrap.cc:654] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.862676 20371 tablet_bootstrap.cc:492] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:56.863430 20370 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:56.868973 20371 tablet_bootstrap.cc:654] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:56.854902 20219 leader_election.cc:343] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.873766 20407 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.876942 20486 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:56.881513 20486 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.881873 20501 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.882297 20486 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.883725 20409 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.884390 20409 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.887104 20409 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.882485 20501 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.890792 20501 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.892594 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:56.893254 20180 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.895042 20370 tablet_bootstrap.cc:654] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.886538 20486 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.895687 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.901300 20180 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:56.901787 20377 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.902266 20377 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.904633 20377 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.906491 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.906701 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.915951 20180 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:56.916607 20253 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:56.909850 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:56.917660 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:56.911747 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.918710 20377 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.919076 20377 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.919453 20377 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.920176 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:56.921411 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 66545.5us
I20260709 12:16:56.923748 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:56.926666 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:56.928218 20219 leader_election.cc:343] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:56.928890 20219 leader_election.cc:343] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.931556 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:56.932231 20256 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:56.933296 20486 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.934291 20372 tablet_bootstrap.cc:492] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:56.934825 20372 ts_tablet_manager.cc:1403] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.043s
I20260709 12:16:56.934895 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:56.937716 20372 raft_consensus.cc:359] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.938457 20372 raft_consensus.cc:385] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.938380 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:16:56.938845 20372 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.939349 20433 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.939855 20433 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:56.939647 20372 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.941125 20433 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.942631 20372 ts_tablet_manager.cc:1434] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
W20260709 12:16:56.943979 20220 leader_election.cc:343] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.944465 20220 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:56.944712 20372 tablet_bootstrap.cc:492] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:56.945531 20493 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.939118 20377 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.949276 20414 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.951435 20326 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:16:56.951970 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:56.952267 20377 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.952613 20180 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.953528 20372 tablet_bootstrap.cc:654] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.956125 20501 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.956666 20501 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.959302 20501 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.966158 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:56.967125 20253 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.969727 20180 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:56.976922 20377 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.977010 20541 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.985020 20377 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.985270 20541 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:56.985867 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:56.987149 20414 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.987512 20377 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:56.981705 20078 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.988766 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:56.990818 20295 leader_election.cc:343] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.987725 20414 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:56.995092 20414 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.011710 20407 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.012014 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.015767 20407 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.017897 20407 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:56.978217 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:16:57.019193 20294 leader_election.cc:343] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.019402 20433 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.019878 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.019971 20433 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.021086 20463 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.021770 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:16:57.022132 20433 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.022360 20541 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.024395 20409 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.030115 20409 raft_consensus.cc:2764] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:57.026409 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:57.033043 20219 leader_election.cc:343] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.027805 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.033923 20330 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:57.034438 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.035035 20255 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.038061 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.038645 20255 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.038992 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.039850 20330 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.040186 20075 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.025688 20253 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:57.033335 20372 tablet_bootstrap.cc:492] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:57.056334 20372 ts_tablet_manager.cc:1403] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.039s
I20260709 12:16:57.054898 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.058735 20326 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.059170 20372 raft_consensus.cc:359] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.059491 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.060019 20372 raft_consensus.cc:385] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.060300 20372 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.061223 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.060983 20372 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.029049 20370 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.065876 20370 ts_tablet_manager.cc:1403] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.203s	user 0.010s	sys 0.003s
I20260709 12:16:57.066370 20372 ts_tablet_manager.cc:1434] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:16:57.067636 20372 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
W20260709 12:16:57.068166 20220 leader_election.cc:343] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.068660 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.068873 20370 raft_consensus.cc:359] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.067188 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:57.026150 20414 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.070863 20370 raft_consensus.cc:385] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.071975 20370 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.071195 20371 tablet_bootstrap.cc:492] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:57.072777 20371 ts_tablet_manager.cc:1403] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.210s	user 0.054s	sys 0.079s
I20260709 12:16:57.072881 20370 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.074306 20541 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.076882 20370 ts_tablet_manager.cc:1434] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:57.077572 20370 tablet_bootstrap.cc:492] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.079228 20433 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:57.079437 20220 leader_election.cc:343] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.080128 20541 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.080624 20377 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.081081 20377 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.080526 20541 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.083509 20371 raft_consensus.cc:359] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.084223 20371 raft_consensus.cc:385] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.084498 20371 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.085337 20377 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:57.085152 20371 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.087705 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.090287 20371 ts_tablet_manager.cc:1434] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.006s
W20260709 12:16:57.090503 20295 leader_election.cc:343] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.091141 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.091933 20253 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:57.091902 20371 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:57.070729 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.097783 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.098260 20372 tablet_bootstrap.cc:654] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.098925 20377 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.099252 20407 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.099337 20377 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.099759 20407 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.099867 20377 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.100145 20407 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.126713 20414 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.106217 20409 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.129043 20409 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.151810 20414 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.162210 20463 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.173687 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.174775 20501 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.175173 20501 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.175503 20501 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.232139 20476 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.162758 20463 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.262159 20370 tablet_bootstrap.cc:700] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Time spent opening tablet: real 0.134s	user 0.007s	sys 0.014s
I20260709 12:16:57.263083 20370 tablet_bootstrap.cc:654] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.259797 20409 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.278275 20371 tablet_bootstrap.cc:654] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:57.273388 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 97650.2us
I20260709 12:16:57.277236 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.258121 20414 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:57.308229 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 77266.5us
I20260709 12:16:57.311208 20463 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:16:57.312350 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49082.3us
I20260709 12:16:57.346804 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.356535 20541 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.358669 20501 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.361703 20501 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.361449 20377 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.365159 20414 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:57.365923 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.366739 20253 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:16:57.366793 20370 tablet_bootstrap.cc:492] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.367411 20370 ts_tablet_manager.cc:1403] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.290s	user 0.025s	sys 0.027s
I20260709 12:16:57.370693 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.375761 20372 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:57.384461 20180 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.375095 20407 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:57.414084 20295 leader_election.cc:343] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:57.449532 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59083.6us
I20260709 12:16:57.396544 20377 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:57.448179 20372 ts_tablet_manager.cc:1403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.381s	user 0.027s	sys 0.021s
I20260709 12:16:57.450699 20407 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.460958 20370 raft_consensus.cc:359] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.461797 20370 raft_consensus.cc:385] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.462105 20370 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.462683 20371 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:57.463162 20371 ts_tablet_manager.cc:1403] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.372s	user 0.024s	sys 0.034s
W20260709 12:16:57.446704 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:57.467031 20371 raft_consensus.cc:359] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.467775 20371 raft_consensus.cc:385] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.468034 20371 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.472323 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.472952 20371 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.474011 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:57.474581 20253 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.476354 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:57.476958 20177 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.477511 20371 ts_tablet_manager.cc:1434] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:16:57.478796 20371 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:57.491470 20370 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.492008 20541 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:57.492502 20294 leader_election.cc:343] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.493095 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.493356 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:57.493988 20255 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:57.494299 20294 leader_election.cc:343] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.499598 20377 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.499760 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.500458 20326 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.502431 20372 raft_consensus.cc:359] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.503353 20372 raft_consensus.cc:385] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.509699 20177 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:57.510655 20255 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:57.512651 20370 ts_tablet_manager.cc:1434] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.145s	user 0.005s	sys 0.018s
I20260709 12:16:57.513693 20370 tablet_bootstrap.cc:492] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.503732 20372 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.520006 20372 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.523418 20372 ts_tablet_manager.cc:1434] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 12:16:57.524369 20372 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:57.520944 20407 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.532227 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.532862 20328 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.535950 20407 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.536891 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:57.537505 20255 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.538599 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:57.519726 20253 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:57.539268 20407 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.551285 20371 tablet_bootstrap.cc:654] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.551895 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:57.560709 20377 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.561769 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.562058 20377 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:57.562434 20330 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.563000 20377 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.564246 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.564803 20329 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.566051 20328 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
W20260709 12:16:57.569291 20295 leader_election.cc:343] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.569795 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.575174 20476 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.581223 20329 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:57.583212 20255 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:57.583526 20370 tablet_bootstrap.cc:654] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.588867 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.589602 20372 tablet_bootstrap.cc:654] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.587420 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.591077 20253 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.594789 20463 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.602802 20463 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.585992 20330 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:57.603293 20463 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.605497 20463 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:16:57.610725 20295 leader_election.cc:343] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.611227 20541 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.611752 20541 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.613894 20541 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:57.615414 20219 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:57.616689 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:57.618378 20495 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.618846 20495 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:57.620342 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.621359 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.622025 20330 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:57.622170 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.623001 20486 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.625084 20377 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.625515 20501 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.627036 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.627921 20407 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.628090 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.628676 20407 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:57.628986 20409 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.629076 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:16:57.629606 20409 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.629604 20407 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.630321 20409 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.630895 20564 raft_consensus.cc:2764] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:57.632186 20370 tablet_bootstrap.cc:492] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.632676 20370 ts_tablet_manager.cc:1403] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.018s
I20260709 12:16:57.622641 20495 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.637463 20501 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:57.638428 20501 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.644933 20370 raft_consensus.cc:359] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.645474 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:57.646339 20493 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.646713 20493 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.647075 20493 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.645725 20370 raft_consensus.cc:385] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.648564 20370 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.653991 20371 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:57.654525 20371 ts_tablet_manager.cc:1403] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.176s	user 0.010s	sys 0.003s
I20260709 12:16:57.649494 20370 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.662309 20371 raft_consensus.cc:359] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.663008 20371 raft_consensus.cc:385] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.663141 20370 ts_tablet_manager.cc:1434] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.007s
I20260709 12:16:57.663280 20371 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.664315 20370 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.664031 20371 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.666203 20371 ts_tablet_manager.cc:1434] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
W20260709 12:16:57.666855 20295 leader_election.cc:343] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.667186 20371 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:57.665871 20409 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:57.662062 20144 leader_election.cc:343] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.687408 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.694500 20372 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:57.695066 20372 ts_tablet_manager.cc:1403] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.171s	user 0.025s	sys 0.017s
I20260709 12:16:57.689448 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.698953 20078 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:57.709131 20294 leader_election.cc:343] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.716799 20409 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.711097 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.719367 20463 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.727679 20501 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.727603 20493 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.728259 20501 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.736223 20371 tablet_bootstrap.cc:654] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.736651 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.738493 20253 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:16:57.738693 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.739327 20330 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.731532 20493 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.739755 20144 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.739969 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:57.745437 20560 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.745839 20560 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.746160 20560 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.756768 20501 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.758904 20370 tablet_bootstrap.cc:654] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.760913 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:57.747833 20254 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.767724 20372 raft_consensus.cc:359] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.768478 20372 raft_consensus.cc:385] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.768682 20372 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.769198 20372 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.777128 20372 ts_tablet_manager.cc:1434] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.082s	user 0.003s	sys 0.004s
I20260709 12:16:57.778165 20372 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
W20260709 12:16:57.779034 20220 leader_election.cc:343] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:57.780143 20220 leader_election.cc:343] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.780050 20075 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.785066 20330 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:57.788843 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.791092 20541 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.792171 20541 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:57.793020 20541 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.794548 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.774925 20560 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.799734 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.802131 20330 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.804345 20254 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:57.810495 20560 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:57.804230 20144 leader_election.cc:343] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.814492 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:57.815487 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:57.815590 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.816121 20255 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.815330 20076 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:57.816941 20144 leader_election.cc:343] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.817323 20076 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.819077 20560 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.820027 20560 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:57.823076 20370 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.823603 20370 ts_tablet_manager.cc:1403] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.160s	user 0.006s	sys 0.013s
I20260709 12:16:57.824668 20372 tablet_bootstrap.cc:654] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.821334 20560 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.833741 20371 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:57.834318 20371 ts_tablet_manager.cc:1403] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.167s	user 0.005s	sys 0.010s
I20260709 12:16:57.826905 20370 raft_consensus.cc:359] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.831657 20255 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:57.835299 20370 raft_consensus.cc:385] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.836529 20370 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.837337 20370 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.838999 20144 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:16:57.840159 20407 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.840634 20407 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:16:57.840363 20371 raft_consensus.cc:359] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.841483 20371 raft_consensus.cc:385] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.841727 20371 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.842314 20371 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.843868 20407 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.845163 20370 ts_tablet_manager.cc:1434] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 12:16:57.845752 20330 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:16:57.846170 20370 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.848915 20371 ts_tablet_manager.cc:1434] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:16:57.851361 20371 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:57.866233 20078 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.885355 20372 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:57.885907 20372 ts_tablet_manager.cc:1403] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.001s
I20260709 12:16:57.889740 20371 tablet_bootstrap.cc:654] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.889837 20372 raft_consensus.cc:359] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.890590 20372 raft_consensus.cc:385] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.890961 20372 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.891646 20372 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.892810 20370 tablet_bootstrap.cc:654] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.894707 20372 ts_tablet_manager.cc:1434] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:16:57.895750 20372 tablet_bootstrap.cc:492] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:57.903582 20372 tablet_bootstrap.cc:654] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.903970 20370 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.904518 20370 ts_tablet_manager.cc:1403] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.010s
I20260709 12:16:57.907938 20370 raft_consensus.cc:359] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.908849 20370 raft_consensus.cc:385] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.909200 20370 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.910140 20370 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.912755 20370 ts_tablet_manager.cc:1434] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:57.914083 20370 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.912232 20076 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.922770 20541 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.923395 20541 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.923895 20370 tablet_bootstrap.cc:654] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.925465 20414 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.926213 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.926105 20414 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.926883 20541 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.927122 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:57.927795 20330 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
W20260709 12:16:57.928013 20220 leader_election.cc:343] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.930783 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:57.932129 20414 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:57.932557 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:57.933410 20255 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:57.934686 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:57.935290 20372 tablet_bootstrap.cc:492] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:57.935513 20414 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.935853 20372 ts_tablet_manager.cc:1403] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.014s
I20260709 12:16:57.935901 20414 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.936461 20414 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.930861 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:57.939803 20372 raft_consensus.cc:359] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:57.940104 20295 leader_election.cc:343] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.940475 20541 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.940882 20541 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.941254 20541 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.945406 20370 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.945892 20370 ts_tablet_manager.cc:1403] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.015s
I20260709 12:16:57.946063 20414 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.948513 20541 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.940470 20372 raft_consensus.cc:385] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.954188 20372 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.954356 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:57.949052 20370 raft_consensus.cc:359] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.954941 20370 raft_consensus.cc:385] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.955245 20370 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
W20260709 12:16:57.955677 20220 leader_election.cc:343] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.956033 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:57.955951 20370 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.956439 20541 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:57.954910 20372 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.958326 20370 ts_tablet_manager.cc:1434] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:16:57.959374 20372 ts_tablet_manager.cc:1434] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:16:57.960330 20372 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:57.961073 20370 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.961428 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:57.962195 20330 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:57.964556 20295 leader_election.cc:343] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.966614 20372 tablet_bootstrap.cc:654] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.967825 20370 tablet_bootstrap.cc:654] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.973892 20370 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:57.978534 20370 ts_tablet_manager.cc:1403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.005s
I20260709 12:16:57.979363 20372 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:57.979866 20372 ts_tablet_manager.cc:1403] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.013s
I20260709 12:16:57.981611 20463 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.981592 20370 raft_consensus.cc:359] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.982368 20370 raft_consensus.cc:385] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.982640 20370 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.983294 20370 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.984319 20372 raft_consensus.cc:359] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.985430 20370 ts_tablet_manager.cc:1434] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:57.985502 20372 raft_consensus.cc:385] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.985841 20372 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.986526 20370 tablet_bootstrap.cc:492] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:57.986492 20372 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:57.989100 20372 ts_tablet_manager.cc:1434] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:57.990059 20372 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:57.993310 20370 tablet_bootstrap.cc:654] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.922842 20076 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.996222 20372 tablet_bootstrap.cc:654] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.005798 20414 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:58.006099 20370 tablet_bootstrap.cc:492] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:58.005893 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:58.010424 20254 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.010473 20370 ts_tablet_manager.cc:1403] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:16:58.014521 20370 raft_consensus.cc:359] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.015416 20370 raft_consensus.cc:385] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.015792 20370 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.017419 20370 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.017988 20254 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:58.019758 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.020596 20370 ts_tablet_manager.cc:1434] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:16:58.021615 20463 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.021831 20370 tablet_bootstrap.cc:492] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:58.022331 20463 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:58.023506 20463 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.030586 20370 tablet_bootstrap.cc:654] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.036569 20433 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.037070 20433 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.038897 20433 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.042091 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.042582 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.042790 20326 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
W20260709 12:16:58.045800 20220 leader_election.cc:343] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.050711 20295 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:58.051994 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.053129 20486 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.053596 20486 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.054029 20486 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.059682 20433 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.999426 20330 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:58.068444 20486 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.072016 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:16:58.073885 20220 leader_election.cc:343] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.087718 20433 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.108070 20560 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.124693 20371 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:58.125248 20371 ts_tablet_manager.cc:1403] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.276s	user 0.065s	sys 0.123s
I20260709 12:16:58.125674 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.124161 20075 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.128815 20372 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:58.131925 20372 ts_tablet_manager.cc:1403] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.142s	user 0.055s	sys 0.043s
I20260709 12:16:58.134059 20372 raft_consensus.cc:359] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.134588 20372 raft_consensus.cc:385] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.134825 20372 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.135454 20372 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.135885 20495 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.136435 20495 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:58.137749 20372 ts_tablet_manager.cc:1434] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:58.137306 20495 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.138768 20372 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:58.130240 20371 raft_consensus.cc:359] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.139721 20371 raft_consensus.cc:385] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.140025 20371 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.140712 20371 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.148880 20372 tablet_bootstrap.cc:654] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.160017 20370 tablet_bootstrap.cc:492] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:58.160508 20370 ts_tablet_manager.cc:1403] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.008s
I20260709 12:16:58.163496 20501 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.164973 20371 ts_tablet_manager.cc:1434] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:16:58.168431 20560 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.171182 20486 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.175607 20370 raft_consensus.cc:359] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.176256 20370 raft_consensus.cc:385] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.176537 20370 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.177187 20370 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.182822 20371 tablet_bootstrap.cc:492] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:58.185611 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:58.186755 20326 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.189790 20371 tablet_bootstrap.cc:654] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.198215 20370 ts_tablet_manager.cc:1434] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260709 12:16:58.212869 20372 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:58.213442 20372 ts_tablet_manager.cc:1403] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.025s
I20260709 12:16:58.216356 20372 raft_consensus.cc:359] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.217084 20372 raft_consensus.cc:385] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.217362 20372 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.218075 20372 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.220371 20372 ts_tablet_manager.cc:1434] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:58.221376 20372 tablet_bootstrap.cc:492] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:58.227582 20370 tablet_bootstrap.cc:492] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:58.227696 20372 tablet_bootstrap.cc:654] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.232059 20076 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.239362 20372 tablet_bootstrap.cc:492] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:58.239557 20501 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.239995 20372 ts_tablet_manager.cc:1403] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:16:58.243317 20372 raft_consensus.cc:359] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.244005 20372 raft_consensus.cc:385] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.244274 20372 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.245044 20372 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.247635 20372 ts_tablet_manager.cc:1434] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:58.247761 20371 tablet_bootstrap.cc:492] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:58.248277 20371 ts_tablet_manager.cc:1403] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.024s
I20260709 12:16:58.248597 20372 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:58.253640 20433 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.254119 20433 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.257015 20409 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.257844 20409 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.260627 20409 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.261292 20433 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.251344 20371 raft_consensus.cc:359] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.263118 20329 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.263268 20371 raft_consensus.cc:385] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.263688 20371 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.264649 20371 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.263693 20326 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:58.270089 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.271260 20433 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.262012 20372 tablet_bootstrap.cc:654] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.271618 20433 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:58.272245 20433 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.262382 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.277034 20330 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:58.277503 20329 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.282341 20501 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.282846 20501 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.277876 20179 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.278484 20371 ts_tablet_manager.cc:1434] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:16:58.284037 20372 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:58.284556 20372 ts_tablet_manager.cc:1403] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.005s
I20260709 12:16:58.284711 20371 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:58.285408 20501 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.278826 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.287431 20372 raft_consensus.cc:359] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.288166 20372 raft_consensus.cc:385] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.288493 20372 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.289211 20372 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.291635 20372 ts_tablet_manager.cc:1434] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:58.292469 20371 tablet_bootstrap.cc:654] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.292593 20372 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:58.297673 20219 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.298544 20612 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.298893 20612 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.299212 20372 tablet_bootstrap.cc:654] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.299259 20612 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.303253 20493 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.303745 20493 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.306392 20493 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.310612 20501 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.310948 20372 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:58.311622 20372 ts_tablet_manager.cc:1403] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:16:58.312366 20612 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.313561 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:58.314375 20255 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:16:58.314610 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.316250 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.316918 20330 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:58.318338 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:58.318935 20327 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.320966 20370 tablet_bootstrap.cc:654] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.322562 20372 raft_consensus.cc:359] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.323213 20372 raft_consensus.cc:385] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.323473 20372 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.324211 20372 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.324445 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.325547 20493 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.325969 20493 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.326383 20493 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.326915 20372 ts_tablet_manager.cc:1434] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:58.327653 20463 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:16:58.328557 20372 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:58.328233 20463 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.333630 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:58.334682 20493 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.335543 20372 tablet_bootstrap.cc:654] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.336678 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:16:58.338100 20220 leader_election.cc:343] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.338673 20327 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:58.339834 20219 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.339630 20433 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.340703 20495 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.341398 20495 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:58.342247 20495 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.346652 20612 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:58.349926 20144 leader_election.cc:343] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.354461 20611 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.354573 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.354995 20611 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.357401 20611 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.358178 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:58.361891 20414 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.362260 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.362368 20414 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.362881 20327 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:58.364135 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.364614 20414 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:58.365198 20433 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.349175 20560 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:16:58.365517 20433 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.366289 20433 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.366801 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:58.368137 20294 leader_election.cc:343] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.368167 20463 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:58.369536 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:58.370177 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.370746 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:58.371894 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.373441 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:58.377528 20295 leader_election.cc:343] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.378269 20295 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.382107 20433 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.389431 20078 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.409771 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:58.412976 20433 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.379104 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:58.414664 20327 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:58.415807 20144 leader_election.cc:343] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.416180 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:58.396196 20493 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.405371 20463 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.415438 20560 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.432753 20407 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:58.433813 20220 leader_election.cc:343] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.434819 20220 leader_election.cc:343] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.421523 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44044us
I20260709 12:16:58.438064 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.440237 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:58.440901 20330 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.440961 20463 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:58.415155 20409 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:58.457595 20371 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:58.460963 20371 ts_tablet_manager.cc:1403] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.176s	user 0.032s	sys 0.014s
W20260709 12:16:58.461287 20220 leader_election.cc:343] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.472478 20370 tablet_bootstrap.cc:492] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:58.473003 20370 ts_tablet_manager.cc:1403] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.246s	user 0.015s	sys 0.000s
W20260709 12:16:58.483844 20220 leader_election.cc:343] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.487829 20433 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.488360 20433 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.501106 20433 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.515506 20433 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.515909 20330 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:58.516088 20433 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:58.531155 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 115357us
I20260709 12:16:58.531378 20433 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.529798 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.533571 20326 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:58.533625 20370 raft_consensus.cc:359] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.534448 20370 raft_consensus.cc:385] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.534726 20370 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.536582 20371 raft_consensus.cc:359] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.537251 20371 raft_consensus.cc:385] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.537532 20371 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.540921 20327 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:58.535387 20370 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.546022 20371 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.548820 20407 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.550673 20371 ts_tablet_manager.cc:1434] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.088s	user 0.003s	sys 0.002s
I20260709 12:16:58.550423 20493 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.551760 20560 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.554152 20370 ts_tablet_manager.cc:1434] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.008s
I20260709 12:16:58.555104 20370 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:58.555430 20371 tablet_bootstrap.cc:492] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:58.562965 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.563879 20433 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.564378 20433 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:58.565152 20433 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.565722 20078 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.570109 20372 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:58.570771 20372 ts_tablet_manager.cc:1403] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.242s	user 0.054s	sys 0.053s
I20260709 12:16:58.577152 20372 raft_consensus.cc:359] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:58.565841 20629 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.015s
I20260709 12:16:58.581058 20612 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.581589 20612 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.583168 20372 raft_consensus.cc:385] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.548012 20463 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:16:58.585511 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.586804 20371 tablet_bootstrap.cc:654] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.588950 20493 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.589488 20493 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.589987 20493 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.583676 20372 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.592028 20414 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.595685 20612 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.598816 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.599529 20326 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
W20260709 12:16:58.604012 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55791.5us
I20260709 12:16:58.619954 20372 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.647130 20372 ts_tablet_manager.cc:1434] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 12:16:58.648229 20372 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:58.649531 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:58.650890 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.605159 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:58.668992 20495 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.663086 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:58.677551 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 85653.4us
I20260709 12:16:58.681304 20371 tablet_bootstrap.cc:492] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:58.681805 20371 ts_tablet_manager.cc:1403] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.000s
I20260709 12:16:58.683856 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:58.685566 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:58.693027 20370 tablet_bootstrap.cc:654] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:58.677877 20220 leader_election.cc:343] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.686887 20495 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:58.697992 20371 raft_consensus.cc:359] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.698201 20495 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.698820 20371 raft_consensus.cc:385] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.699167 20371 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.711347 20371 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.724068 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:58.725725 20433 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.726096 20433 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.726409 20433 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.732434 20493 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.733222 20371 ts_tablet_manager.cc:1434] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:16:58.734340 20371 tablet_bootstrap.cc:492] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:58.821655 20433 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.823091 20370 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:58.829380 20370 ts_tablet_manager.cc:1403] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.274s	user 0.029s	sys 0.011s
I20260709 12:16:58.734287 20493 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.841868 20433 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:58.862020 20372 tablet_bootstrap.cc:654] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.853075 20370 raft_consensus.cc:359] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.864022 20370 raft_consensus.cc:385] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.864432 20370 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.865288 20370 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:58.847050 20075 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.880165 20370 ts_tablet_manager.cc:1434] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:16:58.881542 20370 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:58.892449 20644 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:58.867394 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 142262us
I20260709 12:16:58.893078 20644 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:58.915669 20636 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 12:16:58.931773 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:58.943198 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:58.943636 20409 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.944206 20176 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.920899 20651 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:58.910980 20219 leader_election.cc:343] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.973776 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63955.1us
I20260709 12:16:58.944208 20409 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:58.981178 20220 leader_election.cc:343] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.990001 20220 leader_election.cc:343] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.994481 20644 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:58.990353 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:16:58.999655 20220 leader_election.cc:343] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:59.000752 20220 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:58.984211 20651 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:16:59.006659 20220 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.000967 20541 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.013141 20176 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:59.024077 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:59.021191 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:16:59.026619 20612 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.027125 20612 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:59.027832 20409 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:59.028014 20612 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.033113 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:59.054898 20370 tablet_bootstrap.cc:654] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.053964 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:59.058871 20372 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:59.059410 20372 ts_tablet_manager.cc:1403] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.411s	user 0.018s	sys 0.012s
I20260709 12:16:59.063119 20372 raft_consensus.cc:359] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.063874 20372 raft_consensus.cc:385] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.064231 20372 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.064486 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:59.065265 20372 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.066932 20372 ts_tablet_manager.cc:1434] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:59.069471 20372 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:59.074416 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:59.076474 20178 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.082039 20371 tablet_bootstrap.cc:654] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.084599 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:16:59.090507 20220 leader_election.cc:343] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:59.101877 20294 leader_election.cc:343] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.125494 20078 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.128420 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:59.130246 20327 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:59.132206 20220 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.118754 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:59.139046 20371 tablet_bootstrap.cc:492] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:59.139730 20371 ts_tablet_manager.cc:1403] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.406s	user 0.054s	sys 0.084s
I20260709 12:16:59.136458 20329 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.140801 20372 tablet_bootstrap.cc:654] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.154420 20651 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:59.212150 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:59.213629 20371 raft_consensus.cc:359] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.223547 20371 raft_consensus.cc:385] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.224155 20371 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.229969 20370 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:59.231192 20370 ts_tablet_manager.cc:1403] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.350s	user 0.015s	sys 0.004s
I20260709 12:16:59.229317 20371 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.236444 20371 ts_tablet_manager.cc:1434] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.096s	user 0.010s	sys 0.003s
I20260709 12:16:59.243211 20371 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:59.249784 20372 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:59.250751 20372 ts_tablet_manager.cc:1403] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.011s
I20260709 12:16:59.245245 20253 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:59.262069 20372 raft_consensus.cc:359] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.266237 20372 raft_consensus.cc:385] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.266618 20372 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.262166 20370 raft_consensus.cc:359] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.267700 20370 raft_consensus.cc:385] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.267607 20372 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.267629 20612 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.268287 20370 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.269451 20370 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.272801 20372 ts_tablet_manager.cc:1434] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:16:59.274852 20644 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.275535 20370 ts_tablet_manager.cc:1434] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:16:59.275477 20644 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.277304 20370 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:59.278795 20329 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:59.283658 20644 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:59.288619 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:59.290221 20644 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.290707 20644 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.291240 20644 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:59.295085 20220 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.296375 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:59.299623 20176 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:16:59.297274 20372 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
W20260709 12:16:59.302603 20220 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.315435 20644 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.308943 20075 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.321125 20493 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.323532 20327 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:59.326478 20370 tablet_bootstrap.cc:654] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.335135 20632 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.337946 20639 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.335798 20632 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.338740 20644 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:59.331820 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:59.341339 20632 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:59.341284 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:16:59.342067 20256 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:59.343163 20294 leader_election.cc:343] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.344305 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:59.344888 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:59.346027 20327 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:16:59.347219 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:16:59.354456 20632 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:59.361306 20295 leader_election.cc:343] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.362289 20295 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:59.364290 20644 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.374253 20493 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.375476 20371 tablet_bootstrap.cc:654] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.380090 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:59.379201 20372 tablet_bootstrap.cc:654] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.371357 20632 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.378134 20256 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:59.385353 20541 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.386528 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:16:59.387707 20644 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.388211 20644 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:16:59.389266 20644 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.392843 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:59.393085 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:59.393620 20178 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.396098 20493 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.396720 20493 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:16:59.397910 20493 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.421394 20541 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:59.428603 20295 leader_election.cc:343] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.429102 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:59.434734 20178 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:16:59.447052 20370 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:59.447753 20370 ts_tablet_manager.cc:1403] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.171s	user 0.021s	sys 0.007s
I20260709 12:16:59.438644 20651 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.473483 20463 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.475143 20463 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.482451 20463 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:59.486773 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:16:59.486892 20370 raft_consensus.cc:359] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.488114 20370 raft_consensus.cc:385] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.488507 20370 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
W20260709 12:16:59.489243 20294 leader_election.cc:343] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.490252 20541 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.492229 20076 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.489950 20370 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.497040 20370 ts_tablet_manager.cc:1434] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 12:16:59.498533 20370 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:59.501214 20612 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.501683 20612 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.515514 20372 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:59.516232 20372 ts_tablet_manager.cc:1403] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.234s	user 0.014s	sys 0.015s
I20260709 12:16:59.522403 20371 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:59.523034 20371 ts_tablet_manager.cc:1403] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.280s	user 0.023s	sys 0.012s
I20260709 12:16:59.532215 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:59.532956 20372 raft_consensus.cc:359] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.533720 20372 raft_consensus.cc:385] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.534013 20372 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.534789 20372 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.541085 20372 ts_tablet_manager.cc:1434] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:16:59.542482 20372 tablet_bootstrap.cc:492] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
W20260709 12:16:59.543087 20295 leader_election.cc:343] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.544138 20295 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:16:59.575963 20667 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:16:59.577438 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:59.593019 20220 leader_election.cc:343] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.592710 20651 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.634287 20612 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:59.643368 20371 raft_consensus.cc:359] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.651530 20371 raft_consensus.cc:385] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.652616 20371 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.659731 20371 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.662873 20370 tablet_bootstrap.cc:654] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:59.627100 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84042.3us
I20260709 12:16:59.678318 20372 tablet_bootstrap.cc:654] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.682958 20371 ts_tablet_manager.cc:1434] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.160s	user 0.026s	sys 0.010s
I20260709 12:16:59.686672 20371 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:59.684813 20075 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.706499 20670 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.707111 20670 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.708263 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:59.708995 20327 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:59.709498 20670 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:59.713788 20371 tablet_bootstrap.cc:654] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.728672 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:16:59.729200 20176 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:59.746621 20220 leader_election.cc:343] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.759428 20370 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:59.760056 20370 ts_tablet_manager.cc:1403] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.262s	user 0.016s	sys 0.000s
I20260709 12:16:59.762948 20370 raft_consensus.cc:359] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.763906 20370 raft_consensus.cc:385] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.764235 20370 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.764905 20370 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.767206 20370 ts_tablet_manager.cc:1434] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:16:59.768427 20370 tablet_bootstrap.cc:492] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:59.779906 20371 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:59.780453 20371 ts_tablet_manager.cc:1403] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.004s
I20260709 12:16:59.781795 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:16:59.782564 20326 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:16:59.783356 20371 raft_consensus.cc:359] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.784077 20371 raft_consensus.cc:385] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.784284 20370 tablet_bootstrap.cc:654] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.784358 20371 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.785236 20371 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.787549 20644 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.793589 20371 ts_tablet_manager.cc:1434] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:16:59.798164 20371 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:59.809361 20371 tablet_bootstrap.cc:654] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.813632 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:59.814426 20493 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.814790 20493 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.815150 20493 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.823360 20372 tablet_bootstrap.cc:492] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:16:59.824095 20372 ts_tablet_manager.cc:1403] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.282s	user 0.028s	sys 0.017s
I20260709 12:16:59.825613 20371 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:16:59.826293 20371 ts_tablet_manager.cc:1403] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.005s
I20260709 12:16:59.829581 20372 raft_consensus.cc:359] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.830935 20372 raft_consensus.cc:385] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.831364 20372 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.832080 20371 raft_consensus.cc:359] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.832806 20371 raft_consensus.cc:385] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.833086 20371 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.833258 20372 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.835716 20371 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.836937 20372 ts_tablet_manager.cc:1434] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:16:59.837970 20371 ts_tablet_manager.cc:1434] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:59.838965 20371 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:16:59.839754 20372 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:16:59.845870 20371 tablet_bootstrap.cc:654] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.858029 20644 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.858827 20644 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.860754 20672 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.863272 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:16:59.864846 20295 leader_election.cc:343] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.866593 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:16:59.868567 20294 leader_election.cc:343] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.869115 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:59.870448 20644 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:16:59.871086 20463 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.878523 20493 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.882123 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:16:59.883021 20675 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.883363 20675 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.883967 20675 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.894974 20414 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.895517 20675 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.918730 20370 tablet_bootstrap.cc:492] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:16:59.918583 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:16:59.918546 20675 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:16:59.930099 20220 leader_election.cc:343] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.931622 20493 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:16:59.932513 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:16:59.933907 20220 leader_election.cc:343] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.934729 20370 ts_tablet_manager.cc:1403] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.167s	user 0.049s	sys 0.067s
W20260709 12:16:59.935482 20220 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.937879 20370 raft_consensus.cc:359] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.938624 20370 raft_consensus.cc:385] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.938892 20370 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.940688 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:59.941291 20327 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.944063 20370 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.944774 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:16:59.945487 20329 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.920761 20372 tablet_bootstrap.cc:654] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.958281 20329 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:16:59.980360 20370 ts_tablet_manager.cc:1434] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:16:59.981530 20370 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:16:59.987710 20671 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.988555 20370 tablet_bootstrap.cc:654] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.999284 20632 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.000814 20632 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:16:59.999994 20327 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:00.003023 20632 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.006110 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.008009 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.024328 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.025086 20252 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:17:00.025781 20677 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.027344 20372 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.027909 20372 ts_tablet_manager.cc:1403] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.189s	user 0.023s	sys 0.013s
I20260709 12:17:00.014168 20671 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.030624 20144 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:00.040927 20372 raft_consensus.cc:359] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.041885 20372 raft_consensus.cc:385] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.037050 20671 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:00.043217 20671 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.031126 20677 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:00.044791 20677 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.045863 20372 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.046928 20372 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.032796 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.051018 20327 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:17:00.036633 20632 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.054000 20632 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.054327 20632 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:00.057595 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:00.060348 20372 ts_tablet_manager.cc:1434] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:17:00.061810 20372 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.062242 20371 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.062929 20371 ts_tablet_manager.cc:1403] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.224s	user 0.032s	sys 0.060s
I20260709 12:17:00.065006 20639 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.065637 20639 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.067713 20639 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.068537 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.071000 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.071820 20371 raft_consensus.cc:359] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.072512 20371 raft_consensus.cc:385] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.072790 20371 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.073405 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:00.074318 20409 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.076076 20372 tablet_bootstrap.cc:654] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.077644 20370 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.079766 20370 ts_tablet_manager.cc:1403] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.025s
I20260709 12:17:00.082605 20370 raft_consensus.cc:359] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.083266 20370 raft_consensus.cc:385] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.083271 20371 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.086778 20371 ts_tablet_manager.cc:1434] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:17:00.083550 20370 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.088537 20370 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.088771 20632 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.090934 20370 ts_tablet_manager.cc:1434] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 12:17:00.091075 20632 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.092054 20370 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.092664 20371 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.094240 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:00.094864 20256 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.103992 20671 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.104136 20644 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.104545 20671 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.104579 20644 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.107847 20371 tablet_bootstrap.cc:654] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.107945 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.121294 20370 tablet_bootstrap.cc:654] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.108832 20644 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:00.124519 20295 leader_election.cc:343] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.125793 20256 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:00.111848 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.115509 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.116575 20671 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.127193 20144 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:00.128575 20220 leader_election.cc:343] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.128715 20639 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.129401 20639 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:17:00.129631 20294 leader_election.cc:343] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.130240 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.130478 20639 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.131770 20414 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.115715 20077 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.133752 20077 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.120458 20372 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.100157 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:00.119539 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.136266 20372 ts_tablet_manager.cc:1403] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.012s
I20260709 12:17:00.137416 20324 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.140314 20372 raft_consensus.cc:359] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.141265 20372 raft_consensus.cc:385] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.141553 20372 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
W20260709 12:17:00.141714 20219 leader_election.cc:343] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.142129 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.142216 20372 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.143733 20673 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.144568 20372 ts_tablet_manager.cc:1434] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:00.146660 20372 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.153976 20372 tablet_bootstrap.cc:654] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.161275 20324 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:00.168160 20644 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.168660 20644 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.171497 20371 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.172003 20371 ts_tablet_manager.cc:1403] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.008s
I20260709 12:17:00.174794 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.175539 20256 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:00.177068 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:00.177910 20414 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.178236 20414 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.178520 20414 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.185143 20370 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.185725 20370 ts_tablet_manager.cc:1403] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.032s
I20260709 12:17:00.185168 20644 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.188217 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.190068 20414 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.193595 20414 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.194773 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:00.195070 20176 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:00.196048 20295 leader_election.cc:343] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.196385 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:00.196978 20252 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.197737 20371 raft_consensus.cc:359] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.198364 20371 raft_consensus.cc:385] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.198788 20371 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.198370 20077 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.199498 20371 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:00.200625 20295 leader_election.cc:343] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.202365 20371 ts_tablet_manager.cc:1434] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:17:00.203249 20371 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.212670 20372 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.213223 20372 ts_tablet_manager.cc:1403] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.027s
I20260709 12:17:00.213258 20252 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:00.215631 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.216897 20651 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.217331 20651 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:00.219338 20651 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.223202 20371 tablet_bootstrap.cc:654] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.232306 20372 raft_consensus.cc:359] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.233510 20372 raft_consensus.cc:385] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.233809 20372 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.232920 20370 raft_consensus.cc:359] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.234732 20370 raft_consensus.cc:385] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.235020 20370 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.235821 20370 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.237460 20370 ts_tablet_manager.cc:1434] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.005s
I20260709 12:17:00.237738 20372 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.240844 20372 ts_tablet_manager.cc:1434] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 12:17:00.241889 20372 tablet_bootstrap.cc:492] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.248113 20372 tablet_bootstrap.cc:654] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.249898 20639 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.250659 20371 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.250447 20639 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.251209 20371 ts_tablet_manager.cc:1403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.006s
I20260709 12:17:00.253897 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.254045 20371 raft_consensus.cc:359] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.254694 20371 raft_consensus.cc:385] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.254743 20639 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.255012 20371 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.255970 20371 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.255996 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.258138 20324 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:00.263303 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:00.264091 20639 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.264293 20371 ts_tablet_manager.cc:1434] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:17:00.265435 20371 tablet_bootstrap.cc:492] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.265803 20370 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.266498 20673 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.266992 20673 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.269348 20673 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.271955 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:00.275151 20219 leader_election.cc:343] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.282701 20372 tablet_bootstrap.cc:492] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.292007 20639 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.287029 20076 catalog_manager.cc:5697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:00.295730 20639 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.296326 20639 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.296742 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.298630 20372 ts_tablet_manager.cc:1403] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.000s
W20260709 12:17:00.298960 20220 leader_election.cc:343] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.299402 20220 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.300792 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.301230 20698 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.302481 20371 tablet_bootstrap.cc:654] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.308658 20639 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.309373 20677 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.309891 20677 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.311545 20372 raft_consensus.cc:359] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.312150 20677 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.312312 20372 raft_consensus.cc:385] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.312644 20372 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
W20260709 12:17:00.312949 20144 leader_election.cc:343] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.314311 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.314481 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.315140 20326 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 0.
I20260709 12:17:00.300827 20370 tablet_bootstrap.cc:654] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.313372 20372 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:00.315819 20220 leader_election.cc:343] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.317199 20651 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.317710 20372 ts_tablet_manager.cc:1434] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:17:00.317615 20651 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.318827 20372 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.319777 20651 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.322854 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.323745 20252 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:00.325389 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:00.334633 20651 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.335937 20651 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.336359 20651 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.340590 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:00.340905 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.341648 20639 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.342108 20639 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.342450 20639 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.341609 20324 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:00.357757 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.359191 20677 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.359680 20677 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.360038 20677 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:00.402269 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 61751.1us
I20260709 12:17:00.403262 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.406342 20372 tablet_bootstrap.cc:654] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:00.409358 20295 leader_election.cc:343] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.414691 20371 tablet_bootstrap.cc:492] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.415258 20371 ts_tablet_manager.cc:1403] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.150s	user 0.017s	sys 0.007s
I20260709 12:17:00.402420 20644 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.425781 20644 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.428784 20370 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.429484 20370 ts_tablet_manager.cc:1403] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.010s
I20260709 12:17:00.431528 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:00.434005 20294 leader_election.cc:343] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.434294 20370 raft_consensus.cc:359] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.434681 20639 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.434890 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.435242 20370 raft_consensus.cc:385] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.436460 20651 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.438853 20677 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:00.437374 20295 leader_election.cc:343] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.438056 20370 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.436813 20639 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.439071 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:00.439908 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.440709 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:00.441455 20324 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.441531 20651 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.443455 20677 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.437924 20644 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.443266 20371 raft_consensus.cc:359] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:00.443958 20144 leader_election.cc:343] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.444278 20371 raft_consensus.cc:385] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.444561 20371 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.445042 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:00.445120 20371 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:00.446285 20220 leader_election.cc:343] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.447247 20371 ts_tablet_manager.cc:1434] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:17:00.449026 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:00.447829 20370 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.449571 20256 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.449456 20324 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:00.451117 20370 ts_tablet_manager.cc:1434] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:17:00.452116 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:00.452397 20370 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.452845 20632 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.453306 20632 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:00.454144 20632 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.456996 20372 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.457494 20372 ts_tablet_manager.cc:1403] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.139s	user 0.023s	sys 0.022s
I20260709 12:17:00.458009 20644 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.462934 20371 tablet_bootstrap.cc:492] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.463312 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:00.464131 20327 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.469408 20372 raft_consensus.cc:359] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.470098 20372 raft_consensus.cc:385] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.470353 20372 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.471012 20372 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.473209 20372 ts_tablet_manager.cc:1434] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:17:00.473067 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:00.474393 20372 tablet_bootstrap.cc:492] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.482955 20371 tablet_bootstrap.cc:654] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.486110 20370 tablet_bootstrap.cc:654] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.482769 20256 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:00.497277 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:00.498243 20677 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.499334 20414 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.500005 20414 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:00.500991 20414 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.496382 20372 tablet_bootstrap.cc:654] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:00.502472 20295 leader_election.cc:343] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.503366 20327 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:00.509507 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.511391 20673 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.512022 20673 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:00.513091 20673 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:00.526024 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 70900us
I20260709 12:17:00.530125 20075 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:00.543277 20372 tablet_bootstrap.cc:492] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.543807 20372 ts_tablet_manager.cc:1403] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.001s
I20260709 12:17:00.546675 20372 raft_consensus.cc:359] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.546344 20076 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.549517 20370 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.549997 20370 ts_tablet_manager.cc:1403] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.008s
I20260709 12:17:00.551517 20371 tablet_bootstrap.cc:492] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.552062 20371 ts_tablet_manager.cc:1403] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.012s
I20260709 12:17:00.552871 20370 raft_consensus.cc:359] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.553610 20370 raft_consensus.cc:385] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.553867 20370 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.555619 20371 raft_consensus.cc:359] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.556972 20371 raft_consensus.cc:385] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.557294 20371 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.558002 20371 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.555769 20632 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.560284 20611 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:00.547478 20372 raft_consensus.cc:385] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.574193 20077 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:00.580302 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:00.581769 20371 ts_tablet_manager.cc:1434] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 12:17:00.582983 20371 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.585111 20673 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.590148 20370 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.568879 20372 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.604768 20371 tablet_bootstrap.cc:654] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.611670 20370 ts_tablet_manager.cc:1434] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
I20260709 12:17:00.591867 20372 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.612381 20632 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.613658 20372 ts_tablet_manager.cc:1434] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:17:00.616504 20370 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.619855 20372 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.639032 20370 tablet_bootstrap.cc:654] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.640008 20414 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.644436 20371 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.645224 20371 ts_tablet_manager.cc:1403] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.000s
I20260709 12:17:00.645447 20409 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.645951 20409 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.648903 20372 tablet_bootstrap.cc:654] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.649616 20409 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.650617 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.650804 20179 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.651823 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.653900 20144 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:00.661652 20176 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.648173 20371 raft_consensus.cc:359] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.662796 20371 raft_consensus.cc:385] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.663153 20371 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.663916 20371 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.665763 20371 ts_tablet_manager.cc:1434] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:17:00.666663 20371 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.668391 20632 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.672254 20414 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.672757 20414 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.673826 20370 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.675297 20414 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.675740 20370 ts_tablet_manager.cc:1403] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.007s
I20260709 12:17:00.676604 20644 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:00.678893 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.684973 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:00.686679 20295 leader_election.cc:343] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.693959 20372 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.694411 20371 tablet_bootstrap.cc:654] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.694437 20372 ts_tablet_manager.cc:1403] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.002s
I20260709 12:17:00.700904 20370 raft_consensus.cc:359] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.701452 20372 raft_consensus.cc:359] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.701674 20370 raft_consensus.cc:385] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.702162 20372 raft_consensus.cc:385] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.702365 20370 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.702479 20372 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.703213 20370 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.703217 20372 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.704293 20256 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:00.705998 20372 ts_tablet_manager.cc:1434] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:00.706506 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.707587 20644 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.707939 20644 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.708276 20644 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.712397 20370 ts_tablet_manager.cc:1434] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:17:00.716519 20371 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.717250 20371 ts_tablet_manager.cc:1403] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:17:00.720136 20371 raft_consensus.cc:359] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.720814 20371 raft_consensus.cc:385] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.721076 20371 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.721776 20371 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.721956 20644 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.724107 20370 tablet_bootstrap.cc:492] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.730698 20370 tablet_bootstrap.cc:654] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.732064 20371 ts_tablet_manager.cc:1434] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:17:00.734823 20371 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.740967 20371 tablet_bootstrap.cc:654] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.741132 20372 tablet_bootstrap.cc:492] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.748322 20370 tablet_bootstrap.cc:492] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.748942 20371 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.748942 20370 ts_tablet_manager.cc:1403] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.002s
I20260709 12:17:00.749782 20371 ts_tablet_manager.cc:1403] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:17:00.751436 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:00.751776 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:00.752156 20179 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.752307 20256 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.752620 20371 raft_consensus.cc:359] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.752794 20370 raft_consensus.cc:359] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.753480 20371 raft_consensus.cc:385] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.753611 20370 raft_consensus.cc:385] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.753793 20371 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.753881 20370 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.754655 20370 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.754655 20371 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.756999 20371 ts_tablet_manager.cc:1434] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:00.758020 20371 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:00.759349 20256 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:00.760468 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:00.761205 20414 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.761646 20414 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:00.762358 20414 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.764719 20370 ts_tablet_manager.cc:1434] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:17:00.765952 20370 tablet_bootstrap.cc:492] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.767530 20179 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:00.773197 20644 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.782058 20372 tablet_bootstrap.cc:654] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.787869 20677 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.788472 20677 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.789170 20076 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:00.790097 20370 tablet_bootstrap.cc:654] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.796267 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:00.801692 20220 leader_election.cc:343] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.804111 20370 tablet_bootstrap.cc:492] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.804699 20370 ts_tablet_manager.cc:1403] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.006s
I20260709 12:17:00.806998 20372 tablet_bootstrap.cc:492] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.807518 20372 ts_tablet_manager.cc:1403] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.009s
I20260709 12:17:00.808239 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.808140 20370 raft_consensus.cc:359] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.808895 20370 raft_consensus.cc:385] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.808986 20327 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:00.809191 20370 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.810001 20370 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.810521 20372 raft_consensus.cc:359] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.823694 20677 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.823937 20372 raft_consensus.cc:385] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.824306 20372 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.815037 20219 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.824918 20370 ts_tablet_manager.cc:1434] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:17:00.825099 20372 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.826097 20370 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.828272 20371 tablet_bootstrap.cc:654] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.831835 20644 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.835311 20644 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.835847 20611 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.813030 20409 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.836397 20372 ts_tablet_manager.cc:1434] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.012s
I20260709 12:17:00.836372 20611 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.837442 20644 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.837630 20372 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:00.834751 20673 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.838120 20673 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.838538 20673 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.837829 20409 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.838769 20611 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.840538 20409 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.841209 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:00.842782 20295 leader_election.cc:343] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.846926 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.847805 20256 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:00.849084 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.850466 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.851679 20370 tablet_bootstrap.cc:654] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.850700 20372 tablet_bootstrap.cc:654] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.851850 20414 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.852247 20414 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.852612 20414 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.855396 20651 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.855926 20651 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.856243 20719 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.856796 20719 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.857981 20651 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.858738 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.858835 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.859095 20719 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.859650 20324 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:00.860277 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.861120 20252 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:00.860432 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.862286 20172 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.863703 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:00.863534 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:00.866274 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:17:00.867408 20295 leader_election.cc:343] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.868026 20644 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.869407 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:00.869745 20671 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.870214 20671 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.870607 20671 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.859325 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:00.893446 20295 leader_election.cc:343] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:00.897043 20220 leader_election.cc:343] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.868536 20644 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.899044 20644 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.903880 20370 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:00.905293 20370 ts_tablet_manager.cc:1403] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.029s
I20260709 12:17:00.906256 20673 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.908140 20370 raft_consensus.cc:359] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.908855 20370 raft_consensus.cc:385] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.909158 20370 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.909813 20176 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.909848 20370 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.912240 20698 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.913148 20370 ts_tablet_manager.cc:1434] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:00.913031 20698 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.915052 20370 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:00.915226 20698 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.916530 20715 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.916996 20715 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.919494 20715 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.922966 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:00.924402 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.927589 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:00.933305 20371 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:00.934762 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:00.963843 20219 leader_election.cc:343] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.939997 20414 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.940505 20644 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.965859 20644 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:00.965835 20414 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:00.942792 20294 leader_election.cc:343] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.946592 20370 tablet_bootstrap.cc:654] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.967187 20371 ts_tablet_manager.cc:1403] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.002s
I20260709 12:17:00.954203 20372 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:00.969851 20372 ts_tablet_manager.cc:1403] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.027s
I20260709 12:17:00.970206 20371 raft_consensus.cc:359] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:00.970924 20371 raft_consensus.cc:385] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.971174 20371 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.954550 20673 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:00.955976 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:01.085482 20371 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.086117 20324 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.086339 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:00.961467 20715 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.957237 20409 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.090267 20414 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.091328 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:01.090171 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:17:01.089653 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 146887us
I20260709 12:17:01.096483 20671 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.097258 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:01.097847 20252 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.095376 20324 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:01.099133 20671 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:01.087801 20372 raft_consensus.cc:359] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.104359 20372 raft_consensus.cc:385] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.104648 20372 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.105244 20370 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:01.105742 20370 ts_tablet_manager.cc:1403] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.005s
I20260709 12:17:01.105502 20372 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.119849 20252 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:01.124351 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:01.126502 20372 ts_tablet_manager.cc:1434] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.156s	user 0.022s	sys 0.025s
I20260709 12:17:01.127604 20372 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:01.127828 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:01.131922 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:01.132450 20371 ts_tablet_manager.cc:1434] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.165s	user 0.007s	sys 0.000s
I20260709 12:17:01.133451 20371 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:01.133970 20372 tablet_bootstrap.cc:654] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.134475 20176 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.139755 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:01.140548 20324 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:01.139891 20744 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.142908 20744 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.147607 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:01.148483 20252 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:01.150324 20744 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:01.151993 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:01.152841 20414 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.153611 20414 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:01.154397 20219 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:01.154639 20414 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.156955 20370 raft_consensus.cc:359] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.157860 20370 raft_consensus.cc:385] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.158213 20370 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.159088 20370 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.162173 20370 ts_tablet_manager.cc:1434] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.006s
I20260709 12:17:01.164958 20748 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.165575 20748 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:01.163450 20370 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:01.167198 20748 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.171825 20651 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:01.176261 20295 leader_election.cc:343] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.176997 20295 leader_election.cc:343] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.177352 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:01.178679 20370 tablet_bootstrap.cc:654] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.181725 20744 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:01.184607 20220 leader_election.cc:343] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.185065 20220 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:01.201457 20370 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:01.202140 20370 ts_tablet_manager.cc:1403] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.006s
I20260709 12:17:01.203325 20698 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:01.204224 20220 leader_election.cc:343] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.205140 20220 leader_election.cc:343] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.207990 20370 raft_consensus.cc:359] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.208729 20370 raft_consensus.cc:385] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.209009 20370 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.212913 20076 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.209764 20370 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.216918 20252 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.216917 20370 ts_tablet_manager.cc:1434] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:17:01.227777 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:01.228427 20253 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:01.229128 20370 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:01.239171 20414 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.242839 20414 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.244750 20414 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:01.242352 20719 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.245987 20370 tablet_bootstrap.cc:654] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.246201 20719 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:01.251820 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74202.3us
I20260709 12:17:01.259292 20172 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.266996 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:01.269326 20671 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.271835 20719 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:01.275590 20677 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.279886 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:01.156086 20371 tablet_bootstrap.cc:654] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.320158 20409 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.322666 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:01.366418 20632 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.369035 20632 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:01.369439 20632 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.379845 20744 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.382418 20744 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:01.387940 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 149189us
I20260709 12:17:01.388931 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:01.394958 20744 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:01.411505 20076 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:01.415791 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60520.6us
I20260709 12:17:01.398630 20644 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.426901 20372 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:01.427471 20372 ts_tablet_manager.cc:1403] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.300s	user 0.051s	sys 0.033s
I20260709 12:17:01.404491 20651 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:17:01.419473 20748 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.437680 20370 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:01.438134 20370 ts_tablet_manager.cc:1403] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.211s	user 0.018s	sys 0.018s
I20260709 12:17:01.441919 20372 raft_consensus.cc:359] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.451401 20372 raft_consensus.cc:385] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.451735 20372 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.452418 20372 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.454800 20372 ts_tablet_manager.cc:1434] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:17:01.455862 20372 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:01.424870 20752 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 12:17:01.459700 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47566.8us
I20260709 12:17:01.463151 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:01.463291 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:01.467330 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:01.434748 20757 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:17:01.472313 20632 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.474347 20632 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:01.435937 20748 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.476764 20748 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:01.478278 20370 raft_consensus.cc:359] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.482542 20370 raft_consensus.cc:385] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.482895 20370 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
W20260709 12:17:01.486510 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74082.7us
W20260709 12:17:01.488320 20295 leader_election.cc:343] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.490285 20370 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.491979 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:01.492642 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:01.493242 20254 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:01.498139 20295 leader_election.cc:343] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.501245 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:17:01.504720 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:01.520651 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:01.530351 20220 leader_election.cc:343] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.531554 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:01.533911 20330 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:01.540613 20144 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:01.549072 20370 ts_tablet_manager.cc:1434] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.111s	user 0.003s	sys 0.006s
I20260709 12:17:01.539803 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:01.568439 20370 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:01.579216 20372 tablet_bootstrap.cc:654] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.580873 20254 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:01.559190 20175 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:01.590477 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59225us
I20260709 12:17:01.596498 20409 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:01.610849 20371 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:01.611493 20371 ts_tablet_manager.cc:1403] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.478s	user 0.015s	sys 0.017s
I20260709 12:17:01.693117 20671 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.759964 20372 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:01.760793 20372 ts_tablet_manager.cc:1403] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.305s	user 0.011s	sys 0.015s
W20260709 12:17:01.773362 20294 leader_election.cc:343] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.774113 20294 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:01.712075 20671 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.763320 20251 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:17:01.725467 20770 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 12:17:01.777357 20775 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.796397 20774 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.796490 20371 raft_consensus.cc:359] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.797513 20371 raft_consensus.cc:385] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.797812 20371 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
W20260709 12:17:01.800778 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 238348us
I20260709 12:17:01.802314 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:01.801106 20371 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:01.862102 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 158233us
W20260709 12:17:01.856140 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53922.8us
I20260709 12:17:01.839648 20698 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.868422 20698 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.868970 20698 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:01.872956 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74371.5us
I20260709 12:17:01.874209 20371 ts_tablet_manager.cc:1434] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.262s	user 0.013s	sys 0.020s
I20260709 12:17:01.800037 20775 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:01.875401 20778 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:01.996619 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 131630us
W20260709 12:17:01.997368 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 122989us
W20260709 12:17:02.116446 20780 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:17:02.334656 20779 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.365424 20779 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.368279 20779 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:02.337903 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 328492us
I20260709 12:17:02.345599 20671 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.349236 20409 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:02.018433 20778 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:17:02.352397 20776 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.514s	user 0.000s	sys 0.009s
I20260709 12:17:02.360922 20370 tablet_bootstrap.cc:700] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent opening tablet: real 0.208s	user 0.004s	sys 0.004s
I20260709 12:17:02.355525 20372 raft_consensus.cc:359] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.379907 20372 raft_consensus.cc:385] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.380275 20372 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.337663 20775 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.373908 20409 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.383203 20370 tablet_bootstrap.cc:654] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.383773 20372 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.388847 20372 ts_tablet_manager.cc:1434] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.628s	user 0.013s	sys 0.004s
I20260709 12:17:02.380117 20651 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.405153 20409 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:02.389281 20372 ts_tablet_manager.cc:1467] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Tablet startup took 628ms
I20260709 12:17:02.387435 20775 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:02.422293 20651 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.427386 20775 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:02.407397 20372 ts_tablet_manager.cc:1469] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Trace:
0709 12:16:53.919102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.078819 (+159717us) service_pool.cc:224] Handling call
0709 12:16:54.175494 (+ 96675us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800150698. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd41a2 00007f5de0d15889 00007f5ddfe46d88 00007f5ddff09b80 00007f5ddfeb8400 00007f5dd933daf4 00007f5dd933da82 00007f5dd933d9b1 00007f5dd933d92c
0709 12:16:54.175594 (+   100us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:16:54.175695 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:16:54.369559 (+193864us) tablet_metadata.cc:665] Metadata flushed
0709 12:16:54.476432 (+106873us) tablet_replica.cc:206] Creating consensus instance
0709 12:16:54.476917 (+   485us) inbound_call.cc:177] Queueing success response
0709 12:17:01.455462 (+6978545us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:17:01.761165 (+305703us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:17:02.352822 (+591657us) tablet_replica.cc:261] Starting instrumentation
0709 12:17:02.353603 (+   781us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":25551,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":2329344,"tablet-open.queue_time_us":6978606}
I20260709 12:17:02.447693 20764 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.069s
I20260709 12:17:02.447690 20372 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:02.447742 20787 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.077s
W20260709 12:17:02.444224 20698 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.002s
I20260709 12:17:02.481103 20795 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.481892 20795 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.482697 20370 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:02.483254 20370 ts_tablet_manager.cc:1403] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.915s	user 0.015s	sys 0.014s
I20260709 12:17:02.491523 20414 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.492257 20414 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.464332 20698 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.497579 20414 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:02.501425 20370 raft_consensus.cc:359] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.502427 20370 raft_consensus.cc:385] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.502772 20370 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.503849 20370 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.505564 20795 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:02.514628 20370 ts_tablet_manager.cc:1434] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 12:17:02.516438 20775 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.516638 20371 tablet_bootstrap.cc:492] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:02.520073 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:02.513542 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:02.529512 20372 tablet_bootstrap.cc:654] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.512058 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:02.522703 20778 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.546952 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:02.556110 20330 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:02.561092 20793 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.561694 20793 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.563364 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:02.566773 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:02.569849 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:02.577557 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:02.562594 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:02.560122 20256 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:02.572976 20778 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.565447 20248 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:02.580687 20800 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:02.575095 20328 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:02.574736 20795 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:02.591871 20769 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.825s	user 0.046s	sys 0.043s
I20260709 12:17:02.595281 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:02.588846 20795 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.596055 20325 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.597361 20795 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.599788 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 221) took 1085 ms. Trace:
I20260709 12:17:02.600826 20371 tablet_bootstrap.cc:654] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.602128 20793 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.604151 20179 rpcz_store.cc:276] 0709 12:17:01.514762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.514871 (+   109us) service_pool.cc:224] Handling call
0709 12:17:01.521947 (+  7076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.522292 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.522320 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.522774 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.596224 (+ 73450us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:17:01.596282 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.597012 (+   730us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.560221 (+963209us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:17:02.599475 (+ 39254us) raft_consensus.cc:1685] finished
0709 12:17:02.599495 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.599697 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7234,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3178,"spinlock_wait_cycles":10461440,"thread_start_us":72964,"threads_started":1,"wal-append.queue_time_us":185615}
I20260709 12:17:02.612346 20219 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:02.614327 20370 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:02.615756 20800 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:02.616154 20800 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.616484 20800 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:02.617395 20219 leader_election.cc:343] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.618201 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:02.617163 20651 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:02.640610 20632 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:02.647665 20325 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:02.650347 20719 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:02.649082 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:02.652477 20677 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:02.653064 20078 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 100) took 1020 ms. Trace:
I20260709 12:17:02.653199 20677 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:02.653478 20078 rpcz_store.cc:276] 0709 12:17:01.639035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.639854 (+   819us) service_pool.cc:224] Handling call
0709 12:17:02.652766 (+1012912us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:17:02.654357 20677 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.657572 20372 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:02.658061 20372 ts_tablet_manager.cc:1403] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.211s	user 0.030s	sys 0.006s
I20260709 12:17:02.658249 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:02.659162 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 173) took 1067 ms. Trace:
I20260709 12:17:02.659484 20255 rpcz_store.cc:276] 0709 12:17:01.591981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.592381 (+   400us) service_pool.cc:224] Handling call
0709 12:17:02.657968 (+1065587us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:17:02.659066 (+  1098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9632128}
I20260709 12:17:02.651069 20719 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.644649 20785 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:02.661669 20785 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.662015 20785 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.661049 20372 raft_consensus.cc:359] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.662901 20372 raft_consensus.cc:385] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.663185 20372 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.643859 20632 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.663879 20372 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.663990 20719 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:02.667973 20370 tablet_bootstrap.cc:654] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.669747 20719 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:02.670997 20372 ts_tablet_manager.cc:1434] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:17:02.671692 20371 tablet_bootstrap.cc:492] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:02.672322 20371 ts_tablet_manager.cc:1403] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.156s	user 0.018s	sys 0.000s
I20260709 12:17:02.670240 20719 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.675242 20372 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:02.681170 20178 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.693396 20719 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:02.716413 20632 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.717325 20632 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:02.718014 20632 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.726766 20371 raft_consensus.cc:359] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.728662 20371 raft_consensus.cc:385] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.730252 20371 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.733745 20372 tablet_bootstrap.cc:654] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.734790 20371 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.729946 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:02.737582 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:02.790334 20371 ts_tablet_manager.cc:1434] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.000s
I20260709 12:17:02.842077 20765 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.836267 20779 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.862962 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:02.864233 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:02.865039 20414 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:02.865388 20414 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.865751 20414 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.866098 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:02.842764 20719 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:02.841048 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:02.872579 20784 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:02.872615 20777 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.872803 20810 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:02.873160 20784 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.873540 20784 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.873432 20810 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.856242 20801 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:17:02.878010 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:02.867244 20779 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.880760 20698 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.877497 20719 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.909246 20801 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.871737 20765 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.995388 20810 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.004645 20813 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.004964 20810 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:02.881266 20777 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.087s
I20260709 12:17:03.005297 20813 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.923060 20639 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.014112 20370 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:02.969537 20414 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.015661 20370 ts_tablet_manager.cc:1403] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.402s	user 0.030s	sys 0.024s
I20260709 12:17:03.005502 20810 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.994794 20651 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.939852 20632 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.932600 20797 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.974642 20764 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.978060 20644 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.934326 20779 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:02.978915 20775 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.933615 20781 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.030807 20414 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.013265 20778 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:02.936064 20795 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:02.935177 20800 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.059463 20372 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:03.060214 20372 ts_tablet_manager.cc:1403] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.385s	user 0.019s	sys 0.010s
I20260709 12:17:03.017832 20639 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.002730 20785 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.040586 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.033392 20644 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:03.032433 20651 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.030733 20808 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.063295 20765 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.088873 20409 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:03.042421 20632 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.089425 20409 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.042481 20778 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.059970 20751 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.042783 20775 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.106860 20800 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.081980 20810 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.109342 20370 raft_consensus.cc:359] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.110335 20370 raft_consensus.cc:385] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.110695 20370 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.105649 20765 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.112201 20639 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.111974 20765 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.113684 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 238) took 1095 ms. Trace:
I20260709 12:17:03.114085 20372 raft_consensus.cc:359] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.114794 20372 raft_consensus.cc:385] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.115091 20372 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.081512 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.096133 20175 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:03.108155 20677 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.033327 20764 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.151537 20785 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.098734 20808 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.114472 20751 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.164321 20372 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.190858 20370 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.191816 20795 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.154132 20800 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.194747 20751 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.195976 20808 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.064282 20797 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.198278 20372 ts_tablet_manager.cc:1434] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.001s
I20260709 12:17:03.199438 20372 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: Bootstrap starting.
I20260709 12:17:03.103103 20632 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.190496 20677 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.156333 20747 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.199173 20801 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.092358 20781 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.217864 20810 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.218282 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.239815 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:03.227010 20765 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.239867 20790 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.231889 20795 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.233256 20751 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.210868 20800 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:03.114104 20327 rpcz_store.cc:276] 0709 12:17:02.018058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.018992 (+   934us) service_pool.cc:224] Handling call
0709 12:17:03.112838 (+1093846us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5800150698. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:17:03.113100 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.113309 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:03.113336 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:03.113379 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:03.113415 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.113474 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:03.113590 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44208512}
I20260709 12:17:03.252017 20254 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:03.279045 20797 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.275044 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.279996 20800 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:03.280143 20255 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:03.280411 20677 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.249212 20639 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.233848 20747 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.248935 20775 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.246850 20808 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:03.251065 20651 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.294265 20822 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.293296 20793 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.249531 20810 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.285851 20817 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.275198 20795 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.251777 20790 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.295578 20370 ts_tablet_manager.cc:1434] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.280s	user 0.018s	sys 0.027s
I20260709 12:17:03.294835 20822 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.295706 20808 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.312071 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.289480 20632 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.341881 20764 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.293471 20644 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:03.311753 20771 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.342896 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:03.338951 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.337515 20796 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.337205 20802 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.331493 20778 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.299983 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.290755 20751 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.355394 20370 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:03.343847 20632 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:03.357791 20371 tablet_bootstrap.cc:492] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:03.337338 20814 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.293040 20639 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.295194 20793 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.360142 20814 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.343241 20771 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.359275 20778 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.381619 20750 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:03.382723 20808 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.382316 20750 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.363339 20632 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.360592 20796 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.370982 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.367913 20802 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.384575 20778 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.409301 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.438648 20802 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.439177 20639 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.439246 20802 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.439935 20802 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.440902 20828 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.459180 20747 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.460222 20632 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.416208 20795 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.346966 20817 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.466074 20372 tablet_bootstrap.cc:654] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.434682 20781 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.423132 20823 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.434505 20822 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:03.463240 20784 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.001s
I20260709 12:17:03.441426 20828 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.468099 20795 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.467465 20747 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.470337 20764 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.479592 20414 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.487833 20414 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.480299 20751 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.481225 20757 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.481462 20778 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.481604 20765 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.481829 20719 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.479548 20787 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.496794 20817 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.483132 20796 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.481840 20771 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.483726 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.483774 20747 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.489377 20764 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.490430 20750 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.499330 20414 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:03.504009 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:03.497221 20787 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.475255 20823 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.491400 20793 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.479621 20795 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:03.511330 20295 leader_election.cc:343] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.473963 20784 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.505278 20817 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:17:03.518996 20295 leader_election.cc:343] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.509306 20771 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:03.498106 20757 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.520944 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:03.499284 20765 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.513005 20802 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.517987 20787 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.608219 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:03.648090 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 129145us
I20260709 12:17:03.651262 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:03.652161 20778 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.520357 20790 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.593381 20757 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:03.654016 20295 leader_election.cc:343] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.538717 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.590895 20770 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.593556 20789 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:03.538623 20175 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.646468 20813 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.590868 20764 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.660935 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.649577 20747 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.649928 20795 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.653216 20324 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.594208 20823 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.653424 20778 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:03.539662 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.615197 20814 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.541903 20771 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.540923 20327 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:03.607690 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.657713 20831 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:03.522603 20817 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.670267 20371 tablet_bootstrap.cc:654] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.677197 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:03.665844 20778 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.681667 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.682746 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.742798 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.750826 20372 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: No bootstrap required, opened a new log
I20260709 12:17:03.751591 20372 ts_tablet_manager.cc:1403] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: Time spent bootstrapping tablet: real 0.552s	user 0.043s	sys 0.015s
I20260709 12:17:03.756688 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.759835 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:03.757598 20330 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:03.661892 20770 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.763888 20409 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.661757 20789 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.758960 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.762544 20784 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:03.784142 20813 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:03.682253 20831 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.823935 20764 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.859180 20370 tablet_bootstrap.cc:700] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent opening tablet: real 0.175s	user 0.001s	sys 0.001s
I20260709 12:17:03.868574 20370 tablet_bootstrap.cc:654] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.764134 20795 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.833256 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.906689 20813 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:03.908109 20813 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.914556 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.858635 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.931815 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.867277 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:03.867509 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:03.914149 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.858096 20174 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:03.928128 20817 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:03.990701 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.990945 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.992142 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.993407 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.993456 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.995146 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.996487 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.997344 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.997742 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.999011 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:03.999094 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:03.999893 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.000043 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.000588 20330 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.000767 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.001544 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.001806 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.002357 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.002108 20778 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.002720 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.003335 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:03.904999 20764 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.965412 20765 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.004613 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:03.905241 20795 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:03.967519 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.016377 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.003958 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.010641 20651 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.017021 20330 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.006672 20747 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.023355 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.026229 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.027771 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.028211 20831 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.029163 20770 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.029346 20789 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.022248 20771 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.029577 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.030948 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.035523 20180 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.033818 20747 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.049007 20747 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.049225 20372 raft_consensus.cc:359] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.050184 20372 raft_consensus.cc:385] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.050540 20372 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.055475 20372 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.038489 20778 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.032943 20651 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.064976 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.067801 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.069118 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.070160 20322 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.077099 20372 ts_tablet_manager.cc:1434] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: Time spent starting tablet: real 0.325s	user 0.008s	sys 0.000s
I20260709 12:17:04.072932 20764 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.072736 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.082662 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.092206 20651 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.090598 20784 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.092819 20795 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.083882 20778 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.093935 20325 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:04.093868 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.092943 20784 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.096082 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.096349 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.098210 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.098882 20325 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.094266 20778 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.120437 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.156694 20371 tablet_bootstrap.cc:492] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:04.157392 20371 ts_tablet_manager.cc:1403] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.800s	user 0.022s	sys 0.012s
I20260709 12:17:04.099969 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.159766 20370 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:04.160337 20370 ts_tablet_manager.cc:1403] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.813s	user 0.017s	sys 0.016s
I20260709 12:17:04.161410 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.153210 20792 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.162374 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:04.102656 20295 leader_election.cc:343] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:04.163158 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60568.6us
I20260709 12:17:04.164122 20295 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.099905 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.101321 20324 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.176662 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:17:04.179461 20295 leader_election.cc:343] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.108582 20810 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.101771 20651 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.113294 20828 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.105417 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.174697 20808 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.162715 20784 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.095290 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.178428 20764 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.101478 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.182713 20651 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.184873 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.185564 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.193629 20249 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:04.194748 20651 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.195302 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.198004 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.199079 20328 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:04.199208 20808 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.199790 20808 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.201814 20808 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.203935 20819 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.204423 20808 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.204579 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.204748 20788 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.189211 20764 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.205282 20788 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.205729 20764 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.204438 20819 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.207373 20788 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.208015 20819 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.203970 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.164489 20839 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.164714 20831 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.178122 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:04.187520 20295 leader_election.cc:343] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.213129 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.188042 20370 raft_consensus.cc:359] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.162731 20792 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.215507 20370 raft_consensus.cc:385] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.221689 20371 raft_consensus.cc:359] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.222119 20370 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.222688 20371 raft_consensus.cc:385] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.223060 20371 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.182004 20325 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.205009 20808 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.216089 20831 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.228341 20808 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.218550 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.229842 20076 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 114) took 1864 ms. Trace:
I20260709 12:17:04.218492 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.210879 20817 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.230787 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.231115 20252 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:04.220002 20771 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.190613 20322 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:04.232960 20771 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:04.227277 20829 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.752s	user 0.008s	sys 0.008s
I20260709 12:17:04.233976 20370 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.220618 20828 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.234609 20321 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.235072 20828 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.236380 20370 ts_tablet_manager.cc:1434] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 12:17:04.227763 20819 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.222259 20176 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:04.237783 20819 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.238261 20819 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.238296 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.238538 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.227473 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.232242 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.232697 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.244148 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.244328 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.245779 20698 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.246264 20771 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.246315 20698 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.237408 20828 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.247743 20797 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.248121 20797 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.248498 20797 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.249047 20698 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.252168 20785 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.252652 20785 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.253331 20808 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.252183 20817 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.254473 20785 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.247399 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.255038 20790 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.230242 20076 rpcz_store.cc:276] 0709 12:17:02.364970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.366953 (+  1983us) service_pool.cc:224] Handling call
0709 12:17:04.229742 (+1862789us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:17:04.239506 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.241089 20371 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.254837 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.256276 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.255548 20790 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.257892 20371 ts_tablet_manager.cc:1434] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.002s
I20260709 12:17:04.258235 20790 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.258755 20778 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.261273 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:17:04.261807 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:04.262151 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.263183 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.232178 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.263899 20078 rpcz_store.cc:275] Call kudu.master.MasterService.IsCreateTableDone from 127.0.0.1:55676 (request call id 37) took 1386 ms. Trace:
I20260709 12:17:04.264585 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.264281 20078 rpcz_store.cc:276] 0709 12:17:02.874637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.874773 (+   136us) service_pool.cc:224] Handling call
0709 12:17:02.875104 (+   331us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0709 12:17:04.259874 (+1384770us) catalog_manager.cc:2317] Verify if the table creation is in progress for test-workload [id=de5952fc08474ab1a16a9522bfe34b08]
0709 12:17:04.260835 (+   961us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1384537}
I20260709 12:17:04.266433 20747 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.266546 20788 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.266901 20747 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.267014 20788 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.267359 20747 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.267460 20788 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.270370 20797 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.229866 20831 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.272092 20792 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.243283 20839 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.272634 20792 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:04.272995 20792 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.273334 20792 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.274047 20839 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.275116 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:04.275959 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 93716.4us
I20260709 12:17:04.276962 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:04.277524 20249 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.278857 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.279685 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.280675 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.239988 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.296041 20814 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.296351 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.296533 20814 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.297009 20814 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.297565 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:04.282727 20295 leader_election.cc:343] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.283289 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.283581 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.282500 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.285267 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.286496 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.286635 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.297595 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.303431 20831 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.312204 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 106) took 2664 ms. Trace:
I20260709 12:17:04.312074 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.237346 20370 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Bootstrap starting.
I20260709 12:17:04.305927 20797 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.307893 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.282188 20698 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.298349 20783 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.298514 20789 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.323920 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.314857 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.321339 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.312579 20075 rpcz_store.cc:276] 0709 12:17:01.639192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.686971 (+ 47779us) service_pool.cc:224] Handling call
0709 12:17:04.303840 (+2616869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1567488,"reported_tablets":3}
W20260709 12:17:04.327379 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44963.3us
I20260709 12:17:04.316458 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.315692 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.316987 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.427997 20371 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:04.396754 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:04.441944 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 103803us
W20260709 12:17:04.419500 20220 leader_election.cc:343] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:04.373579 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55711.7us
W20260709 12:17:04.448884 20295 leader_election.cc:343] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:04.449191 20220 leader_election.cc:343] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.449733 20220 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.450923 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.318040 20698 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.469095 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:04.469708 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 153329us
I20260709 12:17:04.325210 20817 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.471892 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.444983 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.326444 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.410418 20178 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:04.318449 20839 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.157s
I20260709 12:17:04.409938 20790 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.340045 20778 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.476321 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.472160 20824 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.338555 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:04.428282 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.479722 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.327622 20789 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.478106 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.427642 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.486581 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.317054 20831 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.335343 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.464093 20752 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.475458 20698 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:04.486267 20295 leader_election.cc:343] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.487138 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.477850 20750 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:04.477705 20817 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.426919 20747 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.426354 20788 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.479317 20751 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.464262 20764 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.520706 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.499828 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.483711 20770 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.486792 20778 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.488662 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.483609 20790 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.511721 20671 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.499773 20789 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.505630 20785 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.498862 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.527315 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.546103 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.527912 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.546866 20252 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:04.528462 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.501062 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.524158 20750 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:04.528965 20819 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.529307 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.520004 20797 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.529860 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.530262 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.501151 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.496706 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:04.538555 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61606.9us
I20260709 12:17:04.517722 20817 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.538273 20651 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.537971 20778 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.555166 20370 tablet_bootstrap.cc:654] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:04.566133 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79078.7us
I20260709 12:17:04.557138 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.538610 20808 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.552629 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.583178 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.583341 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.560487 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.585286 20764 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.585630 20747 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.544829 20788 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.556033 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:04.552170 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.587075 20371 tablet_bootstrap.cc:654] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.547902 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.587163 20819 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.587105 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.542940 20790 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.589198 20651 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.592473 20330 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:04.537199 20784 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.592969 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.594378 20179 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:04.594941 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.586514 20848 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.544301 20173 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:04.555123 20831 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.547643 20785 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.554168 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.647698 20848 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:04.647778 20784 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.648306 20848 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.644745 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.592986 20248 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:04.607694 20254 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:04.588860 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.608209 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.609848 20750 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.661836 20764 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.662420 20247 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.604475 20824 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:04.583294 20797 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.607208 20326 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:17:04.675280 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.607077 20253 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:04.649544 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66422.8us
I20260709 12:17:04.661653 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.669390 20764 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.647137 20814 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.653956 20698 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.644939 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.672377 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.673342 20824 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.674116 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:04.714038 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 121180us
I20260709 12:17:04.681663 20371 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:04.734632 20370 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: No bootstrap required, opened a new log
I20260709 12:17:04.642772 20249 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:04.644420 20328 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:04.606103 20252 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:04.771287 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.770489 20371 ts_tablet_manager.cc:1403] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.398s	user 0.016s	sys 0.012s
W20260709 12:17:04.670368 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 75493.8us
I20260709 12:17:04.770622 20370 ts_tablet_manager.cc:1403] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Time spent bootstrapping tablet: real 0.534s	user 0.023s	sys 0.012s
I20260709 12:17:04.613359 20651 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.611882 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.684944 20778 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.722272 20813 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.678985 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.735502 20327 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.680418 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.676549 20797 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.594853 20792 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.650938 20747 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.769176 20824 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:04.770498 20325 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.652916 20819 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.793047 20850 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.794379 20819 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.794667 20850 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.681994 20785 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.676532 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.735944 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.783764 20179 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.795977 20698 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.795519 20778 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.796594 20764 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.685839 20784 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.776469 20751 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.786140 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.776109 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.802413 20322 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 2: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:04.801883 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.779471 20775 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.796623 20850 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.803781 20850 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.796507 20819 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.804404 20850 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.804448 20651 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:04.782894 20220 leader_election.cc:343] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.809368 20817 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.810436 20176 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.809958 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.811735 20256 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:04.812587 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.820909 20789 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.822862 20250 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.831629 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.843470 20778 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.843647 20850 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.843891 20254 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:04.843990 20778 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:04.844442 20778 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.845947 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:04.848603 20254 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.849239 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.849836 20178 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.849911 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.850917 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.851236 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.851954 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:04.852408 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.853123 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.853263 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.853593 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.854660 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.855211 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.855508 20751 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.855811 20251 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.855966 20751 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.856429 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.848546 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:04.858757 20295 leader_election.cc:343] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:04.859629 20295 leader_election.cc:343] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:04.859702 20220 leader_election.cc:343] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.861020 20220 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.862731 20251 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.862810 20329 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.862913 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:04.868490 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 83061.4us
I20260709 12:17:04.843485 20651 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.869747 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.862684 20784 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:17:04.872364 20370 raft_consensus.cc:359] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.873064 20370 raft_consensus.cc:385] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.873915 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.874604 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.878058 20814 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.878271 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.873420 20370 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.866488 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.845769 20790 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:04.880085 20220 leader_election.cc:343] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.889472 20370 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.890779 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.891281 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.891399 20326 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:04.892146 20178 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:04.892423 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.892514 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.893267 20824 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.879101 20850 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.894508 20824 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.885885 20814 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:04.896433 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.896919 20814 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.898198 20814 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.900421 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.901304 20850 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.878978 20778 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.905449 20370 ts_tablet_manager.cc:1434] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.005s
I20260709 12:17:04.909116 20817 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:04.910456 20220 leader_election.cc:343] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.912267 20747 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.912321 20848 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.912842 20747 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.913843 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:04.895109 20784 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.914893 20784 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:04.915452 20849 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:04.916002 20850 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:04.917208 20817 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:04.915999 20849 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.918404 20817 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.918759 20817 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:04.919641 20849 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.920746 20778 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.916059 20784 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.922366 20784 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.922739 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:04.924958 20220 consensus_peers.cc:597] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:04.926100 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.927142 20330 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:04.929649 20750 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.930076 20750 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:04.931843 20253 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:04.924566 20817 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.933419 20817 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.936050 20747 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.936710 20810 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.938355 20848 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.938866 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.927074 20757 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.939462 20175 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.939823 20757 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:04.940745 20757 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.931126 20750 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.944276 20750 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.922394 20778 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:04.946911 20850 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.947777 20789 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.949330 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:04.950464 20371 raft_consensus.cc:359] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.958221 20371 raft_consensus.cc:385] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.950876 20175 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:04.953118 20810 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.953678 20790 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:04.951436 20220 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.954296 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:04.954944 20813 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.962322 20852 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:04.964223 20813 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.964731 20852 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.965040 20852 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:04.965327 20823 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.965539 20771 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.965787 20823 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:04.965975 20771 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:04.961964 20778 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.965891 20852 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.945327 20751 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.966902 20771 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.966796 20823 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.966698 20778 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:04.965371 20810 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.968575 20823 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.962087 20752 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.967836 20852 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.960793 20850 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:04.968618 20810 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:04.977546 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.978190 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.966698 20814 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.921640 20792 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.970249 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.971436 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:04.983280 20828 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.972201 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:04.972988 20251 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:04.984956 20220 leader_election.cc:343] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.987905 20220 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:04.969359 20751 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:04.988853 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:04.987442 20848 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.990972 20790 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:04.991636 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.958693 20371 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.981428 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.986469 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:04.989012 20256 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.996492 20329 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.979585 20144 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:04.976140 20850 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.991971 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:05.001369 20325 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:04.969075 20778 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.997787 20371 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:04.998389 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.003772 20175 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.003836 20324 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.002283 20850 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.006872 20371 ts_tablet_manager.cc:1434] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.232s	user 0.004s	sys 0.003s
I20260709 12:17:05.014041 20831 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.016882 20371 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:04.991657 20790 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:05.002593 20828 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.006752 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.015688 20810 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.073557 20810 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.083694 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.087906 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:05.088937 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:05.089747 20329 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
W20260709 12:17:05.090312 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 91982.6us
W20260709 12:17:05.090401 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 102570us
I20260709 12:17:05.094290 20752 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.092993 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.075882 20778 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.096537 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.075938 20751 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.098492 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.095764 20828 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.088943 20771 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.110464 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.112068 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.112934 20831 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.105566 20752 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.114758 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:17:05.114887 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.117359 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.105203 20823 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.093441 20784 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:05.112309 20813 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.119609 20828 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.134328 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.135349 20144 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.138638 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.141122 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.142730 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.144078 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.131402 20751 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:05.138634 20823 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.138942 20831 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.150452 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48244.7us
I20260709 12:17:05.151523 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.152976 20751 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.155128 20719 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.114886 20790 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.156220 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.157138 20828 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.157891 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.158702 20823 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.159945 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.158383 20144 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.164702 20823 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.166188 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.132447 20789 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:05.169005 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.173583 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.152998 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.140000 20808 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.177691 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.178802 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.180207 20719 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.180215 20752 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.181515 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.151381 20851 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.178751 20828 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.179028 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.204114 20294 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.205221 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.171761 20823 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.208483 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.209797 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.178275 20814 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.179355 20757 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.208017 20784 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.196159 20831 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.155184 20751 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.218895 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.220438 20256 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 2: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:05.222165 20857 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.222653 20857 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.223717 20651 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.224838 20857 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.207028 20851 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.229578 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.235579 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.176648 20789 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.241649 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.243330 20329 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.246497 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.247166 20326 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:05.233381 20814 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.252198 20814 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.254489 20814 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.256592 20764 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.257126 20764 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:05.258241 20764 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.261237 20764 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.265836 20789 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.269881 20371 tablet_bootstrap.cc:654] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:05.272732 20330 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:05.216405 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.283504 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.290158 20808 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.294255 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:05.296587 20789 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:05.297562 20671 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:05.298031 20671 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.298218 20789 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.298801 20789 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.299954 20789 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.301666 20789 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.309484 20253 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
W20260709 12:17:05.310570 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 106177us
I20260709 12:17:05.311404 20144 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.321928 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.298470 20671 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.304729 20078 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:05.338135 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.337400 20813 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.342298 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.281912 20861 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.346581 20144 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.325999 20808 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.357718 20850 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.355980 20813 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.360090 20850 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.348979 20817 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.361382 20250 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:17:05.361685 20866 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:17:05.361441 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:05.362339 20330 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.344883 20828 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:17:05.364390 20851 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.364773 20851 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.365597 20851 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.366737 20851 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.375257 20824 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:05.380456 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 172054us
I20260709 12:17:05.381268 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.382542 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:05.383375 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:05.384517 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.385656 20330 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:05.386817 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:05.347779 20852 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.388751 20294 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.387643 20698 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:05.400848 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.390954 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.406899 20328 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:05.407428 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.409011 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.408938 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.391650 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.435554 20253 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:05.411288 20179 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 0.
I20260709 12:17:05.412060 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.389550 20764 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.433775 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.409579 20869 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.390452 20778 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.443881 20180 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:05.444816 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.445690 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.445973 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.446777 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.390836 20828 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:17:05.447000 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.448216 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.449338 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.451261 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.453867 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.433090 20861 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.455992 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:17:05.456683 20867 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:17:05.460258 20651 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.438953 20698 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.461463 20698 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.463634 20771 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.389153 20813 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:17:05.464059 20771 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.464927 20771 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.465574 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.466298 20771 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.468917 20171 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:17:05.470302 20171 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:05.470403 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.473187 20671 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.479212 20179 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:05.480636 20294 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.482600 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.480549 20778 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:05.483798 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.487627 20175 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 2: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:05.485911 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.493156 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.529636 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.527796 20778 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.533520 20174 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
W20260709 12:17:05.531406 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.537926 20324 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.538859 20869 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.538666 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:05.537443 20671 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.540740 20326 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:05.541095 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48071.5us
I20260709 12:17:05.542145 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.542680 20173 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
W20260709 12:17:05.543279 20294 leader_election.cc:343] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.543475 20671 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:05.543933 20869 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:05.544471 20869 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.545116 20869 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.544411 20671 consensus_queue.cc:1243] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:05.546838 20294 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.552424 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.553318 20861 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:05.553689 20861 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:05.554023 20861 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.554654 20180 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:05.559587 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.560207 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.566809 20869 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.568843 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.576958 20752 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.577353 20752 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.577258 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.578464 20813 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.578332 20752 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.538700 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:05.579595 20869 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:05.579957 20851 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:05.580360 20851 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.580981 20869 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:05.581168 20851 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.581918 20869 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:05.582358 20851 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.593312 20869 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.569489 20861 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.589362 20326 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:05.579522 20752 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:05.584024 20295 leader_election.cc:343] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.597221 20861 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:05.599447 20178 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.586470 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:05.601482 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:05.602857 20220 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.603789 20671 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.604332 20671 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.604573 20819 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.605283 20671 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.583482 20294 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.608914 20764 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.609608 20861 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.610365 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:05.611332 20220 leader_election.cc:343] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.603742 20698 raft_consensus.cc:2764] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:17:05.612454 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.613175 20698 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.613651 20861 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:05.614270 20220 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.614589 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:05.615124 20698 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.616539 20220 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.616490 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:05.617914 20698 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:05.618213 20789 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.618770 20698 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.619508 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.620460 20789 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.620134 20698 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.626652 20764 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:05.627213 20764 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:05.628147 20764 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.632319 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.633147 20861 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.634265 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.636301 20861 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.637818 20220 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.638149 20851 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:05.638679 20789 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.639310 20220 leader_election.cc:343] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.638685 20851 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.641271 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.641491 20851 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:05.647483 20220 leader_election.cc:343] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.648025 20220 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.649940 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.657218 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.658672 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.662292 20750 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.662887 20651 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.658970 20870 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.666030 20371 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:05.666496 20371 ts_tablet_manager.cc:1403] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.652s	user 0.078s	sys 0.098s
I20260709 12:17:05.658566 20824 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.652266 20789 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.669365 20371 raft_consensus.cc:359] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.670125 20371 raft_consensus.cc:385] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:05.670535 20371 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:05.671463 20371 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:05.669330 20220 leader_election.cc:343] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.680547 20371 ts_tablet_manager.cc:1434] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:17:05.681849 20371 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:05.684161 20294 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.688284 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.688993 20250 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:05.703246 20220 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.708772 20785 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.732333 20764 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.732545 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48471.3us
I20260709 12:17:05.708649 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:05.734067 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47441.5us
I20260709 12:17:05.734376 20698 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.736092 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.736940 20764 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.740271 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.741052 20869 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.741555 20869 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:05.736044 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:05.742393 20869 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.743040 20851 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:05.743512 20851 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:05.743889 20851 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.741760 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:05.745175 20698 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.745630 20698 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.746711 20698 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.752880 20322 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.753013 20851 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.753808 20371 tablet_bootstrap.cc:654] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:05.754558 20785 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.755221 20851 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.756953 20294 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.758562 20870 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.762676 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.763060 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.763836 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.765106 20828 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.765789 20813 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.766247 20813 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.768774 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:05.771377 20250 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:05.767100 20813 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.773810 20323 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:05.774928 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:05.776016 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.777945 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.779062 20323 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 2: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:05.782552 20771 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.783169 20771 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.784423 20852 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:05.785882 20831 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:05.786953 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45449.3us
W20260709 12:17:05.797446 20220 consensus_peers.cc:597] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:05.798198 20220 leader_election.cc:343] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.801200 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:05.785794 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:05.781617 20324 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:05.808760 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:05.811286 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:05.786577 20831 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.812968 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.791651 20828 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.814766 20220 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:05.799357 20771 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:05.796317 20076 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:05.810377 20813 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.818364 20814 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.814044 20789 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.824270 20789 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.825181 20789 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:05.827811 20220 leader_election.cc:343] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:05.829650 20220 leader_election.cc:343] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:05.831779 20813 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.832607 20220 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.832696 20813 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.833438 20824 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.818881 20828 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.816843 20671 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.820638 20751 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.836602 20671 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.836795 20751 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:05.837759 20751 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.837908 20671 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.821413 20831 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.841180 20831 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:05.821194 20076 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:05.831223 20814 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.845165 20076 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:05.816346 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:05.851302 20076 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:05.823200 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.859746 20144 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:05.864840 20814 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.868492 20330 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:05.870210 20253 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:05.871817 20175 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.877743 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.878358 20253 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.888051 20371 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:05.888573 20371 ts_tablet_manager.cc:1403] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.207s	user 0.028s	sys 0.023s
I20260709 12:17:05.879021 20828 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:05.892716 20828 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:05.893658 20828 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.894795 20371 raft_consensus.cc:359] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.898499 20747 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:05.895509 20371 raft_consensus.cc:385] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:05.901907 20371 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:05.904663 20253 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:05.908376 20371 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.907596 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:05.914362 20252 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.916499 20371 ts_tablet_manager.cc:1434] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:17:05.921895 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:05.924687 20220 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:05.930081 20075 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:05.932359 20075 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 2, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:05.938045 20178 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:05.939018 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:05.944130 20861 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.944188 20790 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:05.927624 20764 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:05.947590 20764 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:05.948544 20764 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:05.950961 20371 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:05.923331 20784 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:17:05.958704 20824 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:05.965405 20747 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:06.002758 20295 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:06.019642 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:06.034917 20371 tablet_bootstrap.cc:654] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:06.056490 20076 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.058264 20076 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.060005 20076 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:17:06.068303 20371 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:06.068861 20371 ts_tablet_manager.cc:1403] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.005s
I20260709 12:17:06.071652 20371 raft_consensus.cc:359] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.072299 20371 raft_consensus.cc:385] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:06.072598 20371 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:06.064709 20076 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.073951 20371 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.074903 20076 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.076120 20371 ts_tablet_manager.cc:1434] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:17:06.077378 20371 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
W20260709 12:17:06.084947 20220 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:06.090772 20371 tablet_bootstrap.cc:654] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:06.093667 20764 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:06.094844 20078 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:06.096603 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:06.100381 20078 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.102229 20078 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.103345 20371 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:06.103858 20371 ts_tablet_manager.cc:1403] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 12:17:06.104141 20078 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.106271 20078 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.107471 20371 raft_consensus.cc:359] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.108147 20371 raft_consensus.cc:385] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:06.108394 20371 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:06.109084 20371 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.111099 20371 ts_tablet_manager.cc:1434] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:17:06.107915 20078 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.112084 20371 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:06.114665 20831 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.115164 20831 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.117249 20831 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.119083 20371 tablet_bootstrap.cc:654] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:06.119905 20870 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:06.120383 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.119956 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.127344 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:06.130177 20831 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:06.135419 20178 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.137897 20857 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.141273 20870 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:06.148203 20075 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.150156 20075 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.151042 20371 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:06.160887 20371 ts_tablet_manager.cc:1403] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.024s
I20260709 12:17:06.163201 20324 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.163754 20371 raft_consensus.cc:359] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.165093 20371 raft_consensus.cc:385] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:06.165372 20371 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:06.165318 20831 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.166272 20371 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.170563 20371 ts_tablet_manager.cc:1434] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:06.172230 20371 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:06.178717 20371 tablet_bootstrap.cc:654] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:06.182005 20174 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:06.199314 20330 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.209986 20330 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.225872 20324 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.229440 20857 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:06.244925 20747 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:06.256332 20371 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:06.286634 20371 ts_tablet_manager.cc:1403] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.115s	user 0.027s	sys 0.048s
I20260709 12:17:06.259343 20247 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.278582 20178 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.289006 20371 raft_consensus.cc:359] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.289572 20371 raft_consensus.cc:385] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:06.289794 20371 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:06.290297 20371 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.292341 20371 ts_tablet_manager.cc:1434] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:06.293192 20371 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:06.298746 20790 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.303639 20371 tablet_bootstrap.cc:654] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:06.306881 20771 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.307561 20771 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.310266 20771 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.312781 20175 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.285730 20747 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.314839 20747 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.315354 20250 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.315516 20371 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:06.316040 20371 ts_tablet_manager.cc:1403] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.010s
I20260709 12:17:06.280932 20176 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.318830 20371 raft_consensus.cc:359] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.320883 20371 raft_consensus.cc:385] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:06.322023 20371 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:06.322715 20371 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.326215 20250 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.283383 20322 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.333788 20813 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.337031 20698 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.338156 20790 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.339785 20371 ts_tablet_manager.cc:1434] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:17:06.341133 20371 tablet_bootstrap.cc:492] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:06.352761 20824 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.332523 20324 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.356910 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.358253 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.366014 20322 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.368424 20824 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.374215 20250 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.376093 20371 tablet_bootstrap.cc:654] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:06.391510 20771 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.379812 20178 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.391746 20824 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.386775 20323 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.397531 20326 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.399478 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:06.381078 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:06.399286 20831 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.401299 20831 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.402231 20771 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:06.403617 20831 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.400168 20247 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.404068 20771 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.406394 20771 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.406842 20790 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.407395 20790 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.409312 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.411223 20771 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.411732 20771 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.413870 20771 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.415012 20771 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.415293 20321 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.417488 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.422425 20771 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.422895 20771 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.423995 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.424197 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.424819 20251 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:06.425112 20326 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:06.425320 20771 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.427412 20321 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.428071 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.428828 20248 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 1: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:06.430543 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:06.431159 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.431448 20175 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 0.
I20260709 12:17:06.431979 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:06.435222 20771 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:06.436399 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:06.439533 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.440171 20248 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:06.442006 20771 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:06.443653 20251 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.446981 20790 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:06.390884 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.452373 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:06.457821 20671 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.471752 20813 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:06.472114 20371 tablet_bootstrap.cc:492] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:06.472630 20371 ts_tablet_manager.cc:1403] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.007s
I20260709 12:17:06.451515 20771 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:06.476166 20371 raft_consensus.cc:359] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.476871 20371 raft_consensus.cc:385] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:06.477164 20371 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:06.477928 20323 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.463798 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:06.481346 20784 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:06.481734 20784 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.482084 20784 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.465415 20764 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:06.482940 20174 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:06.486500 20247 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.489329 20784 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.490695 20828 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.493769 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:06.494390 20175 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.496447 20784 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:06.477837 20371 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.429061 20075 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.501063 20813 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:06.461270 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 70696.5us
I20260709 12:17:06.502027 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:06.502694 20249 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.505777 20177 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:06.506101 20173 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.503458 20075 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.513877 20671 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.508941 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:06.532805 20251 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.523906 20857 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:06.553316 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:06.545073 20671 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 12:17:06.592753 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 86627us
I20260709 12:17:06.660013 20932 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.657418 20931 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.679930 20747 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.682085 20931 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.703828 20671 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:06.717903 20747 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:06.758167 20371 ts_tablet_manager.cc:1434] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.285s	user 0.025s	sys 0.023s
W20260709 12:17:06.774955 20935 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:17:06.777678 20371 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: Bootstrap starting.
I20260709 12:17:06.794997 20931 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.810675 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:06.825862 20180 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:06.831740 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.832513 20328 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
W20260709 12:17:06.895628 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53546us
I20260709 12:17:06.839030 20175 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:06.846781 20942 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260709 12:17:06.889912 20747 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:06.908198 20874 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:17:06.933095 20249 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:06.954720 20819 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:06.955436 20819 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:06.973647 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78058.8us
I20260709 12:17:06.979256 20819 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:06.986608 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:06.987272 20329 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:06.988400 20323 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.996624 20323 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:07.007817 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 289537us
I20260709 12:17:07.008939 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:07.011843 20371 tablet_bootstrap.cc:654] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:07.012678 20771 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.013103 20771 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.013557 20771 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.031066 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:07.019582 20940 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:07.053857 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:07.054894 20330 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 2: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:17:07.074522 20949 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.125s	user 0.002s	sys 0.002s
I20260709 12:17:07.048719 20954 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:07.056906 20940 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.085453 20932 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.110401 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:07.111111 20178 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:07.112973 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:07.124735 20220 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.131785 20751 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.134908 20751 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.135316 20751 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.138195 20180 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:07.145475 20751 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.108129 20932 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:07.237619 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 152373us
W20260709 12:17:07.246050 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 178171us
W20260709 12:17:07.298918 20960 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:07.304080 20751 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.320310 20764 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:07.320993 20764 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.353845 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:07.354701 20330 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.356001 20371 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: No bootstrap required, opened a new log
I20260709 12:17:07.358634 20371 ts_tablet_manager.cc:1403] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: Time spent bootstrapping tablet: real 0.585s	user 0.017s	sys 0.017s
I20260709 12:17:07.248436 20954 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:07.357097 20946 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:07.366218 20764 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:07.368355 20954 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.368854 20771 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.372547 20330 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:07.375658 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:07.376346 20172 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:07.381544 20295 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.382663 20942 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:07.383128 20942 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:07.389945 20171 raft_consensus.cc:2368] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3.
I20260709 12:17:07.372131 20771 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.398061 20371 raft_consensus.cc:359] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.398842 20371 raft_consensus.cc:385] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:07.399170 20371 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Initialized, Role: FOLLOWER
I20260709 12:17:07.392180 20942 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.397783 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:07.400586 20247 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 2: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:07.400251 20371 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.402809 20371 ts_tablet_manager.cc:1434] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:17:07.409847 20940 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.406983 20932 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.412711 20942 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:07.414821 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53923.5us
I20260709 12:17:07.418337 20942 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:07.430841 20219 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:07.434532 20947 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.434679 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:07.435273 20947 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:07.436251 20947 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.445215 20751 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:07.445798 20751 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.452670 20172 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:07.460227 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:07.460925 20325 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.467309 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:07.469751 20326 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:07.468384 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:07.459295 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 117) took 1086 ms. Trace:
I20260709 12:17:07.474280 20325 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:07.472479 20075 rpcz_store.cc:276] 0709 12:17:06.372844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.373042 (+   198us) service_pool.cc:224] Handling call
0709 12:17:07.459219 (+1086177us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:06.529203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:06.650529 (+121326us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:06.656916 (+  6387us) write_op.cc:435] Acquired schema lock
0709 12:17:06.661332 (+  4416us) tablet.cc:662] Decoding operations
0709 12:17:06.685444 (+ 24112us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:06.688203 (+  2759us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:06.692391 (+  4188us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:06.746355 (+ 53964us) tablet.cc:701] Row locks acquired
0709 12:17:06.746376 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:17:06.752413 (+  6037us) write_op.cc:270] Start()
0709 12:17:06.756297 (+  3884us) write_op.cc:276] Timestamp: P: 1783599426751480 usec, L: 0
0709 12:17:06.756334 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:17:06.793202 (+ 36868us) log.cc:844] Serialized 928 byte log entry
0709 12:17:07.108506 (+315304us) op_driver.cc:464] REPLICATION: finished
0709 12:17:07.340161 (+231655us) write_op.cc:301] APPLY: starting
0709 12:17:07.345429 (+  5268us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:07.361845 (+ 16416us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:07.366191 (+  4346us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:07.366525 (+   334us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:07.366695 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:07.366738 (+    43us) write_op.cc:312] APPLY: finished
0709 12:17:07.366922 (+   184us) log.cc:844] Serialized 28 byte log entry
0709 12:17:07.367108 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:07.367194 (+    86us) write_op.cc:454] Released schema lock
0709 12:17:07.367235 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:07.367659 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:07.367687 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":231350,"apply.run_cpu_time_us":2021,"apply.run_wall_time_us":27454,"num_ops":2,"prepare.queue_time_us":2155,"prepare.run_cpu_time_us":5112,"prepare.run_wall_time_us":276814,"replication_time_us":347329,"thread_start_us":127573,"threads_started":1}]]}
I20260709 12:17:07.468727 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:07.471894 20173 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.487186 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.536871 20932 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.537410 20932 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.537746 20932 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:07.551379 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 151541us
W20260709 12:17:07.546851 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59764.1us
I20260709 12:17:07.560703 20751 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.563632 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:07.564363 20173 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:07.568187 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:07.572619 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:07.578907 20249 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.564391 20251 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:07.596155 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.599269 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:07.600255 20171 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:07.601809 20295 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.607879 20771 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.609481 20932 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:07.611547 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 43723.7us
I20260709 12:17:07.617218 20220 leader_election.cc:400] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3.
I20260709 12:17:07.608449 20933 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.617560 20220 leader_election.cc:403] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:07.609342 20967 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:07.623476 20967 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:07.619982 20933 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:07.620807 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:07.624437 20967 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.624863 20933 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.625543 20322 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:07.630293 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:07.631042 20324 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.650913 20938 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.652175 20249 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:07.651718 20938 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.652725 20824 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3.
I20260709 12:17:07.613377 20932 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.654385 20938 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:07.668962 20126 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:07.671072 20077 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:07.675676 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:07.761899 20176 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
W20260709 12:17:07.763185 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 81616.1us
I20260709 12:17:07.741017 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:07.770747 20178 raft_consensus.cc:2368] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:17:07.679020 20324 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:07.785708 20220 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.791697 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:07.793712 20947 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.794106 20220 leader_election.cc:400] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:17:07.794576 20220 leader_election.cc:403] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:07.794126 20947 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.795245 20974 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.793716 20933 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.796415 20933 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:07.797318 20933 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.795367 20947 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.803120 20974 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:17:07.804282 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:07.815280 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:07.816485 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:07.807983 20947 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.820498 20252 raft_consensus.cc:2368] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:07.821537 20947 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:07.823849 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:07.826917 20294 leader_election.cc:400] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:07.837452 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:07.855036 20172 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.867739 20254 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:07.871013 20784 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:07.878276 20255 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:07.913097 20172 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:07.914160 20220 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:07.914398 20177 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:07.914942 20947 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.915426 20947 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:07.916397 20969 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:07.916414 20947 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:07.921041 20075 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 0 to 2, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:07.983724 20077 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:08.021111 20324 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.022737 20974 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.028057 20172 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.029603 20974 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.064500 20075 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:08.067044 20075 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:08.081974 20247 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.083822 20969 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.084515 20969 consensus_queue.cc:1243] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:08.084861 20784 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.085242 20784 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:08.086140 20784 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:08.087387 20784 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.168919 20247 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.170225 20933 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.180620 20324 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.183635 20813 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.277714 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:08.284914 20997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:08.285310 20998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:08.286643 21000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:08.288003 18961 server_base.cc:1061] running on GCE node
I20260709 12:17:08.289677 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:08.289916 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:08.290122 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599428290101 us; error 0 us; skew 500 ppm
I20260709 12:17:08.290696 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:08.294730 18961 webserver.cc:533] Webserver started at http://127.18.132.68:38009/ using document root <none> and password file <none>
I20260709 12:17:08.295488 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:08.295778 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:08.296253 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:08.298121 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-3-root/instance:
uuid: "8aef67aa330543a191ab5ab5dc30e84c"
format_stamp: "Formatted at 2026-07-09 12:17:08 on dist-test-slave-xbvc"
I20260709 12:17:08.303414 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:08.306982 21005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:08.307829 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:08.308138 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-3-root
uuid: "8aef67aa330543a191ab5ab5dc30e84c"
format_stamp: "Formatted at 2026-07-09 12:17:08 on dist-test-slave-xbvc"
I20260709 12:17:08.308454 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:08.332119 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:08.333547 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:08.335158 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:08.338558 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:08.338862 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:17:08.339165 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:08.339372 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:08.400686 20177 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.400837 20247 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.403312 20974 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:08.408890 20933 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.423323 20323 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.428206 20933 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.453577 20321 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:08.454138 20321 pending_rounds.cc:85] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 1
I20260709 12:17:08.454512 20321 pending_rounds.cc:107] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:08.454890 20321 raft_consensus.cc:2889] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:08.460703 20857 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.615325 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.68:38217
I20260709 12:17:08.639460 21072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.68:38217 every 8 connection(s)
I20260709 12:17:08.664034 18961 auto_leader_rebalancer-test.cc:439] add a tserver: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:08.680830 21073 heartbeater.cc:344] Connected to a master server at 127.18.132.126:44843
I20260709 12:17:08.681373 21073 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:08.682307 21073 heartbeater.cc:507] Master 127.18.132.126:44843 requested a full tablet report, sending...
I20260709 12:17:08.684495 20075 ts_manager.cc:194] Registered new tserver with Master: 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:08.686021 20075 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56956
I20260709 12:17:09.689322 21073 heartbeater.cc:499] Master 127.18.132.126:44843 was elected leader, sending a full tablet report...
I20260709 12:17:09.827881 20254 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:09.837430 20177 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:09.839777 20948 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:09.858680 20321 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:09.860317 20948 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:09.866321 20948 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:09.868933 20172 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:09.874330 20327 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:17:09.882551 20219 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5844fde759d84503859902ab6bf69cdc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:09.897852 20075 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:09.976280 20323 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:09.995273 20254 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:09.997164 21078 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:09.999503 20177 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.003841 21078 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:10.006984 20294 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cacb9a2627045debeb7e4198ce2bcf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.012414 20967 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.017566 20177 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.025509 20254 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.031121 20249 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.056166 20177 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.055718 20078 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.056948 20323 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:10.058463 20219 consensus_peers.cc:597] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b58bdb95474c4f788fec380b260dc1be. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.059207 20948 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.061650 21086 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:10.077912 21086 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.081096 20172 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.094815 20321 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.103422 20078 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.123183 20172 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.133392 20321 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.136229 20249 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.136119 20940 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.137761 20813 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.156561 20940 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.167608 20321 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:17:10.173182 20144 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56046fd4231240119a75348ab3fc48d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.176729 20249 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:10.184712 20075 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.430204 21108 ts_tablet_manager.cc:933] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:10.432783 21108 tablet_copy_client.cc:323] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:10.449626 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 5844fde759d84503859902ab6bf69cdc from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:10.450380 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 5844fde759d84503859902ab6bf69cdc from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-5844fde759d84503859902ab6bf69cdc
I20260709 12:17:10.460625 20266 tablet_copy_source_session.cc:215] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.468036 21108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844fde759d84503859902ab6bf69cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.502496 21108 tablet_copy_client.cc:806] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.503222 21108 tablet_copy_client.cc:670] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.509676 21108 tablet_copy_client.cc:538] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:10.518452 21112 ts_tablet_manager.cc:933] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:10.522460 21112 tablet_copy_client.cc:323] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:10.524256 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet b58bdb95474c4f788fec380b260dc1be from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:10.524793 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet b58bdb95474c4f788fec380b260dc1be from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-b58bdb95474c4f788fec380b260dc1be
I20260709 12:17:10.528503 21108 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:10.535679 20266 tablet_copy_source_session.cc:215] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.544567 21112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58bdb95474c4f788fec380b260dc1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.565685 21112 tablet_copy_client.cc:806] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.566377 21112 tablet_copy_client.cc:670] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.569263 21108 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:10.570328 21108 tablet_bootstrap.cc:492] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:10.571028 21108 ts_tablet_manager.cc:1403] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.043s	user 0.031s	sys 0.002s
I20260709 12:17:10.571959 21112 tablet_copy_client.cc:538] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:10.574574 21108 raft_consensus.cc:359] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.575449 21108 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:10.576205 21108 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.582991 21112 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:10.625167 21112 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:10.627974 21112 tablet_bootstrap.cc:492] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:10.628856 21112 ts_tablet_manager.cc:1403] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.008s
I20260709 12:17:10.632320 21112 raft_consensus.cc:359] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.633266 21112 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:10.634016 21112 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.644767 21112 ts_tablet_manager.cc:1434] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 12:17:10.661459 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-b58bdb95474c4f788fec380b260dc1be received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:10.662226 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-b58bdb95474c4f788fec380b260dc1be on tablet b58bdb95474c4f788fec380b260dc1be with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:10.667203 21112 ts_tablet_manager.cc:933] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:10.675153 21112 tablet_copy_client.cc:323] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:10.706445 21108 ts_tablet_manager.cc:1434] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.135s	user 0.047s	sys 0.085s
I20260709 12:17:10.714831 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-5844fde759d84503859902ab6bf69cdc received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:10.715284 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-5844fde759d84503859902ab6bf69cdc on tablet 5844fde759d84503859902ab6bf69cdc with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:10.720321 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 8cacb9a2627045debeb7e4198ce2bcf7 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:10.720886 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 8cacb9a2627045debeb7e4198ce2bcf7 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-8cacb9a2627045debeb7e4198ce2bcf7
I20260709 12:17:10.729691 20340 tablet_copy_source_session.cc:215] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.733363 21112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cacb9a2627045debeb7e4198ce2bcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.748008 21108 ts_tablet_manager.cc:933] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:10.750118 21108 tablet_copy_client.cc:323] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.65:39563
I20260709 12:17:10.751402 21112 tablet_copy_client.cc:806] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.752104 21112 tablet_copy_client.cc:670] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.757326 21112 tablet_copy_client.cc:538] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:10.772663 21112 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:10.784638 20190 tablet_copy_service.cc:140] P f5c544fad8874e818acaad733a9d14f1: Received BeginTabletCopySession request for tablet 56046fd4231240119a75348ab3fc48d3 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:60784)
I20260709 12:17:10.785295 20190 tablet_copy_service.cc:161] P f5c544fad8874e818acaad733a9d14f1: Beginning new tablet copy session on tablet 56046fd4231240119a75348ab3fc48d3 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:60784: session id = 8aef67aa330543a191ab5ab5dc30e84c-56046fd4231240119a75348ab3fc48d3
I20260709 12:17:10.794247 20190 tablet_copy_source_session.cc:215] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.799391 21108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56046fd4231240119a75348ab3fc48d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.807490 21112 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:10.808630 21112 tablet_bootstrap.cc:492] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:10.809329 21112 ts_tablet_manager.cc:1403] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.004s
I20260709 12:17:10.812894 21112 raft_consensus.cc:359] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.813724 21112 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:10.814355 21112 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.816723 21112 ts_tablet_manager.cc:1434] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:10.818379 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-8cacb9a2627045debeb7e4198ce2bcf7 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:10.818864 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-8cacb9a2627045debeb7e4198ce2bcf7 on tablet 8cacb9a2627045debeb7e4198ce2bcf7 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:10.821341 21108 tablet_copy_client.cc:806] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.821943 21108 tablet_copy_client.cc:670] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.826924 21108 tablet_copy_client.cc:538] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:10.836440 21108 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:10.866817 21108 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:10.867815 21108 tablet_bootstrap.cc:492] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:10.868484 21108 ts_tablet_manager.cc:1403] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.010s
I20260709 12:17:10.871547 21108 raft_consensus.cc:359] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.872394 21108 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:10.873052 21108 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:10.875639 21108 ts_tablet_manager.cc:1434] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:17:10.877403 20190 tablet_copy_service.cc:342] P f5c544fad8874e818acaad733a9d14f1: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-56046fd4231240119a75348ab3fc48d3 received from {username='slave'} at 127.0.0.1:60784
I20260709 12:17:10.877861 20190 tablet_copy_service.cc:434] P f5c544fad8874e818acaad733a9d14f1: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-56046fd4231240119a75348ab3fc48d3 on tablet 56046fd4231240119a75348ab3fc48d3 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:11.037622 21043 raft_consensus.cc:1217] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:17:11.049937 21043 raft_consensus.cc:1217] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:11.101285 21043 raft_consensus.cc:1217] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:11.287880 21043 raft_consensus.cc:1217] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:11.466231 21089 raft_consensus.cc:1064] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:11.468904 21089 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:11.475613 21043 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:11.475919 20327 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:11.477028 20747 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:11.477872 21089 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.478425 20177 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:11.480057 21089 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.497668 21086 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.502300 20327 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.530150 20076 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.536777 21089 raft_consensus.cc:1064] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:11.540926 21089 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:11.556321 20174 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.589787 20174 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:11.590227 21043 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:11.593322 20323 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:11.600963 21139 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:11.607936 20747 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.611002 20747 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.611188 21043 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.639601 21078 raft_consensus.cc:1064] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:11.641705 20254 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:11.648710 21134 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.647816 21078 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:11.663095 20172 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:11.666741 21086 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.687028 21041 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.699422 21133 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:11.723161 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44609us
I20260709 12:17:11.730432 21040 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.732409 21097 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:11.732698 20172 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.735139 21042 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:11.786896 20249 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.790978 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5844fde759d84503859902ab6bf69cdc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:11.791890 21133 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.795148 21097 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.798427 21042 raft_consensus.cc:2955] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.804018 20176 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.817373 20174 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.822748 20327 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.828069 21078 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.829798 20078 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.848412 20075 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:11.873850 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49666.9us
I20260709 12:17:11.911813 20940 raft_consensus.cc:1064] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:11.915263 20940 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:11.924939 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 89621us
I20260709 12:17:11.935773 20254 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:11.952179 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 5844fde759d84503859902ab6bf69cdc with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:11.955193 21043 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:11.955500 21042 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.955292 20254 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.959064 20321 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:11.966336 21107 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:11.967470 21132 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:11.970348 21150 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:11.984622 21135 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.991336 21042 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.001371 20327 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:12.008968 21126 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:17:12.011688 21157 tablet_replica.cc:333] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:12.013005 21157 raft_consensus.cc:2243] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.028298 21157 raft_consensus.cc:2272] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.035586 20255 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.047935 21134 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.067037 21043 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.067510 20171 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.082782 21157 ts_tablet_manager.cc:1916] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.111882 21126 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:12.117836 20078 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.118880 20321 raft_consensus.cc:2955] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.164170 21146 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.168807 21041 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.174042 21157 ts_tablet_manager.cc:1929] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:12.175247 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b58bdb95474c4f788fec380b260dc1be with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:12.174626 21157 log.cc:1199] T 5844fde759d84503859902ab6bf69cdc P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/5844fde759d84503859902ab6bf69cdc
I20260709 12:17:12.188295 20325 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:12.190759 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 5844fde759d84503859902ab6bf69cdc (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:12.202847 20074 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.204643 20171 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.206996 21147 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.207553 20321 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.222244 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet b58bdb95474c4f788fec380b260dc1be with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:12.221992 21149 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.238627 21041 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.239616 20078 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.240746 20247 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.245023 21152 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.256342 21041 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.257910 20171 raft_consensus.cc:2955] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.281200 21161 tablet_replica.cc:333] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:12.282363 21161 raft_consensus.cc:2243] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.283176 21161 raft_consensus.cc:2272] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.285835 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8cacb9a2627045debeb7e4198ce2bcf7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:12.290565 20073 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.304211 20171 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:12.304800 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cacb9a2627045debeb7e4198ce2bcf7 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:12.307483 21161 ts_tablet_manager.cc:1916] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.311812 21041 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.313465 21162 tablet_replica.cc:333] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:12.313369 21146 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:12.323177 20321 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.329674 21146 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.332121 21041 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.338011 21126 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.343848 20064 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56046fd4231240119a75348ab3fc48d3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:12.349059 20325 raft_consensus.cc:2955] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:12.314594 21162 raft_consensus.cc:2243] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.353770 20077 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.359783 21162 raft_consensus.cc:2272] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.366681 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 56046fd4231240119a75348ab3fc48d3 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:12.370584 21161 ts_tablet_manager.cc:1929] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:17:12.371062 21161 log.cc:1199] T b58bdb95474c4f788fec380b260dc1be P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/b58bdb95474c4f788fec380b260dc1be
I20260709 12:17:12.372913 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet b58bdb95474c4f788fec380b260dc1be (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:12.380525 21162 ts_tablet_manager.cc:1916] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.397380 21162 ts_tablet_manager.cc:1929] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:12.397789 21162 log.cc:1199] T 8cacb9a2627045debeb7e4198ce2bcf7 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/8cacb9a2627045debeb7e4198ce2bcf7
I20260709 12:17:12.399369 21162 tablet_replica.cc:333] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:12.399310 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 8cacb9a2627045debeb7e4198ce2bcf7 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:12.400646 21162 raft_consensus.cc:2243] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.401396 21162 raft_consensus.cc:2272] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.404424 21162 ts_tablet_manager.cc:1916] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.417709 21162 ts_tablet_manager.cc:1929] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:12.418107 21162 log.cc:1199] T 56046fd4231240119a75348ab3fc48d3 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/56046fd4231240119a75348ab3fc48d3
I20260709 12:17:12.419746 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 56046fd4231240119a75348ab3fc48d3 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:13.450281 20255 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:13.456991 20321 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:17:13.457496 20219 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2810bc1c814f432184fd2110cf8b6e45. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.457707 20171 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:13.458416 21086 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.459919 21135 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.467387 21086 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.469481 20321 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.471419 20177 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.491237 20077 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.496569 20255 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:13.590088 20325 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:13.590027 20219 consensus_peers.cc:597] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53fc708954624727a65ab4485d1a2285. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.594202 21086 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.597327 20171 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:13.600198 21086 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.616976 21176 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.618788 20325 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.631063 20176 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.634145 20327 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:13.639146 20077 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.650331 20171 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:13.653298 20255 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:13.659667 20294 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff822ba5f5ad4f8c87f6018de9072cfb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.659745 21097 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.662484 21097 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.673051 21147 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.674546 20255 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.677562 20171 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.695729 20176 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:13.697861 20077 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.702193 20325 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:13.706017 20255 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:13.707408 21167 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:13.708453 20144 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94d92f1167e6425dbdcc7276bd1de9b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.709573 21167 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:13.721426 21169 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.723521 20325 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.738511 20254 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:13.743309 20078 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.956489 21186 ts_tablet_manager.cc:933] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:13.958565 21186 tablet_copy_client.cc:323] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:13.961478 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 53fc708954624727a65ab4485d1a2285 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:13.962011 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 53fc708954624727a65ab4485d1a2285 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-53fc708954624727a65ab4485d1a2285
I20260709 12:17:13.970088 20266 tablet_copy_source_session.cc:215] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:13.973596 21186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fc708954624727a65ab4485d1a2285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:13.997495 21186 tablet_copy_client.cc:806] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:13.998093 21186 tablet_copy_client.cc:670] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.002051 21186 tablet_copy_client.cc:538] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.011394 21186 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:14.035243 21186 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.036235 21186 tablet_bootstrap.cc:492] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:14.036972 21186 ts_tablet_manager.cc:1403] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.026s	user 0.025s	sys 0.001s
I20260709 12:17:14.041486 21186 raft_consensus.cc:359] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.042405 21186 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:14.043082 21186 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.063580 21190 ts_tablet_manager.cc:933] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:14.074923 21190 tablet_copy_client.cc:323] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:14.078794 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 2810bc1c814f432184fd2110cf8b6e45 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:14.079370 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 2810bc1c814f432184fd2110cf8b6e45 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-2810bc1c814f432184fd2110cf8b6e45
I20260709 12:17:14.094787 20266 tablet_copy_source_session.cc:215] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.110697 21190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2810bc1c814f432184fd2110cf8b6e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.187834 21192 ts_tablet_manager.cc:933] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:14.210824 21186 ts_tablet_manager.cc:1434] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.174s	user 0.052s	sys 0.116s
I20260709 12:17:14.212246 21192 tablet_copy_client.cc:323] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.65:39563
I20260709 12:17:14.214658 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-53fc708954624727a65ab4485d1a2285 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:14.215087 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-53fc708954624727a65ab4485d1a2285 on tablet 53fc708954624727a65ab4485d1a2285 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:14.214651 20190 tablet_copy_service.cc:140] P f5c544fad8874e818acaad733a9d14f1: Received BeginTabletCopySession request for tablet 94d92f1167e6425dbdcc7276bd1de9b7 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:60784)
I20260709 12:17:14.217100 20190 tablet_copy_service.cc:161] P f5c544fad8874e818acaad733a9d14f1: Beginning new tablet copy session on tablet 94d92f1167e6425dbdcc7276bd1de9b7 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:60784: session id = 8aef67aa330543a191ab5ab5dc30e84c-94d92f1167e6425dbdcc7276bd1de9b7
I20260709 12:17:14.226492 20190 tablet_copy_source_session.cc:215] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.233533 21192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d92f1167e6425dbdcc7276bd1de9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.238022 21190 tablet_copy_client.cc:806] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.238763 21190 tablet_copy_client.cc:670] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.243984 21190 tablet_copy_client.cc:538] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.263726 21186 ts_tablet_manager.cc:933] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:14.263909 21190 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:14.274590 21186 tablet_copy_client.cc:323] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:14.276356 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet ff822ba5f5ad4f8c87f6018de9072cfb from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:14.276939 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet ff822ba5f5ad4f8c87f6018de9072cfb from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-ff822ba5f5ad4f8c87f6018de9072cfb
I20260709 12:17:14.279809 21192 tablet_copy_client.cc:806] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.280416 21192 tablet_copy_client.cc:670] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.285324 20340 tablet_copy_source_session.cc:215] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.285461 21192 tablet_copy_client.cc:538] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.289848 21186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff822ba5f5ad4f8c87f6018de9072cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.296175 21192 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:14.309710 21186 tablet_copy_client.cc:806] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.310523 21186 tablet_copy_client.cc:670] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.314512 21186 tablet_copy_client.cc:538] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.328132 21186 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:14.332012 21190 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.333114 21190 tablet_bootstrap.cc:492] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:14.333870 21190 ts_tablet_manager.cc:1403] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.009s
I20260709 12:17:14.337414 21190 raft_consensus.cc:359] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.338356 21190 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:14.339143 21190 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.340874 21192 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.341790 21192 tablet_bootstrap.cc:492] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:14.342484 21192 ts_tablet_manager.cc:1403] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.015s
I20260709 12:17:14.346709 21192 raft_consensus.cc:359] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.347939 21192 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:14.348748 21192 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.351877 21192 ts_tablet_manager.cc:1434] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:14.354375 20190 tablet_copy_service.cc:342] P f5c544fad8874e818acaad733a9d14f1: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-94d92f1167e6425dbdcc7276bd1de9b7 received from {username='slave'} at 127.0.0.1:60784
I20260709 12:17:14.354776 20190 tablet_copy_service.cc:434] P f5c544fad8874e818acaad733a9d14f1: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-94d92f1167e6425dbdcc7276bd1de9b7 on tablet 94d92f1167e6425dbdcc7276bd1de9b7 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:14.365696 21190 ts_tablet_manager.cc:1434] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:17:14.367631 21186 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.368505 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-2810bc1c814f432184fd2110cf8b6e45 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:14.368647 21186 tablet_bootstrap.cc:492] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:14.369010 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-2810bc1c814f432184fd2110cf8b6e45 on tablet 2810bc1c814f432184fd2110cf8b6e45 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:14.369477 21186 ts_tablet_manager.cc:1403] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.013s
I20260709 12:17:14.372634 21186 raft_consensus.cc:359] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.373472 21186 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:14.374110 21186 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:14.376539 21186 ts_tablet_manager.cc:1434] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:14.378286 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-ff822ba5f5ad4f8c87f6018de9072cfb received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:14.378715 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-ff822ba5f5ad4f8c87f6018de9072cfb on tablet ff822ba5f5ad4f8c87f6018de9072cfb with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:14.472648 21041 raft_consensus.cc:1217] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:14.557328 21043 raft_consensus.cc:1217] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 12:17:14.561153 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 81641.7us
I20260709 12:17:14.664045 21043 raft_consensus.cc:1217] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:14.744479 21043 raft_consensus.cc:1217] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:15.015235 21086 raft_consensus.cc:1064] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:15.017705 21086 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.024394 21043 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.026355 21201 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.032603 20327 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.032786 20176 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.034134 21201 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.038060 21201 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.047418 21202 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.052691 21043 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.056368 21086 raft_consensus.cc:1064] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:15.069602 21086 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.073146 20171 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.082854 20327 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.083734 21043 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.083364 20074 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.084430 21132 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.089821 21132 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.100917 20176 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.147758 21176 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.198939 20325 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.213774 21203 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.230269 20323 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.237133 20172 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.266027 21043 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.272190 21147 raft_consensus.cc:1064] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:15.275079 21147 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.281544 20255 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.286480 21168 raft_consensus.cc:1064] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:15.299404 20078 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.298624 21168 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.305490 21041 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.306609 20323 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.309661 21132 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.313359 21202 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.317641 21175 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.325822 20323 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.326537 20254 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.334141 20172 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:15.336025 21203 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.339771 21042 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.343617 20176 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.345281 21132 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.347846 20254 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.352026 21097 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.353410 20172 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.354941 21097 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.356565 21097 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.367098 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53fc708954624727a65ab4485d1a2285 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.371963 21042 raft_consensus.cc:2955] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.375979 20073 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.389286 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 53fc708954624727a65ab4485d1a2285 with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:15.396142 21221 tablet_replica.cc:333] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:15.398101 21221 raft_consensus.cc:2243] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.407229 21041 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:15.413988 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2810bc1c814f432184fd2110cf8b6e45 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.414407 21221 raft_consensus.cc:2272] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.418123 21221 ts_tablet_manager.cc:1916] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.422014 21203 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.433434 21041 raft_consensus.cc:2955] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.468545 20323 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.472661 21040 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.485872 21199 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:15.488767 21199 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.488463 21040 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.511078 20177 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.546319 20073 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.492367 21147 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.578778 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 2810bc1c814f432184fd2110cf8b6e45 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:15.575558 20077 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.590955 20255 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.614792 21221 ts_tablet_manager.cc:1929] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:15.615329 21221 log.cc:1199] T 53fc708954624727a65ab4485d1a2285 P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/53fc708954624727a65ab4485d1a2285
I20260709 12:17:15.619846 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 53fc708954624727a65ab4485d1a2285 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:15.620538 21168 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.622073 21227 tablet_replica.cc:333] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:15.627954 20255 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.653842 20321 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.662065 21227 raft_consensus.cc:2243] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.664280 21227 raft_consensus.cc:2272] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.668452 21227 ts_tablet_manager.cc:1916] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.667661 21223 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.674362 21042 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.685915 21041 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.685436 20327 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.701799 20177 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.687450 21147 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.718268 20074 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.724340 21229 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.727219 21227 ts_tablet_manager.cc:1929] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:15.727775 21227 log.cc:1199] T 2810bc1c814f432184fd2110cf8b6e45 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/2810bc1c814f432184fd2110cf8b6e45
I20260709 12:17:15.729427 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 2810bc1c814f432184fd2110cf8b6e45 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:15.732137 20254 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.736514 21229 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.742280 21042 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.744141 20176 raft_consensus.cc:2955] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.761500 20177 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:15.767190 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff822ba5f5ad4f8c87f6018de9072cfb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.767516 20254 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:15.767539 21041 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:15.769372 21223 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.771235 21223 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.777294 20078 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.789103 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet ff822ba5f5ad4f8c87f6018de9072cfb with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:15.790097 21168 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.798023 21042 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.819535 21232 tablet_replica.cc:333] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:15.821769 20064 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94d92f1167e6425dbdcc7276bd1de9b7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.822012 21232 raft_consensus.cc:2243] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.822754 21232 raft_consensus.cc:2272] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.826203 21232 ts_tablet_manager.cc:1916] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.829319 20077 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.835269 20254 raft_consensus.cc:2955] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:15.852677 21232 ts_tablet_manager.cc:1929] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:15.853879 21232 log.cc:1199] T ff822ba5f5ad4f8c87f6018de9072cfb P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/ff822ba5f5ad4f8c87f6018de9072cfb
I20260709 12:17:15.855706 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 94d92f1167e6425dbdcc7276bd1de9b7 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:15.856719 21227 tablet_replica.cc:333] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:15.857764 21227 raft_consensus.cc:2243] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.858568 21227 raft_consensus.cc:2272] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.861478 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet ff822ba5f5ad4f8c87f6018de9072cfb (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:15.863368 21227 ts_tablet_manager.cc:1916] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.885119 21227 ts_tablet_manager.cc:1929] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:15.885578 21227 log.cc:1199] T 94d92f1167e6425dbdcc7276bd1de9b7 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/94d92f1167e6425dbdcc7276bd1de9b7
I20260709 12:17:15.887145 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 94d92f1167e6425dbdcc7276bd1de9b7 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:16.947726 20327 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:17:16.954170 20294 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04d32aa1a8cf46979742c1fb0beb8b2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.955610 20254 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:16.955907 20172 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:16.956879 21147 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:16.957697 21229 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:16.965372 21229 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:16.966945 20172 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:16.968957 20254 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:16.986423 20077 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.007436 20327 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.014878 20254 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:17.015064 20294 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d378f8e2f934dcc8adcad8d5c71b573. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.015347 20172 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.016752 21237 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.019460 21238 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.037983 21237 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.040279 20254 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.041599 20172 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.053925 20255 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.062989 20078 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:17.070104 20219 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02f2bc2263db420a815ba46efc7bf818. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.071415 20172 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.071702 20327 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.073079 21203 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.074040 21176 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.095079 21086 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.099692 20177 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.108564 20321 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.124320 20255 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.124981 20074 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:17:17.143523 20219 consensus_peers.cc:597] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce44adc86d94477297f0d6521f9cb48b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.145205 20177 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.146488 21176 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.148391 20321 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.149763 21176 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.156055 21086 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.157526 20177 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.160043 20321 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.178625 20077 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:17.458571 21253 ts_tablet_manager.cc:933] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:17.460759 21253 tablet_copy_client.cc:323] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:17.462383 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 04d32aa1a8cf46979742c1fb0beb8b2c from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:17.462958 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 04d32aa1a8cf46979742c1fb0beb8b2c from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-04d32aa1a8cf46979742c1fb0beb8b2c
I20260709 12:17:17.469496 20340 tablet_copy_source_session.cc:215] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.473563 21253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d32aa1a8cf46979742c1fb0beb8b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.496609 21253 tablet_copy_client.cc:806] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.497357 21253 tablet_copy_client.cc:670] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.502838 21255 ts_tablet_manager.cc:933] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:17.503017 21253 tablet_copy_client.cc:538] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.505126 21255 tablet_copy_client.cc:323] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:17.506842 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 0d378f8e2f934dcc8adcad8d5c71b573 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:17.507396 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 0d378f8e2f934dcc8adcad8d5c71b573 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-0d378f8e2f934dcc8adcad8d5c71b573
I20260709 12:17:17.515247 20340 tablet_copy_source_session.cc:215] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.515354 21253 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:17.519083 21255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d378f8e2f934dcc8adcad8d5c71b573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.571049 21258 ts_tablet_manager.cc:933] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:17.575728 21255 tablet_copy_client.cc:806] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.577929 21255 tablet_copy_client.cc:670] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.582736 21255 tablet_copy_client.cc:538] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.584867 21257 ts_tablet_manager.cc:933] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:17.590112 21258 tablet_copy_client.cc:323] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:17.592741 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 02f2bc2263db420a815ba46efc7bf818 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:17.593502 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 02f2bc2263db420a815ba46efc7bf818 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-02f2bc2263db420a815ba46efc7bf818
I20260709 12:17:17.605150 21255 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:17.607988 20266 tablet_copy_source_session.cc:215] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.616216 21253 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.623679 21253 tablet_bootstrap.cc:492] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:17.624580 21253 ts_tablet_manager.cc:1403] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.111s	user 0.040s	sys 0.043s
I20260709 12:17:17.624980 21258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f2bc2263db420a815ba46efc7bf818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.619670 21257 tablet_copy_client.cc:323] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:17.632917 21253 raft_consensus.cc:359] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.633913 21253 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:17.634655 21253 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.655450 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet ce44adc86d94477297f0d6521f9cb48b from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:17.671751 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet ce44adc86d94477297f0d6521f9cb48b from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-ce44adc86d94477297f0d6521f9cb48b
I20260709 12:17:17.694446 21253 ts_tablet_manager.cc:1434] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.069s	user 0.031s	sys 0.028s
I20260709 12:17:17.700480 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-04d32aa1a8cf46979742c1fb0beb8b2c received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:17.700959 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-04d32aa1a8cf46979742c1fb0beb8b2c on tablet 04d32aa1a8cf46979742c1fb0beb8b2c with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:17.705197 20266 tablet_copy_source_session.cc:215] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.708524 21255 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.708946 21257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce44adc86d94477297f0d6521f9cb48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.715500 21258 tablet_copy_client.cc:806] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.716171 21258 tablet_copy_client.cc:670] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.720655 21258 tablet_copy_client.cc:538] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.724371 21255 tablet_bootstrap.cc:492] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:17.725234 21255 ts_tablet_manager.cc:1403] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.122s	user 0.026s	sys 0.036s
I20260709 12:17:17.730268 21258 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:17.731809 21257 tablet_copy_client.cc:806] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.732465 21257 tablet_copy_client.cc:670] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.740211 21255 raft_consensus.cc:359] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.741201 21255 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:17.742022 21255 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.753024 21257 tablet_copy_client.cc:538] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.752745 21255 ts_tablet_manager.cc:1434] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:17:17.760221 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-0d378f8e2f934dcc8adcad8d5c71b573 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:17.760675 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-0d378f8e2f934dcc8adcad8d5c71b573 on tablet 0d378f8e2f934dcc8adcad8d5c71b573 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:17.781314 21257 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:17.784133 21258 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.785164 21258 tablet_bootstrap.cc:492] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:17.785892 21258 ts_tablet_manager.cc:1403] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.056s	user 0.030s	sys 0.008s
I20260709 12:17:17.792162 21258 raft_consensus.cc:359] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.793473 21258 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:17.794150 21258 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.799448 21258 ts_tablet_manager.cc:1434] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:17:17.802950 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-02f2bc2263db420a815ba46efc7bf818 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:17.803378 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-02f2bc2263db420a815ba46efc7bf818 on tablet 02f2bc2263db420a815ba46efc7bf818 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:17.818262 21257 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.822688 21257 tablet_bootstrap.cc:492] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:17.823418 21257 ts_tablet_manager.cc:1403] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.000s
I20260709 12:17:17.826269 21257 raft_consensus.cc:359] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.826893 21257 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:17.827643 21257 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:17.830081 21257 ts_tablet_manager.cc:1434] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:17:17.832739 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-ce44adc86d94477297f0d6521f9cb48b received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:17.833108 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-ce44adc86d94477297f0d6521f9cb48b on tablet ce44adc86d94477297f0d6521f9cb48b with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:17.899165 21042 raft_consensus.cc:1217] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:17.959468 21042 raft_consensus.cc:1217] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:17.998761 21041 raft_consensus.cc:1217] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:18.075831 21041 raft_consensus.cc:1217] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:18.452606 21263 raft_consensus.cc:1064] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:18.453215 21203 raft_consensus.cc:1064] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:18.455787 21203 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.456463 21263 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.467434 21041 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.469167 20327 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.470539 21176 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.473228 20177 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.474429 21041 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.475385 21263 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.476294 21203 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.477726 21262 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.484413 20172 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.488231 20255 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.493711 21262 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.492251 21203 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.521664 21262 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.524017 20254 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.529521 21263 raft_consensus.cc:1064] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:18.532023 21263 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.544535 20074 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.558169 21042 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.552354 20177 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.559738 21263 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.560104 20176 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.561589 21238 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.563954 20255 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.562952 21268 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.565778 21273 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.580055 20327 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.589269 21040 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.600590 20171 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.626721 21041 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.658569 21285 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.661856 20254 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:18.687902 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 58006.5us
I20260709 12:17:18.703521 21042 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.705466 20178 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.751068 21288 raft_consensus.cc:1064] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:18.753023 20078 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.755916 21288 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.776791 21041 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.778805 20323 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.779793 20176 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.781598 21292 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.781354 20077 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.783152 21288 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.787457 20323 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.792613 21041 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.793406 21292 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.794373 21262 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.794842 20254 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.796953 21272 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.812664 21272 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.818584 21041 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.835418 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04d32aa1a8cf46979742c1fb0beb8b2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:18.825131 20254 raft_consensus.cc:2955] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.845009 21292 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.846629 20327 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.847841 20323 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.839540 20255 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.858532 21042 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.859869 20325 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.860491 21288 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.862851 21287 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.864414 21042 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.872812 21176 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.882645 20323 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.888432 20073 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:18.897938 21041 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.899135 20177 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.900472 21238 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.901926 21262 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.902534 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce44adc86d94477297f0d6521f9cb48b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:18.909642 21238 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.908586 21042 raft_consensus.cc:2955] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.913700 20177 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.917989 20178 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.930418 21041 raft_consensus.cc:2955] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.941322 20078 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.944380 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d378f8e2f934dcc8adcad8d5c71b573 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:18.955302 20077 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.956419 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 04d32aa1a8cf46979742c1fb0beb8b2c with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:18.955286 20073 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:18.962126 21299 tablet_replica.cc:333] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:18.963375 21299 raft_consensus.cc:2243] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:18.964169 21299 raft_consensus.cc:2272] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:18.968791 21299 ts_tablet_manager.cc:1916] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:18.971994 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet ce44adc86d94477297f0d6521f9cb48b with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:18.974058 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d378f8e2f934dcc8adcad8d5c71b573 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:18.976922 20254 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:18.983686 21041 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.985045 21292 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.985414 20178 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:18.987030 21292 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.994562 21176 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.996845 21299 ts_tablet_manager.cc:1929] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:18.998016 20178 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:19.002315 21041 raft_consensus.cc:2955] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:18.997298 21299 log.cc:1199] T 04d32aa1a8cf46979742c1fb0beb8b2c P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/04d32aa1a8cf46979742c1fb0beb8b2c
I20260709 12:17:19.006815 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 04d32aa1a8cf46979742c1fb0beb8b2c (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:19.015615 21301 tablet_replica.cc:333] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:19.017706 21299 tablet_replica.cc:333] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:19.019233 21301 raft_consensus.cc:2243] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.020751 21299 raft_consensus.cc:2243] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.022948 21299 raft_consensus.cc:2272] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.028342 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02f2bc2263db420a815ba46efc7bf818 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.038528 21299 ts_tablet_manager.cc:1916] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.041118 21301 raft_consensus.cc:2272] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.041904 20073 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:19.049906 21301 ts_tablet_manager.cc:1916] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.058919 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f2bc2263db420a815ba46efc7bf818 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:19.073349 21301 ts_tablet_manager.cc:1929] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.073912 21301 log.cc:1199] T 0d378f8e2f934dcc8adcad8d5c71b573 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/0d378f8e2f934dcc8adcad8d5c71b573
I20260709 12:17:19.076503 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 0d378f8e2f934dcc8adcad8d5c71b573 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:19.077700 21299 ts_tablet_manager.cc:1929] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.078203 21299 log.cc:1199] T ce44adc86d94477297f0d6521f9cb48b P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/ce44adc86d94477297f0d6521f9cb48b
I20260709 12:17:19.078305 21302 tablet_replica.cc:333] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:19.080814 21302 raft_consensus.cc:2243] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.081789 21302 raft_consensus.cc:2272] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.080780 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet ce44adc86d94477297f0d6521f9cb48b (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:19.085173 21302 ts_tablet_manager.cc:1916] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.096941 21302 ts_tablet_manager.cc:1929] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.097259 21302 log.cc:1199] T 02f2bc2263db420a815ba46efc7bf818 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/02f2bc2263db420a815ba46efc7bf818
I20260709 12:17:19.098618 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 02f2bc2263db420a815ba46efc7bf818 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:20.142164 20255 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.150563 20321 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:20.150920 20177 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:17:20.152196 20219 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98e8de971f5342ac94652edf51dd27ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.152747 21304 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:20.153848 21176 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:20.162364 21306 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.163648 20177 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.164346 20321 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.184332 20073 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.191349 20321 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.200558 20254 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:20.200695 20177 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:20.202396 21272 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:20.203375 21285 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:20.204790 20294 consensus_peers.cc:597] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ebc8da2a63b4daeb972508fd248a6f2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.227281 21272 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.232924 20254 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.250473 20177 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.268432 20323 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.271139 20077 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.277550 20254 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:20.278316 20294 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a145c5f943d84d5eade056f80c775a0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.279135 21272 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:20.279920 20177 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:20.281353 21311 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:20.306492 21272 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.309827 20254 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.315836 20178 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.325655 20255 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.326654 20074 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.345099 20321 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:20.345594 20219 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c5dfa3335ec44bcb98beeec64591f01. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.346473 21306 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:20.352810 20178 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:20.354357 21304 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:20.355842 21176 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.362747 20321 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.370347 20177 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:20.390460 20077 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.584964 21323 ts_tablet_manager.cc:933] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:20.588231 21323 tablet_copy_client.cc:323] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:20.590132 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 98e8de971f5342ac94652edf51dd27ef from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:20.590745 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 98e8de971f5342ac94652edf51dd27ef from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-98e8de971f5342ac94652edf51dd27ef
I20260709 12:17:20.599912 20266 tablet_copy_source_session.cc:215] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:20.606967 21323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e8de971f5342ac94652edf51dd27ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:20.629706 21323 tablet_copy_client.cc:806] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:20.631012 21323 tablet_copy_client.cc:670] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:20.635361 21323 tablet_copy_client.cc:538] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:20.645849 21323 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:20.670774 21323 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:20.671823 21323 tablet_bootstrap.cc:492] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:20.672523 21323 ts_tablet_manager.cc:1403] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.027s	user 0.023s	sys 0.004s
I20260709 12:17:20.675920 21323 raft_consensus.cc:359] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.676797 21323 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:20.677557 21323 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.710455 21323 ts_tablet_manager.cc:1434] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.038s	user 0.019s	sys 0.017s
I20260709 12:17:20.712692 21327 ts_tablet_manager.cc:933] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:20.712852 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-98e8de971f5342ac94652edf51dd27ef received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:20.713402 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-98e8de971f5342ac94652edf51dd27ef on tablet 98e8de971f5342ac94652edf51dd27ef with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:20.720463 21327 tablet_copy_client.cc:323] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:20.722545 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet a145c5f943d84d5eade056f80c775a0e from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:20.723078 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet a145c5f943d84d5eade056f80c775a0e from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-a145c5f943d84d5eade056f80c775a0e
I20260709 12:17:20.726284 21323 ts_tablet_manager.cc:933] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:20.728685 21323 tablet_copy_client.cc:323] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:20.730615 20339 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 6ebc8da2a63b4daeb972508fd248a6f2 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:20.731174 20339 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 6ebc8da2a63b4daeb972508fd248a6f2 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-6ebc8da2a63b4daeb972508fd248a6f2
I20260709 12:17:20.731993 20340 tablet_copy_source_session.cc:215] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:20.735721 21327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a145c5f943d84d5eade056f80c775a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:20.742183 20339 tablet_copy_source_session.cc:215] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:20.745385 21323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebc8da2a63b4daeb972508fd248a6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:20.752153 21327 tablet_copy_client.cc:806] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:20.752790 21327 tablet_copy_client.cc:670] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:20.763041 21327 tablet_copy_client.cc:538] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:20.771694 21323 tablet_copy_client.cc:806] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:20.772423 21323 tablet_copy_client.cc:670] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:20.775874 21327 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:20.778271 21323 tablet_copy_client.cc:538] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:20.793411 21323 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:20.799193 21327 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:20.800266 21327 tablet_bootstrap.cc:492] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:20.801033 21327 ts_tablet_manager.cc:1403] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.013s
I20260709 12:17:20.805580 21327 raft_consensus.cc:359] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.806509 21327 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:20.807281 21327 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.810725 21327 ts_tablet_manager.cc:1434] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:17:20.815498 20339 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-a145c5f943d84d5eade056f80c775a0e received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:20.815953 20339 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-a145c5f943d84d5eade056f80c775a0e on tablet a145c5f943d84d5eade056f80c775a0e with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:20.826001 21323 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:20.827040 21323 tablet_bootstrap.cc:492] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:20.827816 21323 ts_tablet_manager.cc:1403] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.007s
I20260709 12:17:20.830866 21323 raft_consensus.cc:359] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.831733 21323 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:20.832406 21323 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.835079 21323 ts_tablet_manager.cc:1434] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:20.841414 20339 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-6ebc8da2a63b4daeb972508fd248a6f2 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:20.841853 20339 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-6ebc8da2a63b4daeb972508fd248a6f2 on tablet 6ebc8da2a63b4daeb972508fd248a6f2 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:20.857420 21323 ts_tablet_manager.cc:933] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:20.860826 21323 tablet_copy_client.cc:323] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:20.865243 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 6c5dfa3335ec44bcb98beeec64591f01 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:20.865764 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 6c5dfa3335ec44bcb98beeec64591f01 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-6c5dfa3335ec44bcb98beeec64591f01
I20260709 12:17:20.872887 20266 tablet_copy_source_session.cc:215] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:20.875689 21323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5dfa3335ec44bcb98beeec64591f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:20.892204 21323 tablet_copy_client.cc:806] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:20.892717 21323 tablet_copy_client.cc:670] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:20.896966 21323 tablet_copy_client.cc:538] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:20.902349 21323 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:20.922254 21323 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:20.923146 21323 tablet_bootstrap.cc:492] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:20.923846 21323 ts_tablet_manager.cc:1403] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.005s
I20260709 12:17:20.927089 21323 raft_consensus.cc:359] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.927906 21323 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:20.928508 21323 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:20.930683 21323 ts_tablet_manager.cc:1434] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:17:20.932518 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-6c5dfa3335ec44bcb98beeec64591f01 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:20.932930 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-6c5dfa3335ec44bcb98beeec64591f01 on tablet 6c5dfa3335ec44bcb98beeec64591f01 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:21.010200 21041 raft_consensus.cc:1217] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:21.057607 21041 raft_consensus.cc:1217] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:21.178107 21041 raft_consensus.cc:1217] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:21.293932 21041 raft_consensus.cc:1217] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:21.409686 21306 raft_consensus.cc:1064] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:21.412654 21306 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.423313 21041 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:21.425889 21306 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:21.429891 20178 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:21.431293 20327 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:21.436573 21304 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.437557 21287 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.446333 21287 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.453868 20177 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.457429 20327 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.463352 21041 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.472993 20074 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:21.544529 20255 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.551973 20178 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:21.552095 21041 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:21.554073 21306 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:21.556034 21287 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:21.565423 21304 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.571578 20178 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.569912 21041 raft_consensus.cc:2955] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.589489 21311 raft_consensus.cc:1064] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:21.596778 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98e8de971f5342ac94652edf51dd27ef with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:21.602671 20074 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 4 to 5, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.608022 21311 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.614318 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e8de971f5342ac94652edf51dd27ef with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:21.648428 21344 tablet_replica.cc:333] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:21.650516 21344 raft_consensus.cc:2243] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:21.648613 21346 raft_consensus.cc:1064] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:21.651346 21344 raft_consensus.cc:2272] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:21.659370 21041 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.660996 21272 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.661283 21344 ts_tablet_manager.cc:1916] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:21.662561 21346 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.672683 20255 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.674259 21311 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.674566 20177 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.677572 21272 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.685992 20178 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.687668 20255 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.689580 21345 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.696695 21344 ts_tablet_manager.cc:1929] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:21.696655 21346 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:21.697409 21344 log.cc:1199] T 98e8de971f5342ac94652edf51dd27ef P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/98e8de971f5342ac94652edf51dd27ef
I20260709 12:17:21.687980 21041 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.701182 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 98e8de971f5342ac94652edf51dd27ef (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:21.702621 21346 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:21.717341 21311 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.720203 20255 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.720559 21345 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.720539 20177 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.724303 20254 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.741216 20077 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.749581 20178 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.749650 21041 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.761965 20078 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:21.770588 21042 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.792850 20324 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.799166 21040 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:21.800659 21285 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.812170 21311 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.816192 21040 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.820180 20324 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.826841 20178 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:21.828357 21345 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.829766 20254 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:21.833154 21304 raft_consensus.cc:1064] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:21.837179 21346 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:21.840415 21304 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:21.844274 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a145c5f943d84d5eade056f80c775a0e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:21.849987 20073 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:21.856194 21040 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.859041 20171 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.860675 21306 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.863600 20324 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:21.864501 21332 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:21.869757 21332 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.870268 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet a145c5f943d84d5eade056f80c775a0e with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:21.883684 20176 raft_consensus.cc:2955] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.898236 21311 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.922286 21357 tablet_replica.cc:333] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:21.926640 21357 raft_consensus.cc:2243] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:21.927522 21357 raft_consensus.cc:2272] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:21.944912 21357 ts_tablet_manager.cc:1916] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:21.944952 21043 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:21.949012 20255 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:21.967517 21357 ts_tablet_manager.cc:1929] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:21.970327 21357 log.cc:1199] T a145c5f943d84d5eade056f80c775a0e P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/a145c5f943d84d5eade056f80c775a0e
I20260709 12:17:21.971812 20078 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:21.987818 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ebc8da2a63b4daeb972508fd248a6f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:21.987980 21311 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:21.994899 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ebc8da2a63b4daeb972508fd248a6f2 with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:21.997254 21362 tablet_replica.cc:333] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:22.000775 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet a145c5f943d84d5eade056f80c775a0e (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:22.002835 21361 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.007472 20177 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.019826 21040 raft_consensus.cc:2955] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.025131 21043 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.030001 20078 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.055197 21362 raft_consensus.cc:2243] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:22.056030 21362 raft_consensus.cc:2272] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:22.064110 21362 ts_tablet_manager.cc:1916] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:22.096465 21362 ts_tablet_manager.cc:1929] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:22.101148 21362 log.cc:1199] T 6ebc8da2a63b4daeb972508fd248a6f2 P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/6ebc8da2a63b4daeb972508fd248a6f2
I20260709 12:17:22.103672 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 6ebc8da2a63b4daeb972508fd248a6f2 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:22.106050 20324 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.113114 20255 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:22.126205 20176 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:22.131881 21361 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.132326 21040 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:22.134455 21332 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.140057 21306 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.146147 21040 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.146255 20176 raft_consensus.cc:2955] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.161063 20073 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:22.162348 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c5dfa3335ec44bcb98beeec64591f01 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:22.180521 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c5dfa3335ec44bcb98beeec64591f01 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:22.181563 21344 tablet_replica.cc:333] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:22.182638 21344 raft_consensus.cc:2243] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:22.183427 21344 raft_consensus.cc:2272] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:22.186607 21344 ts_tablet_manager.cc:1916] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:22.203099 21344 ts_tablet_manager.cc:1929] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:22.203414 21344 log.cc:1199] T 6c5dfa3335ec44bcb98beeec64591f01 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/6c5dfa3335ec44bcb98beeec64591f01
I20260709 12:17:22.204843 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 6c5dfa3335ec44bcb98beeec64591f01 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:23.244895 20324 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:23.251865 20254 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:23.252526 20177 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:23.252632 20294 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f9ab1c5b9f64cf4ac204ed80e9e0035. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.253798 21346 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.255072 21285 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.265281 21346 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.269279 20177 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.284475 20254 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:23.288448 20073 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.289340 20255 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.301326 20177 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.301483 20327 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:23.303175 20219 consensus_peers.cc:597] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b4b4e64b7f442968c110b5d746e4b14. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.303798 21363 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.304962 21361 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.333465 21306 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.337097 20176 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.351373 20327 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.360601 20255 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:23.367132 20078 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:23.395649 20219 consensus_peers.cc:597] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc70b6f5a049439b939f85c3a096fb9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.397258 20176 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:23.399583 20327 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:23.405539 21306 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.419582 21363 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:23.428507 21361 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.430423 20327 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.433487 20176 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.445144 20255 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:23.456945 20327 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.459930 21306 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.461127 20177 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:23.463590 20219 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bddbf42869844c6f9ae72ceaefc93ea8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.470184 20073 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.481273 21374 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.487108 20324 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.485139 21361 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.513502 20171 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.521564 20073 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:23.753952 21384 ts_tablet_manager.cc:933] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:23.761763 21384 tablet_copy_client.cc:323] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:23.763481 20339 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:23.764071 20339 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-4f9ab1c5b9f64cf4ac204ed80e9e0035
I20260709 12:17:23.771435 20339 tablet_copy_source_session.cc:215] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:23.774806 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:23.792273 21384 tablet_copy_client.cc:806] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:23.792940 21384 tablet_copy_client.cc:670] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:23.797112 21384 tablet_copy_client.cc:538] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:23.799458 21386 ts_tablet_manager.cc:933] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:23.801662 21386 tablet_copy_client.cc:323] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:23.803333 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 1b4b4e64b7f442968c110b5d746e4b14 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:23.803896 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 1b4b4e64b7f442968c110b5d746e4b14 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-1b4b4e64b7f442968c110b5d746e4b14
I20260709 12:17:23.805596 21384 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:23.811627 20266 tablet_copy_source_session.cc:215] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:23.866767 21386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4b4e64b7f442968c110b5d746e4b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:23.871270 21389 ts_tablet_manager.cc:933] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:23.879999 21389 tablet_copy_client.cc:323] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:23.902782 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet bc70b6f5a049439b939f85c3a096fb9d from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:23.905984 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet bc70b6f5a049439b939f85c3a096fb9d from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-bc70b6f5a049439b939f85c3a096fb9d
I20260709 12:17:23.931205 21384 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:23.932358 21384 tablet_bootstrap.cc:492] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:23.932827 20266 tablet_copy_source_session.cc:215] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:23.933110 21384 ts_tablet_manager.cc:1403] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.128s	user 0.060s	sys 0.054s
I20260709 12:17:23.937711 21389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc70b6f5a049439b939f85c3a096fb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:23.939657 21384 raft_consensus.cc:359] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:23.940631 21384 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:23.941351 21384 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:23.943768 21386 tablet_copy_client.cc:806] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:23.945514 21386 tablet_copy_client.cc:670] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:23.955818 21384 ts_tablet_manager.cc:1434] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:17:23.958904 20339 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-4f9ab1c5b9f64cf4ac204ed80e9e0035 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:23.959415 20339 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-4f9ab1c5b9f64cf4ac204ed80e9e0035 on tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:23.962378 21386 tablet_copy_client.cc:538] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:23.969408 21384 ts_tablet_manager.cc:933] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:23.976302 21384 tablet_copy_client.cc:323] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:23.978369 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet bddbf42869844c6f9ae72ceaefc93ea8 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:23.978926 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet bddbf42869844c6f9ae72ceaefc93ea8 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-bddbf42869844c6f9ae72ceaefc93ea8
I20260709 12:17:23.981709 21386 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:23.990186 20266 tablet_copy_source_session.cc:215] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:24.032136 21384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddbf42869844c6f9ae72ceaefc93ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:24.089232 21389 tablet_copy_client.cc:806] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:24.092177 21389 tablet_copy_client.cc:670] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:24.103332 21384 tablet_copy_client.cc:806] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:24.104034 21384 tablet_copy_client.cc:670] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:24.104573 21386 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:24.105808 21386 tablet_bootstrap.cc:492] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:24.107522 21386 ts_tablet_manager.cc:1403] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.126s	user 0.031s	sys 0.040s
I20260709 12:17:24.110899 21386 raft_consensus.cc:359] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:24.111819 21386 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:24.112550 21386 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:24.112197 21389 tablet_copy_client.cc:538] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:24.113543 21384 tablet_copy_client.cc:538] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:24.115221 21386 ts_tablet_manager.cc:1434] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:24.127076 21389 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:24.127292 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-1b4b4e64b7f442968c110b5d746e4b14 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:24.128463 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-1b4b4e64b7f442968c110b5d746e4b14 on tablet 1b4b4e64b7f442968c110b5d746e4b14 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:24.137578 21384 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:24.164983 21389 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:24.165540 21384 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:24.167325 21384 tablet_bootstrap.cc:492] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:24.167598 21389 tablet_bootstrap.cc:492] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:24.168148 21384 ts_tablet_manager.cc:1403] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.008s
I20260709 12:17:24.168510 21389 ts_tablet_manager.cc:1403] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.011s
I20260709 12:17:24.171361 21389 raft_consensus.cc:359] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:24.172192 21389 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:24.172122 21384 raft_consensus.cc:359] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:24.173060 21384 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:24.172905 21389 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:24.174091 21384 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:24.176919 21384 ts_tablet_manager.cc:1434] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:17:24.178606 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-bddbf42869844c6f9ae72ceaefc93ea8 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:24.178831 21389 ts_tablet_manager.cc:1434] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:17:24.179008 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-bddbf42869844c6f9ae72ceaefc93ea8 on tablet bddbf42869844c6f9ae72ceaefc93ea8 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:24.181823 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-bc70b6f5a049439b939f85c3a096fb9d received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:24.182174 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-bc70b6f5a049439b939f85c3a096fb9d on tablet bc70b6f5a049439b939f85c3a096fb9d with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:24.217015 21040 raft_consensus.cc:1217] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:24.240943 21040 raft_consensus.cc:1217] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:17:24.476609 21040 raft_consensus.cc:1217] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:24.509768 21040 raft_consensus.cc:1217] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:24.633124 21306 raft_consensus.cc:1064] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:24.637152 21306 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:24.644158 21043 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.644795 20324 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.646292 21306 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.647001 20176 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.647190 21396 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:24.649161 21395 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.671650 21306 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.674098 20327 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.676425 21040 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.693524 20073 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.700302 20171 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.736018 21285 raft_consensus.cc:1064] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:24.738999 21285 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:24.753458 20254 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:24.755756 21040 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:24.758018 20255 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:24.758036 21346 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:24.762547 21311 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.766212 20171 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:24.781220 21043 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:24.785917 20323 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:24.787333 21395 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:24.796624 21311 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.800951 21396 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:24.802235 21380 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.806124 21311 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.826331 21040 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.844732 21043 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.861328 20077 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.876415 20247 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.886456 20078 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:24.889245 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b4b4e64b7f442968c110b5d746e4b14 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:24.891898 20327 raft_consensus.cc:2955] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.908427 20171 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.920336 20327 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:24.921326 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4b4e64b7f442968c110b5d746e4b14 with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:24.927727 21043 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:24.929742 21408 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:24.938335 21413 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.941169 21043 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:24.949414 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:24.962106 21416 tablet_replica.cc:333] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:24.963405 21416 raft_consensus.cc:2243] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:24.964217 21416 raft_consensus.cc:2272] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:24.972394 21416 ts_tablet_manager.cc:1916] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:24.971843 20077 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.989205 21416 ts_tablet_manager.cc:1929] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:24.989766 21416 log.cc:1199] T 1b4b4e64b7f442968c110b5d746e4b14 P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/1b4b4e64b7f442968c110b5d746e4b14
I20260709 12:17:24.990466 20176 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:24.991736 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 1b4b4e64b7f442968c110b5d746e4b14 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:24.997794 21285 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.001317 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:25.011489 20178 raft_consensus.cc:2955] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.027304 21363 raft_consensus.cc:1064] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:25.031945 21306 raft_consensus.cc:1064] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:25.035202 21306 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:25.042590 21418 tablet_replica.cc:333] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:25.030917 21363 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:25.048274 21418 raft_consensus.cc:2243] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.049046 21418 raft_consensus.cc:2272] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.052271 21418 ts_tablet_manager.cc:1916] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.081763 21418 ts_tablet_manager.cc:1929] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:17:25.082288 21418 log.cc:1199] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/4f9ab1c5b9f64cf4ac204ed80e9e0035
I20260709 12:17:25.086024 20178 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.087482 21396 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.093868 21043 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.096397 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 4f9ab1c5b9f64cf4ac204ed80e9e0035 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:25.097443 20327 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.106555 20171 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:25.108899 21363 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.115322 21395 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.133666 21043 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:25.135524 21396 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.135583 20323 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:25.141327 21306 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.145869 21396 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.159016 21043 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.159456 21415 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.190174 20330 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.203984 20078 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.213982 21363 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.215395 21040 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.222219 20178 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.236789 20323 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.240155 20171 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.256704 20078 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.265591 20254 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:25.276382 21043 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.278736 21363 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.282307 20171 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.284698 21306 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.287896 21417 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.291069 21043 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.297498 20254 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:25.317833 20078 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.322355 20171 raft_consensus.cc:2955] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.323740 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bddbf42869844c6f9ae72ceaefc93ea8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.324756 20323 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:25.325116 21040 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:25.340032 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet bddbf42869844c6f9ae72ceaefc93ea8 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:25.341751 21396 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.346302 21380 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.347519 21428 tablet_replica.cc:333] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:25.357558 21428 raft_consensus.cc:2243] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.358351 21428 raft_consensus.cc:2272] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.362623 21396 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.369577 21428 ts_tablet_manager.cc:1916] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.381541 21040 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.389176 21428 ts_tablet_manager.cc:1929] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:25.389683 21428 log.cc:1199] T bddbf42869844c6f9ae72ceaefc93ea8 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/bddbf42869844c6f9ae72ceaefc93ea8
I20260709 12:17:25.391342 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet bddbf42869844c6f9ae72ceaefc93ea8 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:25.397987 20074 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.400744 20327 raft_consensus.cc:2955] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:25.403756 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc70b6f5a049439b939f85c3a096fb9d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.412698 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet bc70b6f5a049439b939f85c3a096fb9d with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:25.413686 21416 tablet_replica.cc:333] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:25.421226 21416 raft_consensus.cc:2243] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.422130 21416 raft_consensus.cc:2272] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.425921 21416 ts_tablet_manager.cc:1916] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.439692 21416 ts_tablet_manager.cc:1929] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:25.440063 21416 log.cc:1199] T bc70b6f5a049439b939f85c3a096fb9d P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/bc70b6f5a049439b939f85c3a096fb9d
I20260709 12:17:25.441448 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet bc70b6f5a049439b939f85c3a096fb9d (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:26.485224 20327 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:26.492911 20171 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.492996 20247 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:26.493680 20294 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 599fe0ac57224f249385f1d6243cb41a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:26.494249 21431 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.495124 21414 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.503511 21429 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.506400 20247 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.508095 20171 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.529111 20327 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:26.530326 20074 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:26.539186 20294 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc3c17581b364b2292ad25402ab6bf57. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:26.539955 20247 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.540489 20171 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.541497 21414 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.543310 21414 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.562031 21431 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.571285 20171 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.586023 20247 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:26.587553 20254 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.597738 20078 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:17:26.622406 20219 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99f5ffbc4fe542b3996e60bb26ee1c35. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:26.624509 20323 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.624962 20171 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.625844 21396 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:26.627336 21442 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.637604 21442 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.639376 20323 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.640442 20171 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.653658 20247 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:26.658557 20078 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.665042 20171 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.666884 21442 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.670064 20327 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.672433 21442 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:26.677896 20219 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5260534c5dcb4fe0a840162b4eb6d460. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:26.687700 21442 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.690373 20178 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.690373 20327 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:26.708012 20078 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:27.245631 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 222480us
I20260709 12:17:27.271718 21455 ts_tablet_manager.cc:933] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:27.355482 21468 ts_tablet_manager.cc:933] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:27.360590 21469 ts_tablet_manager.cc:933] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:27.357530 21455 tablet_copy_client.cc:323] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:27.365923 21469 tablet_copy_client.cc:323] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:27.367159 21468 tablet_copy_client.cc:323] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:27.535128 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 99f5ffbc4fe542b3996e60bb26ee1c35 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:27.535781 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 99f5ffbc4fe542b3996e60bb26ee1c35 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-99f5ffbc4fe542b3996e60bb26ee1c35
I20260709 12:17:27.572755 20266 tablet_copy_source_session.cc:215] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.583722 21468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99f5ffbc4fe542b3996e60bb26ee1c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.589545 20339 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet fc3c17581b364b2292ad25402ab6bf57 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:27.590191 20339 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet fc3c17581b364b2292ad25402ab6bf57 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-fc3c17581b364b2292ad25402ab6bf57
I20260709 12:17:27.614576 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 599fe0ac57224f249385f1d6243cb41a from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:27.626202 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 599fe0ac57224f249385f1d6243cb41a from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-599fe0ac57224f249385f1d6243cb41a
W20260709 12:17:27.662814 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59799.1us
I20260709 12:17:27.675087 20340 tablet_copy_source_session.cc:215] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.663587 21476 ts_tablet_manager.cc:933] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:27.697635 21469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599fe0ac57224f249385f1d6243cb41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.700544 20339 tablet_copy_source_session.cc:215] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.704957 21455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3c17581b364b2292ad25402ab6bf57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.717218 21476 tablet_copy_client.cc:323] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:27.719164 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 5260534c5dcb4fe0a840162b4eb6d460 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:27.719748 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 5260534c5dcb4fe0a840162b4eb6d460 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-5260534c5dcb4fe0a840162b4eb6d460
I20260709 12:17:27.732410 21455 tablet_copy_client.cc:806] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.733065 21455 tablet_copy_client.cc:670] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.741475 21455 tablet_copy_client.cc:538] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.731561 20266 tablet_copy_source_session.cc:215] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.749121 21468 tablet_copy_client.cc:806] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.749771 21468 tablet_copy_client.cc:670] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.751879 21476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5260534c5dcb4fe0a840162b4eb6d460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.754843 21455 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:27.763273 21468 tablet_copy_client.cc:538] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.775921 21469 tablet_copy_client.cc:806] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.776891 21469 tablet_copy_client.cc:670] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.788648 21469 tablet_copy_client.cc:538] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.800772 21468 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:27.806135 21469 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:27.803061 21455 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.827186 21455 tablet_bootstrap.cc:492] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:27.828437 21476 tablet_copy_client.cc:806] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.836939 21455 ts_tablet_manager.cc:1403] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.082s	user 0.028s	sys 0.004s
I20260709 12:17:27.830363 21476 tablet_copy_client.cc:670] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.849002 21455 raft_consensus.cc:359] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.850642 21455 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:27.851450 21455 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.852447 21476 tablet_copy_client.cc:538] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.868463 21468 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.869616 21468 tablet_bootstrap.cc:492] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:27.870445 21468 ts_tablet_manager.cc:1403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.000s
I20260709 12:17:27.871239 21476 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:27.886181 21455 ts_tablet_manager.cc:1434] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 12:17:27.873684 21468 raft_consensus.cc:359] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.893564 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-fc3c17581b364b2292ad25402ab6bf57 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:27.906657 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-fc3c17581b364b2292ad25402ab6bf57 on tablet fc3c17581b364b2292ad25402ab6bf57 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:27.911477 21468 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:27.924136 21468 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.930140 21469 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.934432 21469 tablet_bootstrap.cc:492] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:27.935163 21469 ts_tablet_manager.cc:1403] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.020s
I20260709 12:17:27.938333 21469 raft_consensus.cc:359] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.941998 21469 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:27.942696 21469 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.941617 21468 ts_tablet_manager.cc:1434] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:17:27.945163 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-99f5ffbc4fe542b3996e60bb26ee1c35 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:27.945567 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-99f5ffbc4fe542b3996e60bb26ee1c35 on tablet 99f5ffbc4fe542b3996e60bb26ee1c35 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:27.951490 21469 ts_tablet_manager.cc:1434] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:17:27.954128 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-599fe0ac57224f249385f1d6243cb41a received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:27.954521 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-599fe0ac57224f249385f1d6243cb41a on tablet 599fe0ac57224f249385f1d6243cb41a with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:27.957912 21476 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.959138 21476 tablet_bootstrap.cc:492] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:27.959887 21476 ts_tablet_manager.cc:1403] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.014s
I20260709 12:17:27.963131 21476 raft_consensus.cc:359] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.964047 21476 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:27.964746 21476 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:27.967468 21476 ts_tablet_manager.cc:1434] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:17:27.969628 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-5260534c5dcb4fe0a840162b4eb6d460 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:27.970038 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-5260534c5dcb4fe0a840162b4eb6d460 on tablet 5260534c5dcb4fe0a840162b4eb6d460 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:28.052048 21039 raft_consensus.cc:1217] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:28.296334 21039 raft_consensus.cc:1217] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:17:28.345163 20201 debug-util.cc:398] Leaking SignalData structure 0x7b080010fee0 after lost signal to thread 18964
W20260709 12:17:28.346464 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9ee0 after lost signal to thread 20112
W20260709 12:17:28.347626 20201 debug-util.cc:398] Leaking SignalData structure 0x7b080029ef20 after lost signal to thread 20204
W20260709 12:17:28.348701 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800315180 after lost signal to thread 20280
W20260709 12:17:28.349961 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800337d60 after lost signal to thread 20354
W20260709 12:17:28.351190 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800250ea0 after lost signal to thread 21072
I20260709 12:17:28.357087 21039 raft_consensus.cc:1217] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:28.410568 21039 raft_consensus.cc:1217] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:28.605968 21431 raft_consensus.cc:1064] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:28.608870 21431 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:28.615950 21039 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.618083 20176 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.619185 21431 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.626627 21462 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.638361 20252 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.655815 21431 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.680320 21462 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.685739 20176 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.708560 20252 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.712833 21039 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.725641 20074 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.793499 20325 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:28.812702 21039 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:28.812726 20176 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:28.816599 21461 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.817524 21456 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.825140 21461 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.826834 20176 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.844571 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc3c17581b364b2292ad25402ab6bf57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:28.849107 20073 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:28.854987 21040 raft_consensus.cc:2955] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:28.860952 21475 raft_consensus.cc:1064] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:28.866719 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet fc3c17581b364b2292ad25402ab6bf57 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:28.877193 21475 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:28.888702 21462 raft_consensus.cc:1064] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:28.917660 21450 raft_consensus.cc:1064] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:28.896349 21462 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:28.957913 21450 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:29.000047 21039 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.001639 21493 tablet_replica.cc:333] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:29.001827 21494 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:29.010285 21039 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.010583 20249 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.022255 21462 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:29.024113 21456 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:29.028158 20330 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.030195 21452 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:29.013420 20176 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.045387 21462 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:29.055876 20173 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.077482 21043 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.087291 20327 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.095044 21493 raft_consensus.cc:2243] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:29.099632 21493 raft_consensus.cc:2272] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:29.100629 21494 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:29.110121 20174 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:29.111202 21461 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.114665 21493 ts_tablet_manager.cc:1916] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:29.097797 21452 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:17:29.133550 20176 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.139226 21450 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:29.141063 21039 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.141513 20249 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.161288 20077 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.177507 21495 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.187420 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.192195 20179 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:29.191536 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 94492.2us
W20260709 12:17:29.218626 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47097us
I20260709 12:17:29.231138 20077 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.236672 21506 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:29.248600 20321 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:29.262234 20179 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.263293 20325 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.263799 21510 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:17:29.273250 21043 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.288897 21493 ts_tablet_manager.cc:1929] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.289436 21493 log.cc:1199] T fc3c17581b364b2292ad25402ab6bf57 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/fc3c17581b364b2292ad25402ab6bf57
I20260709 12:17:29.295771 21040 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.296087 21505 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.298959 21456 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.302806 21509 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.305371 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet fc3c17581b364b2292ad25402ab6bf57 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:29.304811 20176 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.312566 21043 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.333942 20179 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.341082 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 599fe0ac57224f249385f1d6243cb41a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:29.342308 21042 raft_consensus.cc:2955] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.378793 20321 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.406931 20077 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.412847 20073 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.508656 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 599fe0ac57224f249385f1d6243cb41a with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:29.536238 20249 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:29.550228 21493 tablet_replica.cc:333] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:29.574385 20248 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:29.609614 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74649.8us
I20260709 12:17:29.622222 21042 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.639508 21505 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:29.642968 20176 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.651455 21493 raft_consensus.cc:2243] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:29.652756 21493 raft_consensus.cc:2272] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:29.657567 21493 ts_tablet_manager.cc:1916] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:29.657608 21505 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:29.672821 21042 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.679234 20323 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.680400 21452 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.685252 21450 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:29.685518 21042 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.709401 21450 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:29.722774 21493 ts_tablet_manager.cc:1929] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.724804 21493 log.cc:1199] T 599fe0ac57224f249385f1d6243cb41a P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/599fe0ac57224f249385f1d6243cb41a
I20260709 12:17:29.725955 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5260534c5dcb4fe0a840162b4eb6d460 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:29.729537 21452 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.743059 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 599fe0ac57224f249385f1d6243cb41a (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:29.744692 21042 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.746685 20176 raft_consensus.cc:2955] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.751937 20321 raft_consensus.cc:2955] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.758778 20074 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.760475 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99f5ffbc4fe542b3996e60bb26ee1c35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:29.791219 20073 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:29.798139 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 5260534c5dcb4fe0a840162b4eb6d460 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:29.826129 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 99f5ffbc4fe542b3996e60bb26ee1c35 with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:29.854014 21522 tablet_replica.cc:333] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:29.858126 21519 tablet_replica.cc:333] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:29.856724 21522 raft_consensus.cc:2243] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:29.859915 21519 raft_consensus.cc:2243] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:29.860999 21519 raft_consensus.cc:2272] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:29.859920 21522 raft_consensus.cc:2272] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:29.866086 21522 ts_tablet_manager.cc:1916] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:29.869658 21519 ts_tablet_manager.cc:1916] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:29.877956 20248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:29.878772 20248 raft_consensus.cc:606] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:29.882314 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:29.882807 20249 raft_consensus.cc:606] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:29.891496 21519 ts_tablet_manager.cc:1929] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.892141 21519 log.cc:1199] T 5260534c5dcb4fe0a840162b4eb6d460 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/5260534c5dcb4fe0a840162b4eb6d460
I20260709 12:17:29.894073 21522 ts_tablet_manager.cc:1929] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.894560 21522 log.cc:1199] T 99f5ffbc4fe542b3996e60bb26ee1c35 P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/99f5ffbc4fe542b3996e60bb26ee1c35
I20260709 12:17:29.894402 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 5260534c5dcb4fe0a840162b4eb6d460 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:29.896796 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 99f5ffbc4fe542b3996e60bb26ee1c35 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:29.912555 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:29.913105 20323 raft_consensus.cc:606] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:29.915832 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:29.916380 20323 raft_consensus.cc:606] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:29.921716 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:29.922228 20323 raft_consensus.cc:606] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:29.924033 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:29.925884 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:29.927024 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:29.954109 21508 raft_consensus.cc:993] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:29.954758 21508 raft_consensus.cc:1081] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:29.957746 21043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:29.958346 21043 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:29.958693 21043 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.972349 21043 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:29.976199 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:29.976923 20249 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.977206 20249 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:29.978065 20249 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:29.978750 21461 raft_consensus.cc:993] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:29.979315 20249 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.983518 21431 raft_consensus.cc:1081] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:29.985261 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:29.985834 20176 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:29.986222 20176 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.987313 21043 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:29.988843 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:29.989529 20323 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.993784 20176 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:29.994213 20249 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:29.996230 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:29.996582 20176 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:29.997320 21482 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:29.999435 21431 raft_consensus.cc:993] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:29.999310 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:29.999783 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:30.000106 21431 raft_consensus.cc:1081] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:30.000285 20248 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.001763 21043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53126
I20260709 12:17:30.002327 21043 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.002861 21043 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.000337 20321 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.003989 20321 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:30.004799 20321 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:30.005595 20323 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:30.006098 20321 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.012040 21043 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.014803 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:30.015343 20176 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.020181 21482 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:30.020840 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:30.021426 20327 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.021907 20327 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:30.021457 21482 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.022320 20176 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:30.022742 20327 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.027004 20327 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.026849 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:30.028013 21524 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.030344 21524 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:30.031325 21524 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.034251 21043 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:30.036266 20327 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:30.056284 20248 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:30.056751 20321 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:30.059218 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:30.061715 21496 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.062168 21496 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:30.063035 21496 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:30.073683 20074 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.092537 20074 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.097640 20077 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.276022 21508 raft_consensus.cc:993] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:30.276626 21508 raft_consensus.cc:1081] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:30.280508 21043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:30.281082 21043 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.281484 21043 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.292815 21043 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.295495 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:30.296015 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:30.296306 20176 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.296770 20248 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.297155 20248 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:30.298089 20248 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.299435 20248 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.304922 20176 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:30.306213 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:30.307288 21524 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.295372 21043 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:30.307773 21524 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:30.308755 21524 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:30.311825 20248 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:30.347924 20077 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:30.403362 21431 raft_consensus.cc:993] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:30.403934 21461 raft_consensus.cc:1081] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:30.405650 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:30.406278 20176 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:30.406662 20176 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.418537 20176 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:30.421591 20176 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:30.423151 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:30.423822 20327 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.424154 20327 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:30.425045 20327 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:30.426434 20327 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.428151 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:30.428823 20248 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.436623 20327 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:30.437855 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:30.438722 21478 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.439232 21478 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:30.440172 21478 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:30.443090 20248 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:30.463482 20077 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.465765 20248 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.467140 21524 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.480376 20327 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.482952 21524 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.525983 20178 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.528522 21482 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.550557 20327 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.552242 21496 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.591220 20323 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.594509 21482 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.643633 20249 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.647972 21542 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.824671 20178 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.827343 21482 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.840392 20249 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.844229 21482 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.941898 20249 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.943621 21478 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.986855 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:30.996773 20323 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.000486 20327 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.004071 21478 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:31.027179 20294 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0cfc71bca12d482b9f153b0596eba41f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:31.041709 20249 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:31.041967 20178 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:31.043751 21518 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.044718 21461 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.081277 21518 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.082355 20178 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.103443 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:31.104113 20249 raft_consensus.cc:606] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:31.107237 20248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:31.107837 20248 raft_consensus.cc:606] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:31.114331 20073 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.116180 20248 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.119982 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:31.120808 20249 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:31.128051 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:31.127806 20327 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.130501 20249 raft_consensus.cc:606] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:31.150734 20248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:31.154525 21505 raft_consensus.cc:993] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:31.156205 21505 raft_consensus.cc:1081] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:31.158144 20178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:17:31.158687 20178 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.159049 20178 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.151417 20248 raft_consensus.cc:606] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:31.160997 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:31.163182 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:31.164386 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:31.181023 20294 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 812122fe309946b0a0eebf7bc2214d12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:31.198064 20248 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:31.200035 20178 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.202226 20178 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:31.205564 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:31.206161 20323 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.206395 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:31.207036 20248 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.207317 20248 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:31.208156 20248 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.209403 21518 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:31.213255 20248 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.225028 20248 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:31.227347 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:31.228566 21478 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.229146 21478 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:31.228457 21551 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.230010 21478 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.235800 20252 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.239500 20323 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:31.242897 20178 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:31.257800 20252 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.258042 20074 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.260702 21431 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:31.290112 20219 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dda77defaf824b5c9cc9505346d7080c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:31.292037 20179 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:31.296294 20327 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:31.297817 21505 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.299531 21475 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.309973 21475 raft_consensus.cc:993] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:31.312222 21475 raft_consensus.cc:1081] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:31.315732 20179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:17:31.316543 20179 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.317008 20179 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.329180 20176 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.330431 20179 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.332543 20179 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:31.340025 20074 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.351454 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:31.352377 20248 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.352802 20248 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:31.353834 20248 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.355058 20248 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.359647 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:31.360280 20327 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.375118 20323 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.373631 21475 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.385818 20327 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:31.389997 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:31.390491 20248 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:31.391196 21478 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.394846 21478 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:31.396251 21505 raft_consensus.cc:993] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:31.396562 21478 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.401806 21452 raft_consensus.cc:1081] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:31.403367 20074 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.408202 21452 raft_consensus.cc:993] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:31.408650 21452 raft_consensus.cc:1081] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:31.451395 21043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:31.452055 21043 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.452409 21043 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.458489 21042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:31.459091 21042 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.459427 21042 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.476965 21043 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:31.484629 21043 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:31.485252 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:31.485910 20327 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:31.486477 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83874.5us
I20260709 12:17:31.488404 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:31.488968 20252 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:31.489265 20252 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:31.490201 21042 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:31.492740 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:31.493299 20176 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.492980 20252 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:31.494104 20252 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.495507 20327 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:31.496572 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:31.503146 20252 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:31.507042 21042 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:31.507421 20176 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:31.508800 20173 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.510084 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:31.510985 21482 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:31.511137 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:31.511757 21524 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.512373 20248 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.511775 20249 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.513615 20249 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:31.514345 20249 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:31.511477 21482 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:31.516321 21482 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:31.515384 20249 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.522342 20074 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.542336 21508 raft_consensus.cc:993] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:31.549831 20249 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:31.552968 21508 raft_consensus.cc:1081] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:31.563444 21524 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:31.565097 21524 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:31.573647 20077 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 3, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 3 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.575851 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:17:31.590658 20176 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:31.591059 20176 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.597648 21573 ts_tablet_manager.cc:933] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:31.600452 20176 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.604516 20176 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:31.618305 20327 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:31.620968 20219 consensus_peers.cc:597] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dedcb24fca34377b036e86f9764e60b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:31.621850 21562 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.628129 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:31.628722 20248 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.629030 20248 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:31.630587 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:31.631233 20323 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.632537 20074 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:31.637281 21572 ts_tablet_manager.cc:933] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:31.639744 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:31.640369 20321 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:31.647697 20248 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.648646 21475 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:31.651907 21573 tablet_copy_client.cc:323] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:31.653059 20174 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:31.653404 21572 tablet_copy_client.cc:323] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:31.654527 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 812122fe309946b0a0eebf7bc2214d12 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:31.655120 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 812122fe309946b0a0eebf7bc2214d12 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-812122fe309946b0a0eebf7bc2214d12
I20260709 12:17:31.655879 20339 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 0cfc71bca12d482b9f153b0596eba41f from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:31.656453 20339 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 0cfc71bca12d482b9f153b0596eba41f from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-0cfc71bca12d482b9f153b0596eba41f
I20260709 12:17:31.665405 20339 tablet_copy_source_session.cc:215] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:31.665781 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:31.665860 21562 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.667614 20248 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.668634 21574 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.669152 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfc71bca12d482b9f153b0596eba41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:31.669220 21574 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:31.670254 21574 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:31.668303 20340 tablet_copy_source_session.cc:215] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:31.681806 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812122fe309946b0a0eebf7bc2214d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:31.690088 21572 tablet_copy_client.cc:806] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:31.690936 21572 tablet_copy_client.cc:670] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:31.698222 21572 tablet_copy_client.cc:538] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:31.709195 20074 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:31.709457 21562 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.717638 21572 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:31.729235 20176 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.733800 21573 tablet_copy_client.cc:806] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:31.734413 21573 tablet_copy_client.cc:670] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:31.739400 20252 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.740832 21573 tablet_copy_client.cc:538] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:31.741510 20327 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.748588 21574 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.758941 20248 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:31.760124 21573 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:31.776347 20074 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:31.801131 20327 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.820340 21572 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:31.821672 21572 tablet_bootstrap.cc:492] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:31.822870 21572 ts_tablet_manager.cc:1403] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.106s	user 0.033s	sys 0.025s
I20260709 12:17:31.833034 21542 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.837785 20248 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.826539 21572 raft_consensus.cc:359] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.847646 21572 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:31.841037 21496 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:31.848428 21572 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.875162 21572 ts_tablet_manager.cc:1434] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
I20260709 12:17:31.882236 21573 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:31.896549 21573 tablet_bootstrap.cc:492] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:31.916177 21573 ts_tablet_manager.cc:1403] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.156s	user 0.027s	sys 0.025s
I20260709 12:17:31.932370 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-0cfc71bca12d482b9f153b0596eba41f received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:31.933202 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-0cfc71bca12d482b9f153b0596eba41f on tablet 0cfc71bca12d482b9f153b0596eba41f with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:31.936961 21572 ts_tablet_manager.cc:933] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:31.941962 21573 raft_consensus.cc:359] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.946159 20327 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:31.947248 21573 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:31.950280 21524 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:31.966095 21573 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:31.969786 21573 ts_tablet_manager.cc:1434] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.010s
W20260709 12:17:31.970890 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 80264.8us
I20260709 12:17:31.980571 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-812122fe309946b0a0eebf7bc2214d12 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:32.001721 20323 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.999507 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-812122fe309946b0a0eebf7bc2214d12 on tablet 812122fe309946b0a0eebf7bc2214d12 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:32.010134 21542 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:32.012378 21572 tablet_copy_client.cc:323] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:32.060189 21573 ts_tablet_manager.cc:933] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:32.062153 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet dda77defaf824b5c9cc9505346d7080c from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:32.064136 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet dda77defaf824b5c9cc9505346d7080c from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-dda77defaf824b5c9cc9505346d7080c
I20260709 12:17:32.064173 20249 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:32.068183 20249 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:32.068943 21524 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:17:32.082757 21524 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.084241 21042 raft_consensus.cc:1217] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:32.093133 20174 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:32.094623 21524 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.102237 21573 tablet_copy_client.cc:323] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:32.096273 20266 tablet_copy_source_session.cc:215] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:32.105633 20265 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 9dedcb24fca34377b036e86f9764e60b from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:32.106618 20265 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 9dedcb24fca34377b036e86f9764e60b from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-9dedcb24fca34377b036e86f9764e60b
I20260709 12:17:32.136577 20323 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:32.141597 21478 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:17:32.145737 21042 raft_consensus.cc:1217] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:32.156520 20248 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:32.164052 21496 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:32.236495 20265 tablet_copy_source_session.cc:215] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:32.251174 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dedcb24fca34377b036e86f9764e60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:32.295648 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda77defaf824b5c9cc9505346d7080c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:32.303223 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.328801 21573 tablet_copy_client.cc:806] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:32.329598 21573 tablet_copy_client.cc:670] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:32.344532 21572 tablet_copy_client.cc:806] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:32.345305 21572 tablet_copy_client.cc:670] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:32.349327 21573 tablet_copy_client.cc:538] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:32.353123 21572 tablet_copy_client.cc:538] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:32.401046 21572 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:32.406212 21573 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:32.470814 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:32.471488 20252 raft_consensus.cc:606] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:32.475834 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:32.476372 20252 raft_consensus.cc:606] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:32.495229 21573 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:32.497334 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:32.511224 21589 raft_consensus.cc:1064] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:32.513384 20252 raft_consensus.cc:606] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:32.515857 21589 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.517345 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:32.517747 21573 tablet_bootstrap.cc:492] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:32.517946 20249 raft_consensus.cc:606] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:32.518566 21573 ts_tablet_manager.cc:1403] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.012s
I20260709 12:17:32.512778 21572 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:32.520969 21572 tablet_bootstrap.cc:492] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:32.521719 21572 ts_tablet_manager.cc:1403] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.011s
I20260709 12:17:32.522492 20248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:32.523031 20248 raft_consensus.cc:606] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:32.524201 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:32.526245 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:32.527153 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.529260 21573 raft_consensus.cc:359] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:32.530100 21573 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:32.534160 21042 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:32.535252 20176 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:32.535401 21589 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:32.537070 21518 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.527750 21572 raft_consensus.cc:359] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:32.542964 21572 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:32.543730 21572 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:32.540825 20252 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:32.530781 21573 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:32.549947 21573 ts_tablet_manager.cc:1434] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:17:32.551251 21518 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.551934 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-9dedcb24fca34377b036e86f9764e60b received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:32.552433 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-9dedcb24fca34377b036e86f9764e60b on tablet 9dedcb24fca34377b036e86f9764e60b with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:32.553475 21572 ts_tablet_manager.cc:1434] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:17:32.561659 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-dda77defaf824b5c9cc9505346d7080c received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:32.562110 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-dda77defaf824b5c9cc9505346d7080c on tablet dda77defaf824b5c9cc9505346d7080c with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:32.571205 20176 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.571229 21461 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.605569 21042 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.606356 20249 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.605499 20077 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.663141 21610 raft_consensus.cc:993] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:32.664673 21565 raft_consensus.cc:1081] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:32.666682 21043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:32.667229 21043 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.667797 21043 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.667078 21042 raft_consensus.cc:1217] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:32.675537 21043 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.678355 21043 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:32.682839 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:32.683401 20252 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.685850 20252 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:32.687198 20252 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.688732 20252 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.689254 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:32.689970 20173 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.698123 21588 raft_consensus.cc:1064] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:32.700765 21588 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.727257 20173 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:32.729518 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:32.730435 21482 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:32.730930 21482 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:32.731842 21482 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.764735 20077 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.773331 20327 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.782258 21042 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:32.783344 20249 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:32.784058 20252 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:32.793068 21042 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.786626 21618 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:32.795243 21588 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.794055 20173 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.793727 20252 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.796497 21617 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.797997 21518 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.800068 21518 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.805727 21588 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.812161 21042 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.817793 20248 raft_consensus.cc:2955] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.826397 21475 raft_consensus.cc:993] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:32.826903 21475 raft_consensus.cc:1081] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:32.829489 20323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:32.830061 20323 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.830402 20323 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.836320 21043 raft_consensus.cc:1217] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:32.872408 21565 raft_consensus.cc:993] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:32.872933 21565 raft_consensus.cc:1081] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:32.875013 20327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:32.875536 20327 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.875895 20327 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.881829 20078 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 4 to 5, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.884552 21610 raft_consensus.cc:993] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:32.885063 21610 raft_consensus.cc:1081] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:32.885149 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 812122fe309946b0a0eebf7bc2214d12 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:32.887220 21043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:32.893945 21043 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.894363 21043 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.891057 20323 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:32.898312 20323 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:32.900260 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:32.900900 20173 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.893059 20327 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.902015 21043 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.902624 20327 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:32.905372 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:32.906010 20248 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.906309 20248 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:32.907892 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:32.908466 20174 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.908993 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 812122fe309946b0a0eebf7bc2214d12 with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45116
I20260709 12:17:32.907205 20248 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.912676 20248 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.926276 21505 raft_consensus.cc:993] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:32.926441 20174 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:32.927474 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:32.928428 21482 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.928900 21482 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:32.929845 21482 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.931658 21043 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:32.935271 20248 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:32.936558 21617 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:32.927016 21505 raft_consensus.cc:1081] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:32.944360 21042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:32.944887 21042 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.945253 21042 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.950013 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:32.950608 21041 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.969754 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:32.970472 20249 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.970782 20249 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:32.971612 20249 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:32.973654 20249 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.988587 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:32.989291 20255 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.989557 20255 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:32.996302 20255 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:32.998226 20255 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:33.009691 21040 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.018968 20073 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 3, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 3 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.963320 20173 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:33.025408 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:33.026371 21588 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:33.026870 21588 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:33.029101 21588 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:33.032546 21042 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.034641 21042 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:33.035400 21041 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:33.044333 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:33.045231 21518 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:33.045718 21518 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:33.046602 21518 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.056336 20248 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.067099 21622 tablet_replica.cc:333] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:17:33.050666 20077 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.077613 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:33.090422 20252 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:33.091681 20252 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:33.091741 21622 raft_consensus.cc:2243] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:33.092756 20252 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.117012 21622 raft_consensus.cc:2272] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:33.117568 21562 consensus_queue.cc:1175] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 12:17:33.081398 20173 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.121984 20073 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.098335 20255 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:33.101466 21475 raft_consensus.cc:1064] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:33.111744 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:33.125170 20176 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:33.117057 20252 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:33.099351 20249 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:33.131927 21622 ts_tablet_manager.cc:1916] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:33.143187 21475 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.155995 20176 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:33.139385 20252 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:33.124114 20073 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:33.166636 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:33.167625 21482 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:33.168144 21482 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:33.169010 21482 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.176170 20176 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:33.177284 21622 ts_tablet_manager.cc:1929] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:33.177810 21622 log.cc:1199] T 812122fe309946b0a0eebf7bc2214d12 P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/812122fe309946b0a0eebf7bc2214d12
I20260709 12:17:33.180907 21524 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:33.181700 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 812122fe309946b0a0eebf7bc2214d12 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:33.193755 21043 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:33.195214 20327 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:33.196061 21505 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:33.198827 21565 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.199288 20173 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:33.200891 21505 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.216652 20327 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.230710 20178 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:33.232618 21518 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:33.208978 20073 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.234153 21040 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:33.235687 21518 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:33.246347 21588 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.254710 20178 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.267180 21039 raft_consensus.cc:2955] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.272974 21043 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.267242 21505 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.307914 20252 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:33.309267 20173 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.310323 21482 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:33.330693 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0cfc71bca12d482b9f153b0596eba41f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:33.335160 20077 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.338501 20073 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 1 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.356073 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cfc71bca12d482b9f153b0596eba41f with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:33.359788 20323 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.406129 20249 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.410666 21505 raft_consensus.cc:1064] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:33.420024 21505 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:33.433343 21039 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:33.449896 21475 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:33.459501 20248 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:33.463793 20330 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:33.471895 21610 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.475739 21040 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:33.477203 21588 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:33.479212 20248 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:33.480715 21524 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:33.485062 21565 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:33.487854 20174 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:33.496628 20330 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.502333 21524 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:33.510958 21039 raft_consensus.cc:2955] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.534899 21043 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:33.539213 20323 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:33.541005 21636 tablet_replica.cc:333] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:33.542385 21636 raft_consensus.cc:2243] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:33.542769 21518 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:33.545593 21562 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.549796 21475 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.563903 20248 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:33.569188 21636 raft_consensus.cc:2272] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:33.576925 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dedcb24fca34377b036e86f9764e60b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:17:33.615377 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49805.9us
I20260709 12:17:33.615955 20173 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:33.612622 20074 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:33.637676 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49698.5us
I20260709 12:17:33.642932 21636 ts_tablet_manager.cc:1916] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:33.660547 21648 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:33.662983 20248 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:33.668627 21640 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:33.681252 20178 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:33.687377 20323 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.680354 21565 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.691607 21648 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:17:33.736917 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:33.754660 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dedcb24fca34377b036e86f9764e60b with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
W20260709 12:17:33.792624 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63107.2us
I20260709 12:17:33.796999 21642 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.815831 20178 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:33.860365 20074 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.892772 21663 tablet_replica.cc:333] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
W20260709 12:17:33.900157 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134429us
W20260709 12:17:33.896607 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 140674us
I20260709 12:17:33.907902 21636 ts_tablet_manager.cc:1929] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:33.908528 21636 log.cc:1199] T 0cfc71bca12d482b9f153b0596eba41f P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/0cfc71bca12d482b9f153b0596eba41f
I20260709 12:17:33.910434 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 0cfc71bca12d482b9f153b0596eba41f (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:33.912741 21640 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:33.923398 21663 raft_consensus.cc:2243] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:33.924281 21663 raft_consensus.cc:2272] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:33.932693 21043 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.936261 20176 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:33.965282 21663 ts_tablet_manager.cc:1916] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:33.996559 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67122.4us
I20260709 12:17:34.051687 21663 ts_tablet_manager.cc:1929] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:34.052405 21663 log.cc:1199] T 9dedcb24fca34377b036e86f9764e60b P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/9dedcb24fca34377b036e86f9764e60b
I20260709 12:17:34.067435 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 9dedcb24fca34377b036e86f9764e60b (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:34.114681 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:34.115362 20249 raft_consensus.cc:606] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:34.119481 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:34.120071 20323 raft_consensus.cc:606] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:34.125607 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:34.126204 20249 raft_consensus.cc:606] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:34.129820 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:34.130455 20249 raft_consensus.cc:606] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:34.133656 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:34.134176 20323 raft_consensus.cc:606] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:34.138013 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:34.139956 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:34.140774 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:34.416338 21642 raft_consensus.cc:993] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:34.417099 21645 raft_consensus.cc:1081] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:34.418819 20330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:34.419517 20330 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:34.438119 20330 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.469738 20330 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.472146 20330 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:34.475296 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:34.482622 20176 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.500900 21651 raft_consensus.cc:993] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:34.501541 21651 raft_consensus.cc:1081] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:34.504314 20179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:34.505062 20179 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:34.505537 20179 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:34.512584 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43747.2us
I20260709 12:17:34.514396 20176 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:34.520633 20295 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:34.521749 21650 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:34.522297 21650 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:34.525766 21650 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.535300 20173 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:34.546111 20179 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.556490 20179 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:34.559183 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:34.559329 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:34.559882 20330 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:34.560367 20330 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:34.561215 20330 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.562474 20330 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.566898 20248 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.559921 20252 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.589461 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:34.590123 20256 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:34.590415 20256 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:34.581751 21610 raft_consensus.cc:993] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:34.594328 21610 raft_consensus.cc:1081] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:34.595392 20330 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:34.591117 20256 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.600081 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:34.602240 21668 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:34.612922 21668 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:34.619280 21668 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.609704 21610 raft_consensus.cc:993] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
W20260709 12:17:34.600580 21505 consensus_queue.cc:1175] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:34.620779 21610 raft_consensus.cc:1081] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:34.600260 20256 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.629714 20256 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:34.644726 20324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:34.645318 20324 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:34.645675 20324 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.657104 21038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53112
I20260709 12:17:34.657857 21038 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:34.658336 21038 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.666004 21041 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:34.669064 21562 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:34.669972 21038 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.673717 20324 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.674932 21038 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:34.676621 21505 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:34.677724 21038 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:34.689625 21518 raft_consensus.cc:993] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:34.690084 21518 raft_consensus.cc:1081] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:34.691720 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:34.692431 20248 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:34.692763 20248 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:34.693539 20248 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.694537 20252 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:34.694769 20248 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.697073 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:34.700902 20174 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.707908 20324 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:34.708009 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:34.708665 20330 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.710088 20073 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:34.713137 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dda77defaf824b5c9cc9505346d7080c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:34.720496 20074 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.722025 20174 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:34.698088 20173 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:34.724483 20330 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:34.729697 20248 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:34.734503 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:34.735324 21648 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:34.735839 21648 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:34.736670 21648 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.740500 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:34.741221 20256 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:34.741554 20256 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:17:34.743098 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 51021.1us
I20260709 12:17:34.742403 20256 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:34.737829 21505 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:34.746675 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:34.747828 21640 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:34.748473 21640 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:34.748596 20256 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.749709 21640 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.757455 20173 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:34.757529 21038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53126
I20260709 12:17:34.758430 21038 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:34.758864 21038 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.767242 21038 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.772330 20256 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:34.767500 20174 raft_consensus.cc:2955] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:34.798640 20075 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.817194 21038 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:34.818715 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47693.6us
I20260709 12:17:34.822942 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:34.823596 20248 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.826741 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet dda77defaf824b5c9cc9505346d7080c with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:34.829355 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:34.829963 20324 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:34.830246 20324 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:34.831347 20248 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:34.831229 20324 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.832741 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:34.832940 20324 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.833613 21482 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:34.834160 21482 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:34.834982 21482 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:34.836571 20074 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.842973 20324 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:34.856338 21678 tablet_replica.cc:333] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:34.867913 21678 raft_consensus.cc:2243] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:34.868901 21678 raft_consensus.cc:2272] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:34.872761 21678 ts_tablet_manager.cc:1916] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:34.882686 20074 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 3 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.892429 20073 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.902300 21678 ts_tablet_manager.cc:1929] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:34.902799 21678 log.cc:1199] T dda77defaf824b5c9cc9505346d7080c P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/dda77defaf824b5c9cc9505346d7080c
I20260709 12:17:34.904633 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet dda77defaf824b5c9cc9505346d7080c (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:34.962598 20174 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:34.964299 21655 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:34.982474 20256 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:34.985129 21617 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:35.203109 20248 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:35.207249 20330 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:35.208993 21482 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:35.210696 21655 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.250900 20256 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:35.253075 21675 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:35.255261 20330 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:35.257714 21668 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:35.274489 20256 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:35.289386 21668 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:35.301697 20247 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:35.308372 21634 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:35.341127 20174 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:35.348030 21648 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.355343 20324 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:35.358223 21482 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:35.425252 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08001b16a0 after lost signal to thread 18964
W20260709 12:17:35.426638 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8540 after lost signal to thread 20112
W20260709 12:17:35.428088 20351 debug-util.cc:398] Leaking SignalData structure 0x7b0800308b40 after lost signal to thread 20204
W20260709 12:17:35.429384 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08000c97e0 after lost signal to thread 20280
W20260709 12:17:35.430629 20351 debug-util.cc:398] Leaking SignalData structure 0x7b0800316b80 after lost signal to thread 20354
W20260709 12:17:35.431998 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08001018a0 after lost signal to thread 21072
I20260709 12:17:35.446472 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:35.575977 20174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094b66f474ed4806afc377722fa74020"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:35.576702 20174 raft_consensus.cc:606] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:35.580458 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:35.582365 20324 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:35.585415 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:35.586032 20330 raft_consensus.cc:606] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:35.588753 20248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:35.589375 20248 raft_consensus.cc:606] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:35.593740 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:35.595882 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:35.596700 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:35.818807 21649 raft_consensus.cc:993] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:35.819371 21649 raft_consensus.cc:1081] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:35.823503 20324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "094b66f474ed4806afc377722fa74020"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42162
I20260709 12:17:35.824108 20324 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:35.824469 20324 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.841864 20324 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:35.846057 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:35.846690 20174 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:35.846977 20174 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:35.847748 20174 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:35.848932 20174 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.857949 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:35.858639 20249 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.868646 20249 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:35.874076 20324 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:35.878095 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:35.879707 21648 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:35.880216 21648 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:35.884732 20174 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:35.897224 21648 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:35.940876 20077 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:35.951707 21610 raft_consensus.cc:993] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:35.952409 21610 raft_consensus.cc:1081] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:35.954206 20323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:35.954792 20323 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:35.955176 20323 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.963706 20323 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:35.967510 20323 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:35.968453 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:35.977138 20174 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.986492 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:35.987270 20248 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:35.996130 20324 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:36.001639 20248 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:36.002934 20248 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:36.022037 20248 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:36.033545 20294 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f979d38c94754ec998f38fd4e97c3ab9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:36.034826 20249 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:36.040457 20179 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:36.045094 21704 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:36.058007 20174 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:36.059460 21701 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:36.067045 21655 raft_consensus.cc:993] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:36.068719 21655 raft_consensus.cc:1081] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:36.087057 20179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:36.087697 20179 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:36.107416 20179 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.131130 21701 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.135842 20256 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.146232 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:36.149947 21617 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:36.159358 21617 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:36.160983 21704 raft_consensus.cc:993] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:36.162680 21704 raft_consensus.cc:1081] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:36.163296 21617 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:36.167266 20252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:17:36.167852 20252 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:36.168205 20252 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.186748 20249 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:36.200522 20248 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:36.205825 20179 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:36.213681 20252 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:36.248267 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:36.248840 20324 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:36.249121 20324 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:36.249156 20252 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:36.240856 20174 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.249996 20324 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:36.251153 20324 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.251915 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:36.252544 20330 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:36.252831 20330 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:36.253672 20330 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:36.254858 20330 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.256323 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:36.256351 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:36.256996 20176 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.257090 21038 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.266768 20179 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:36.267434 21038 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:36.268662 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:36.269446 21687 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:36.269943 21687 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:36.270780 21687 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:36.279711 20219 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f631101c7754614902057ac50b914e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:36.282552 20323 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:36.284734 21562 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.286774 20179 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:36.304571 21610 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:17:36.387377 20176 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:36.400559 20248 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:36.396009 20324 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:36.416481 20330 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:36.422147 21705 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:36.479321 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 76560.1us
I20260709 12:17:36.514134 21728 ts_tablet_manager.cc:933] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:36.525521 21728 tablet_copy_client.cc:323] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:36.527493 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet f979d38c94754ec998f38fd4e97c3ab9 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:36.528198 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet f979d38c94754ec998f38fd4e97c3ab9 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-f979d38c94754ec998f38fd4e97c3ab9
I20260709 12:17:36.531438 20073 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.555635 20340 tablet_copy_source_session.cc:215] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:36.560859 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979d38c94754ec998f38fd4e97c3ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:36.584470 21728 tablet_copy_client.cc:806] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:36.585108 21728 tablet_copy_client.cc:670] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:36.603732 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:36.605597 21562 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:36.606103 21562 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:36.608654 21610 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.606940 21562 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:36.626367 20324 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.641111 21728 tablet_copy_client.cc:538] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:36.645579 20256 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:36.647974 21701 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:36.664978 21728 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:36.708565 21728 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:36.709779 21728 tablet_bootstrap.cc:492] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:36.710600 21728 ts_tablet_manager.cc:1403] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.046s	user 0.027s	sys 0.005s
I20260709 12:17:36.715377 21728 raft_consensus.cc:359] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:36.716233 21728 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:36.716867 21728 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:36.719669 21728 ts_tablet_manager.cc:1434] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:17:36.737936 20178 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:36.742033 20174 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:36.747290 20247 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:36.802515 21648 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:36.807813 21727 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:36.850692 20219 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8aaa749694d4c0c9f5af38eeb53fe12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:36.857856 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-f979d38c94754ec998f38fd4e97c3ab9 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:36.858532 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-f979d38c94754ec998f38fd4e97c3ab9 on tablet f979d38c94754ec998f38fd4e97c3ab9 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:36.679261 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:36.878273 20077 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:36.898509 21728 ts_tablet_manager.cc:933] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:36.898296 20075 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:36.911121 20077 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:36.920578 20326 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:36.944602 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 89562.4us
I20260709 12:17:36.984896 21038 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:36.972823 21610 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 12:17:37.011768 21740 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:17:37.013410 21737 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:17:37.020516 20321 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:37.023078 20077 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:37.047922 21038 raft_consensus.cc:1217] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:37.053462 20323 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:37.055037 21562 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:37.067083 20173 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.036702 21728 tablet_copy_client.cc:323] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:37.075531 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 9f631101c7754614902057ac50b914e5 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:37.076181 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 9f631101c7754614902057ac50b914e5 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-9f631101c7754614902057ac50b914e5
W20260709 12:17:37.078553 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46569.8us
I20260709 12:17:37.083298 20179 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:37.082732 20173 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:37.051291 21720 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:37.089035 21610 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:37.124186 21721 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:37.129515 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:37.130414 20326 raft_consensus.cc:606] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:37.143847 20173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:37.144603 20173 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:37.204484 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:37.205271 20323 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:37.209906 20266 tablet_copy_source_session.cc:215] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:37.217355 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:37.244837 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:37.246029 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:37.295492 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f631101c7754614902057ac50b914e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:37.300890 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 65499.1us
W20260709 12:17:37.371554 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 64421.1us
I20260709 12:17:37.377400 21648 raft_consensus.cc:993] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:37.397202 21725 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:37.404174 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 124047us
I20260709 12:17:37.417773 21738 ts_tablet_manager.cc:933] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:37.431814 21756 raft_consensus.cc:1081] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:37.448724 20321 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:37.462492 21730 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:37.491050 20256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:17:37.491818 20256 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:37.492292 20256 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:37.517094 21758 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:17:37.532491 20256 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:37.550199 20256 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:37.552775 21720 raft_consensus.cc:993] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:37.553357 21720 raft_consensus.cc:1081] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:37.560128 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:37.561053 20321 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:37.561456 20321 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:37.562459 20321 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:37.568653 20321 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.577809 20321 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:17:37.583165 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60333.8us
I20260709 12:17:37.587352 21738 tablet_copy_client.cc:323] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
W20260709 12:17:37.571554 21701 consensus_queue.cc:1175] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 2 status { last_received { term: 2 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 2 index: 3 } }
I20260709 12:17:37.594862 21728 tablet_copy_client.cc:806] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:37.601294 20219 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:37.603360 21562 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:37.603937 21562 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:37.605810 21562 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:37.605064 21728 tablet_copy_client.cc:670] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:37.635784 21727 raft_consensus.cc:993] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:37.636307 21727 raft_consensus.cc:1081] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:37.637673 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet e8aaa749694d4c0c9f5af38eeb53fe12 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:37.638304 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet e8aaa749694d4c0c9f5af38eeb53fe12 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-e8aaa749694d4c0c9f5af38eeb53fe12
I20260709 12:17:37.649936 21728 tablet_copy_client.cc:538] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:37.678994 20075 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:37.682307 21728 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
W20260709 12:17:37.684273 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800166360 after lost signal to thread 18964
W20260709 12:17:37.685588 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800167a00 after lost signal to thread 20112
W20260709 12:17:37.687059 20277 debug-util.cc:398] Leaking SignalData structure 0x7b080033a2e0 after lost signal to thread 20204
W20260709 12:17:37.689018 20277 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6c60 after lost signal to thread 20280
I20260709 12:17:37.691411 20266 tablet_copy_source_session.cc:215] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:17:37.706981 20277 debug-util.cc:398] Leaking SignalData structure 0x7b080012d580 after lost signal to thread 20354
W20260709 12:17:37.709240 20277 debug-util.cc:398] Leaking SignalData structure 0x7b08002829a0 after lost signal to thread 21072
I20260709 12:17:37.718757 21738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8aaa749694d4c0c9f5af38eeb53fe12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:37.726984 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 122017us
I20260709 12:17:37.742812 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:37.743454 20179 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.752645 20177 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:37.756482 20179 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:17:37.762012 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 149333us
I20260709 12:17:37.765271 20252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:17:37.765816 20252 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:37.766177 20252 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.780345 20252 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:37.785077 20252 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:37.787840 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:37.788414 20177 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.771677 21738 tablet_copy_client.cc:806] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:37.791364 20330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42162
I20260709 12:17:37.792619 20330 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:37.793115 20330 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.797660 20177 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:37.798620 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:37.799680 21719 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:37.800154 21719 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:37.801209 21719 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:37.801162 20330 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:37.805020 20330 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:37.824273 20074 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:37.808840 21738 tablet_copy_client.cc:670] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:37.830688 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:37.831604 20330 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:37.831916 20330 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:37.834383 20330 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:37.839634 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:37.841393 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:37.841977 20256 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.844151 20330 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.859213 21738 tablet_copy_client.cc:538] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:37.861867 20322 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:37.881337 20177 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:37.881799 20177 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:37.882854 20177 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:37.884168 20177 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.901335 20256 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:37.912680 20330 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:37.918056 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:37.920492 21707 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:37.921130 21707 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:37.922899 21707 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:37.940853 20177 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:37.950896 20177 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:37.953967 21728 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:37.955042 21728 tablet_bootstrap.cc:492] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:37.956799 21728 ts_tablet_manager.cc:1403] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.275s	user 0.015s	sys 0.024s
I20260709 12:17:37.958335 21648 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:37.964650 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 124931us
I20260709 12:17:37.973266 21728 raft_consensus.cc:359] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:37.976507 21728 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:37.977423 21728 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:37.981353 21728 ts_tablet_manager.cc:1434] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:17:37.983016 21738 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:37.987267 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-9f631101c7754614902057ac50b914e5 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:37.987812 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-9f631101c7754614902057ac50b914e5 on tablet 9f631101c7754614902057ac50b914e5 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:38.012344 20074 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.018182 20256 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:38.035830 20294 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34e43fd47bc14908b8da11134e6fd1d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:38.040221 21755 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:17:38.044579 21727 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:38.051383 20177 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:38.052434 20075 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.094118 20255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:38.095000 20255 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:17:38.112924 20255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:38.120615 20255 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Received request to transfer leadership
W20260709 12:17:38.124294 20063 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f979d38c94754ec998f38fd4e97c3ab9 already in progress [suppressed 56 similar messages]
I20260709 12:17:38.130806 20252 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:38.170121 20074 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:38.174561 20176 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:38.182482 21775 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:38.186575 20063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62318.2us
I20260709 12:17:38.188417 20256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:38.188993 20256 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Received request to transfer leadership
W20260709 12:17:38.207224 20126 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:17:38.207710 20126 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f979d38c94754ec998f38fd4e97c3ab9 already in progress
W20260709 12:17:38.208000 20126 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f979d38c94754ec998f38fd4e97c3ab9 already in progress
I20260709 12:17:38.251071 21738 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:38.252214 21738 tablet_bootstrap.cc:492] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:38.252974 21738 ts_tablet_manager.cc:1403] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.270s	user 0.052s	sys 0.033s
I20260709 12:17:38.268867 21719 raft_consensus.cc:993] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:38.269469 21719 raft_consensus.cc:1081] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:38.269567 21738 raft_consensus.cc:359] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:38.272444 21738 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:38.273169 21738 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:38.275187 21738 ts_tablet_manager.cc:1434] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:17:38.280304 20177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:17:38.280818 20177 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:38.284003 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-e8aaa749694d4c0c9f5af38eeb53fe12 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:38.284582 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-e8aaa749694d4c0c9f5af38eeb53fe12 on tablet e8aaa749694d4c0c9f5af38eeb53fe12 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:38.281173 20177 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.286769 21038 raft_consensus.cc:1217] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:38.297762 20322 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:38.299854 21041 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Advancing to term 3
I20260709 12:17:38.303606 20328 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:38.307726 21754 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:38.307608 21719 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:38.324757 20177 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:38.335114 21041 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:38.345623 20178 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:38.346732 20177 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:38.345160 21562 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:17:38.371681 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:38.372540 20256 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.372931 20256 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:38.375176 21730 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:38.387251 21043 raft_consensus.cc:1217] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:38.390059 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:38.502789 20178 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:38.446563 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:38.522431 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 125246us
I20260709 12:17:38.538048 21562 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:38.563243 20252 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:38.571679 21790 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:38.584400 20256 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:38.591373 20256 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.602444 21707 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:38.610234 20174 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:38.641251 21738 ts_tablet_manager.cc:933] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:38.713367 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 59137.2us
W20260709 12:17:38.714704 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 75666.3us
W20260709 12:17:38.713367 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60481.3us
I20260709 12:17:38.729192 20256 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:38.717010 21707 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:17:38.741242 21754 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:17:38.844091 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82585.8us
W20260709 12:17:38.889025 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 289689us
W20260709 12:17:38.901444 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.918864 21738 tablet_copy_client.cc:323] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
W20260709 12:17:38.951282 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.969151 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:38.977720 21720 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:38.978422 21720 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:38.979912 21720 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:39.018976 21725 raft_consensus.cc:1064] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:39.022009 21725 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.024611 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet 34e43fd47bc14908b8da11134e6fd1d6 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:39.025245 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet 34e43fd47bc14908b8da11134e6fd1d6 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-34e43fd47bc14908b8da11134e6fd1d6
I20260709 12:17:39.049574 20340 tablet_copy_source_session.cc:215] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:39.061478 21738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e43fd47bc14908b8da11134e6fd1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:39.062755 21719 raft_consensus.cc:1064] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:39.066504 21719 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.073465 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fc708954624727a65ab4485d1a2285"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:39.074103 20252 raft_consensus.cc:606] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:39.081305 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:39.081874 20330 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:39.084659 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:39.085258 20252 raft_consensus.cc:606] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:39.088183 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:39.088742 20252 raft_consensus.cc:606] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:39.089881 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:39.092059 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:39.092869 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:39.092586 20077 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.104600 21041 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.109086 20330 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.124960 21725 raft_consensus.cc:993] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:39.125578 21715 raft_consensus.cc:1081] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:39.131311 21798 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.136976 20330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fc708954624727a65ab4485d1a2285"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:39.138902 20330 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.139346 20330 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.150811 21725 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:39.155300 20179 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.167135 21038 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.161281 20322 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.169385 20330 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.175940 21730 raft_consensus.cc:993] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:39.175844 21775 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:39.177831 21795 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.182801 20179 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.192303 20330 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:39.194947 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:39.195586 20254 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.195909 20254 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:39.196699 20254 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.197973 20254 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.195909 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:39.199196 21038 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.204408 21715 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.193845 21725 raft_consensus.cc:1081] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
W20260709 12:17:39.207829 21813 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:17:39.213030 21738 tablet_copy_client.cc:806] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:39.213799 21738 tablet_copy_client.cc:670] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:39.216557 21038 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:39.224078 21719 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.229089 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:39.231041 21803 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.231539 21803 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:39.232524 20177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:17:39.233146 20177 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:39.233515 20177 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.261336 20177 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.242684 21738 tablet_copy_client.cc:538] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:39.232378 21803 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.268169 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:39.269145 20247 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:39.269454 20247 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:39.268105 20177 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:39.270236 20247 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.272958 20247 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.298664 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:39.299335 21041 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:39.463762 20254 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:39.470062 21041 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:39.475548 20247 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
W20260709 12:17:39.505293 21819 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 12:17:39.589021 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 89266.2us
I20260709 12:17:39.580461 21041 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:39.602802 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 202295us
I20260709 12:17:39.310997 21775 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:17:39.660256 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 65477.6us
W20260709 12:17:39.696702 21821 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:17:39.738734 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 134852us
W20260709 12:17:39.750733 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82962.9us
I20260709 12:17:39.760383 20252 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:39.788923 21041 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Advancing to term 4
I20260709 12:17:39.799688 21041 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:39.807677 21738 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:39.807726 21829 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:39.847579 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:39.864198 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74315.3us
I20260709 12:17:39.892104 20077 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.913246 21722 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:39.918773 21038 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:39.932852 21830 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:39.895354 21687 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:39.943511 21687 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:39.945385 21687 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:39.938309 21830 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:17:39.940279 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 85138.3us
I20260709 12:17:39.909143 20073 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:39.958096 21738 tablet_bootstrap.cc:700] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent opening tablet: real 0.141s	user 0.001s	sys 0.001s
I20260709 12:17:39.966264 21843 raft_consensus.cc:993] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:39.969949 21843 raft_consensus.cc:1081] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:39.968319 21830 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:40.045656 20328 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:40.051800 20256 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:40.053408 21722 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:40.057789 20176 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:40.067162 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:40.068416 20252 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:17:40.072564 21830 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:40.074867 21042 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:40.079234 20177 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:40.090098 21843 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:40.108103 20327 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:40.111227 20078 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.146801 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:40.148821 20174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:40.149793 20174 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:40.150235 20174 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.154443 21715 raft_consensus.cc:993] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:40.155464 21795 raft_consensus.cc:1081] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:40.160454 20174 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:40.202404 20327 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:40.204232 20174 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:40.217226 20327 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:40.218134 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:40.253476 21830 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:40.271948 21848 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:40.280591 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:40.281538 20327 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:40.281941 20327 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:40.302100 20321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:40.306090 20321 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:40.306488 20321 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:40.295625 20327 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:40.342464 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:40.343327 20252 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.365175 20327 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.374110 20321 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:40.373842 20074 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:40.383052 21738 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:40.394183 20327 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:40.408824 20321 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:40.423935 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:40.424690 20174 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:40.424624 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:40.450613 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:40.451440 20255 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:40.451819 20255 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:40.452680 20255 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:40.456449 21738 tablet_bootstrap.cc:492] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:40.457615 21738 ts_tablet_manager.cc:1403] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.650s	user 0.033s	sys 0.012s
I20260709 12:17:40.438076 21848 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:40.591660 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 127446us
I20260709 12:17:40.682986 21848 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:40.684108 21848 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:40.667174 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.470793 20247 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:40.671118 20174 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
W20260709 12:17:40.678294 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 202395us
I20260709 12:17:40.694547 20252 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:40.747355 21038 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:40.759748 21795 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:40.761281 21738 raft_consensus.cc:359] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:40.762203 21738 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:40.762879 21738 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:40.755738 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:40.790402 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:40.795854 20247 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:40.802174 21041 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:40.804296 20253 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:40.809594 20255 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:40.822184 21738 ts_tablet_manager.cc:1434] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.364s	user 0.016s	sys 0.008s
I20260709 12:17:40.822240 20323 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:40.834061 21845 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:40.840492 21849 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:40.843670 21845 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:40.844810 21845 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:40.845389 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.848131 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-34e43fd47bc14908b8da11134e6fd1d6 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:40.848764 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-34e43fd47bc14908b8da11134e6fd1d6 on tablet 34e43fd47bc14908b8da11134e6fd1d6 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:40.849457 21038 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:40.852420 20255 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:40.904474 20074 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:40.925184 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 71895.8us
I20260709 12:17:40.928751 21846 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:40.937595 20177 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:40.947345 21805 raft_consensus.cc:1064] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:40.950516 21805 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:40.952066 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.966564 20171 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:40.973158 20177 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:40.984836 21848 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:40.988555 21715 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.005954 21730 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.015345 21866 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:41.016062 20073 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.020426 20328 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:41.017501 21042 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.023829 21039 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.025314 21038 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:41.039455 21836 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:17:41.061070 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8aaa749694d4c0c9f5af38eeb53fe12 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:41.069538 21848 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.076766 20247 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:41.077731 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f631101c7754614902057ac50b914e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:41.087795 20077 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.089890 20077 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.087994 20177 raft_consensus.cc:2955] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.093732 21042 raft_consensus.cc:1217] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:17:41.105129 20171 raft_consensus.cc:2955] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.116153 21722 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.138077 21805 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:41.141484 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f631101c7754614902057ac50b914e5 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:41.141765 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094b66f474ed4806afc377722fa74020"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:41.142277 20247 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:41.142509 20322 raft_consensus.cc:606] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:41.154695 20319 tablet_service.cc:1558] Processing DeleteTablet for tablet e8aaa749694d4c0c9f5af38eeb53fe12 with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42150
I20260709 12:17:41.158198 21848 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.161208 20171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:41.161837 20171 raft_consensus.cc:606] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:41.162592 21042 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.177722 20171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:41.168367 21805 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.178412 20171 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:41.181895 20256 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.207829 20171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:41.208847 21877 tablet_replica.cc:333] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:41.211938 21837 raft_consensus.cc:993] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:41.210585 21877 raft_consensus.cc:2243] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:41.212497 21837 raft_consensus.cc:1081] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:41.213423 21877 raft_consensus.cc:2272] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:41.229503 20328 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:41.231315 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53438
I20260709 12:17:41.231932 20247 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.232311 20247 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.238896 20073 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.239600 20247 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.241637 20255 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:41.243335 21830 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:41.246701 20247 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:41.253866 21849 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:41.258859 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:41.263610 20171 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:41.259541 20322 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.269719 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:41.270342 20173 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.270668 20173 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:41.282096 20330 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.288612 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:41.294533 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:41.298512 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:41.301851 20173 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.304320 20173 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.330871 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:41.337611 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:41.344149 21730 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:41.350904 21730 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:41.351995 21730 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.413774 21877 ts_tablet_manager.cc:1916] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:41.417682 20173 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:41.445042 20174 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:41.453958 21847 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.467106 21830 raft_consensus.cc:993] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:41.467651 21830 raft_consensus.cc:1081] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:41.469398 20256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "094b66f474ed4806afc377722fa74020"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:17:41.470129 20256 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.470556 20256 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.501021 21776 raft_consensus.cc:993] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:41.501585 21776 raft_consensus.cc:1081] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:41.518325 20325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42162
I20260709 12:17:41.518960 20325 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.519364 20325 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.528904 21722 raft_consensus.cc:993] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:41.527310 20325 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:41.532377 21722 raft_consensus.cc:1081] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:41.535256 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:41.535923 20173 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:41.536275 20173 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:41.539085 20173 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:41.540580 20173 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.517233 20256 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.547940 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42162
I20260709 12:17:41.548557 20322 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:41.548945 20322 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.550949 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:41.551605 20249 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.570326 20249 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:17:41.571113 20325 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:41.572289 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:41.572953 21041 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.577666 20173 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:17:41.582152 20064 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f979d38c94754ec998f38fd4e97c3ab9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f5c544fad8874e818acaad733a9d14f1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:41.582345 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:41.582698 20322 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.583410 21881 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:41.583979 21881 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:41.585098 20322 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:41.584960 21881 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:41.586723 20256 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:41.589224 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:41.598647 20171 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:41.598994 20171 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:41.601095 20171 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.601930 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:41.602192 20171 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.604116 20073 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.591907 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:41.607618 20249 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.610059 20322 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:41.610440 20322 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:41.616290 21041 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:17:41.617640 20322 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.714334 20322 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.720243 20249 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:41.720887 20171 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:41.749924 20077 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:41.755975 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:41.759943 20322 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:17:41.756637 20174 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.754710 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:41.778854 21882 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:41.779470 21882 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:41.785555 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:41.785851 21877 ts_tablet_manager.cc:1929] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:41.786388 21877 log.cc:1199] T 9f631101c7754614902057ac50b914e5 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/9f631101c7754614902057ac50b914e5
I20260709 12:17:41.786728 21730 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:41.787254 21730 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:41.788311 21730 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.780591 21882 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:41.798861 20174 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:17:41.824431 21877 tablet_replica.cc:333] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:17:41.825719 21877 raft_consensus.cc:2243] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:41.826594 21877 raft_consensus.cc:2272] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:41.832046 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet 9f631101c7754614902057ac50b914e5 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
W20260709 12:17:41.906575 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74165.1us
W20260709 12:17:41.926062 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59385.9us
W20260709 12:17:41.938365 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 84187.4us
I20260709 12:17:41.974278 20077 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:41.985642 20171 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:41.962563 21881 raft_consensus.cc:1064] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:41.943531 21877 ts_tablet_manager.cc:1916] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:42.025976 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 100848us
I20260709 12:17:42.056298 20325 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:42.062281 20179 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:42.076893 21893 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:42.080310 21881 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.081670 21039 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:42.082891 20074 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:42.083770 21895 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:17:42.110015 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61462.5us
I20260709 12:17:42.065209 21866 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:42.139657 21896 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 12:17:42.185353 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75949.2us
I20260709 12:17:42.235913 20174 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:42.212694 20323 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.237514 21039 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:42.241519 21893 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:42.243543 20249 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:42.246179 20171 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:42.250936 20256 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:42.257530 21877 ts_tablet_manager.cc:1929] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:42.258020 21877 log.cc:1199] T e8aaa749694d4c0c9f5af38eeb53fe12 P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/e8aaa749694d4c0c9f5af38eeb53fe12
I20260709 12:17:42.259514 21903 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:17:42.259907 20174 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:17:42.261711 21845 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:42.268632 21039 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:17:42.270392 21830 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:42.271733 21897 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 6 to 8, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.273399 21877 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42150 (request call id 80) took 1105 ms. Trace:
I20260709 12:17:42.273890 21877 rpcz_store.cc:276] 0709 12:17:41.154040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.154330 (+   290us) service_pool.cc:224] Handling call
0709 12:17:41.824083 (+669753us) ts_tablet_manager.cc:1151] Deleting tablet e8aaa749694d4c0c9f5af38eeb53fe12
0709 12:17:41.824146 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:17:42.235980 (+411834us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:42.257369 (+ 21389us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:42.259189 (+  1820us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":668709}
I20260709 12:17:42.282143 21881 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:42.276652 20174 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 6 to 8, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.285825 21895 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:42.289516 20173 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:42.297350 20249 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:42.299470 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet e8aaa749694d4c0c9f5af38eeb53fe12 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:42.293028 21881 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:17:42.321834 21039 raft_consensus.cc:2955] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 6 to 8, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.380385 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f979d38c94754ec998f38fd4e97c3ab9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 5)
I20260709 12:17:42.345017 21830 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:17:42.400220 21907 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:17:42.424666 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:42.440009 20323 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:42.453154 21898 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:42.453783 20073 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 6 to 8, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.520958 21895 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.527220 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet f979d38c94754ec998f38fd4e97c3ab9 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:42.533617 20253 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.560142 21042 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.571503 21917 tablet_replica.cc:333] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:42.574811 20173 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.583359 20077 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 4 to 5, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.676163 20323 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.693078 21041 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:42.695103 21881 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:42.701175 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:42.701783 20328 raft_consensus.cc:606] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:42.714582 20253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:42.715231 20253 raft_consensus.cc:606] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:42.718868 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:42.719465 20328 raft_consensus.cc:606] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:42.722361 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:42.722903 20328 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:42.724167 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:42.726171 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:42.726926 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:42.730309 21894 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.744812 21830 raft_consensus.cc:993] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:42.745350 21830 raft_consensus.cc:1081] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:42.750310 20174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:42.750922 20174 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:42.751295 20174 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.757570 21041 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.761862 20173 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:42.764665 21895 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:42.759267 20174 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.769335 20174 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:42.770578 20173 raft_consensus.cc:2955] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:42.788744 21893 raft_consensus.cc:993] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:42.789311 21844 raft_consensus.cc:1081] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:17:42.793776 21042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53126
I20260709 12:17:42.794384 21042 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:42.794978 21042 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:42.804960 21917 raft_consensus.cc:2243] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:42.805932 21917 raft_consensus.cc:2272] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:42.806066 21042 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.809190 21917 ts_tablet_manager.cc:1916] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:42.815537 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:42.816182 21039 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.819303 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:42.819860 21042 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:42.819957 20328 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:42.820569 20328 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:42.821740 20328 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.827843 20328 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:42.845659 21917 ts_tablet_manager.cc:1929] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:17:42.848832 21917 log.cc:1199] T f979d38c94754ec998f38fd4e97c3ab9 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/f979d38c94754ec998f38fd4e97c3ab9
I20260709 12:17:42.850456 21039 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:17:42.856135 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet f979d38c94754ec998f38fd4e97c3ab9 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:42.877157 21900 raft_consensus.cc:993] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:42.877758 21900 raft_consensus.cc:1081] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:42.880544 20324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:42.881093 20324 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:42.881438 20324 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.891937 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:42.892566 20330 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:42.892874 20330 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:42.893713 20330 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.894992 20330 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.899686 20324 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:42.901713 20324 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:42.902307 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:42.902941 20174 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.909927 20330 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:17:42.918706 20174 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:42.919852 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:42.920825 21881 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:42.921285 21881 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:42.923408 21881 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:42.935039 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:42.935668 20253 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:42.935968 20253 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:42.936760 20253 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:42.937888 20253 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.940459 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:42.941075 20179 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:42.948580 20179 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:42.953212 20253 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:42.870286 20328 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:42.961300 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:42.962604 21802 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:42.964017 21802 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:42.965044 21802 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:42.985065 20074 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.996246 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34e43fd47bc14908b8da11134e6fd1d6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:43.031335 20074 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 5 to 6, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:43.055483 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet 34e43fd47bc14908b8da11134e6fd1d6 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53418
I20260709 12:17:43.056653 21917 tablet_replica.cc:333] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:17:43.060228 21895 raft_consensus.cc:993] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:43.060804 21895 raft_consensus.cc:1081] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:43.061340 20177 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:43.062860 21917 raft_consensus.cc:2243] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:43.063812 21917 raft_consensus.cc:2272] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:43.073974 21917 ts_tablet_manager.cc:1916] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:43.084452 20253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:17:43.085081 20253 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.085441 20253 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.080250 20076 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 2, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 2 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.093266 20253 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:43.111987 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:43.112967 21922 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:43.114715 21922 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:43.115724 21922 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:43.125218 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:43.125955 20330 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:43.126281 20330 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:43.126782 20253 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:43.127121 20330 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:43.128355 20330 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.149622 20074 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 6, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 6 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.171597 20330 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:43.173247 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:43.174512 21866 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.175064 21866 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:43.176113 21866 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:43.175925 21917 ts_tablet_manager.cc:1929] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:17:43.180095 21917 log.cc:1199] T 34e43fd47bc14908b8da11134e6fd1d6 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/34e43fd47bc14908b8da11134e6fd1d6
I20260709 12:17:43.181651 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet 34e43fd47bc14908b8da11134e6fd1d6 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:17:43.202899 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:43.203612 20173 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.207751 20074 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.231113 20173 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:43.418201 20173 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:43.420235 20323 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.422091 21802 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.424153 21830 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:43.521682 20249 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:43.523418 21895 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:43.557775 20177 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.564109 21921 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.605473 20324 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:43.607909 21900 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:43.630460 21041 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:17:43.713330 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 60609.8us
I20260709 12:17:43.721187 21886 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:43.724493 20324 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:17:43.748543 21886 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:43.756217 20173 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:43.779629 21866 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:43.859675 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:43.960816 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:43.961544 20324 raft_consensus.cc:606] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:43.966197 20247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:43.966770 20247 raft_consensus.cc:606] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:43.970217 20179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:43.970808 20179 raft_consensus.cc:606] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:43.972347 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:43.976667 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:43.978222 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:44.090562 21895 raft_consensus.cc:993] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:44.091235 21895 raft_consensus.cc:1081] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:44.125448 20179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:44.126277 20179 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.126714 20179 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.205928 20179 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.224166 20179 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:44.229763 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:44.230466 20323 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:44.230768 20323 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:44.231673 20323 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.233158 20323 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.243536 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:44.244220 21041 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.263259 21041 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:44.275835 20323 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:44.311041 21849 raft_consensus.cc:993] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:44.311689 21849 raft_consensus.cc:1081] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:44.355949 20249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53438
I20260709 12:17:44.356611 20249 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.356992 20249 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.385313 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:44.384124 20249 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.387180 21939 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:44.387715 21939 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:44.388629 21939 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.390777 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:44.391409 21041 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.398037 20249 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:44.401044 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:44.401674 20179 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:44.401985 20179 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:44.402803 20179 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.404072 20179 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.411499 20179 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:44.418488 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:44.419466 21915 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:44.420047 21915 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:44.421763 21915 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.423352 20076 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.463577 21041 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:44.493698 20249 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:44.514464 20324 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:44.514554 20219 consensus_peers.cc:597] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8271323bedc7421a87f787fc100b6efe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.518570 21946 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:44.520040 21866 raft_consensus.cc:993] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:44.528194 21866 raft_consensus.cc:1081] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:44.526329 20179 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.529896 20323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:44.530421 20323 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.530789 20323 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.531430 21946 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:44.563012 20323 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.565682 20323 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:44.567595 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:44.568272 20247 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:44.568392 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:44.568645 20247 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:44.569037 21039 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.569525 20247 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.570917 20247 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.588405 21039 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:44.590204 20247 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:44.591722 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:44.593667 21895 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:44.594168 21895 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:44.597375 21895 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:44.594216 21945 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.601528 20323 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.604560 20074 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.628530 20179 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.638906 20073 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.655119 20323 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:44.678524 20179 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:44.684412 20247 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:44.686342 21934 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:44.692826 20294 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae0621ca652d416d9284323ec7eb2363. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.693346 21934 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:44.695530 20076 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index -1 to 2, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.751945 21881 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.758518 20179 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.762331 20253 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.791330 20074 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:44.808653 21039 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:44.813932 21945 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:44.841648 20330 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:17:44.908066 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63328.6us
I20260709 12:17:44.911991 21922 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:44.943622 20171 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:44.949493 21945 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:45.010453 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 87536.9us
I20260709 12:17:45.038813 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:45.057657 21042 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:45.035833 21962 ts_tablet_manager.cc:933] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:45.392899 21962 tablet_copy_client.cc:323] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:45.408066 20179 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:17:45.423012 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 394246us
I20260709 12:17:45.442092 21939 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:45.485496 20256 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:45.495637 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:45.496428 20330 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:45.504088 20179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:45.507834 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 8271323bedc7421a87f787fc100b6efe from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:45.509445 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 8271323bedc7421a87f787fc100b6efe from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-8271323bedc7421a87f787fc100b6efe
I20260709 12:17:45.523702 21997 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:45.524652 20179 raft_consensus.cc:606] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:45.528661 20256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:45.530007 20256 raft_consensus.cc:606] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:45.531932 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:45.534029 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:45.534896 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:45.523805 20266 tablet_copy_source_session.cc:215] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:45.551914 21043 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:45.554064 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.564081 21881 raft_consensus.cc:993] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:45.564213 21939 raft_consensus.cc:993] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:45.564739 21939 raft_consensus.cc:1081] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:45.564709 21881 raft_consensus.cc:1081] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:45.587488 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:45.588195 20171 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:45.588591 20171 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.588855 21999 ts_tablet_manager.cc:933] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:45.603005 20171 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:45.605304 20171 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:45.611464 21999 tablet_copy_client.cc:323] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:17:45.628139 21962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8271323bedc7421a87f787fc100b6efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:45.643844 21987 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:17:45.665180 21900 raft_consensus.cc:993] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:45.673382 21988 raft_consensus.cc:1081] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:45.674630 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet ae0621ca652d416d9284323ec7eb2363 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:17:45.675298 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet ae0621ca652d416d9284323ec7eb2363 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-ae0621ca652d416d9284323ec7eb2363
I20260709 12:17:45.699748 20323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:45.700544 20323 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:45.700947 20323 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:45.738128 20323 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:45.750070 20340 tablet_copy_source_session.cc:215] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:45.769529 20323 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:45.771132 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:45.771976 20249 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:45.772374 20249 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:45.767352 21962 tablet_copy_client.cc:806] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:45.776000 20249 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:45.779718 20249 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:45.780871 21999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0621ca652d416d9284323ec7eb2363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:45.784986 21962 tablet_copy_client.cc:670] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
W20260709 12:17:46.057047 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.067883 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 436747us
I20260709 12:17:46.074230 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:46.075017 20179 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.093343 21977 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.096500 21977 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.107312 21977 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.102785 20179 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:46.355130 21977 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.355981 21977 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.358834 21977 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:46.558640 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.608677 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:46.776633 20074 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 306) took 1077 ms. Trace:
I20260709 12:17:46.781587 20074 rpcz_store.cc:276] 0709 12:17:45.699389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.753646 (+ 54257us) service_pool.cc:224] Handling call
0709 12:17:46.776519 (+1022873us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 12:17:46.814996 20249 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.035s	user 0.009s	sys 0.008s
I20260709 12:17:46.815362 20249 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:46.816061 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1411) took 1045 ms. Trace:
I20260709 12:17:46.816530 20249 rpcz_store.cc:276] 0709 12:17:45.770684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.770834 (+   150us) service_pool.cc:224] Handling call
0709 12:17:46.815969 (+1045135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:46.829383 21999 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.981s	user 0.034s	sys 0.033s
I20260709 12:17:46.830785 21999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53126 (request call id 561) took 1295 ms. Trace:
I20260709 12:17:46.831185 21999 rpcz_store.cc:276] 0709 12:17:45.535517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.535659 (+   142us) service_pool.cc:224] Handling call
0709 12:17:45.593187 (+ 57528us) ts_tablet_manager.cc:934] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
0709 12:17:45.778886 (+185699us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:45.847612 (+ 68726us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:45.847830 (+   218us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:46.829911 (+982081us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:46.830269 (+   358us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:46.830631 (+   362us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:46.830695 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":318,"tablet-copy.queue_time_us":26400,"thread_start_us":43728,"threads_started":2}
I20260709 12:17:46.833112 21999 tablet_copy_client.cc:806] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:46.833716 21999 tablet_copy_client.cc:670] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
W20260709 12:17:46.863350 20201 debug-util.cc:398] Leaking SignalData structure 0x7b080033a500 after lost signal to thread 18964
W20260709 12:17:46.869050 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08002670c0 after lost signal to thread 20112
W20260709 12:17:46.869412 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfd00 after lost signal to thread 20126
W20260709 12:17:46.870545 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08000c99a0 after lost signal to thread 20204
W20260709 12:17:46.871685 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08000c99e0 after lost signal to thread 20280
W20260709 12:17:46.872790 20201 debug-util.cc:398] Leaking SignalData structure 0x7b080030c560 after lost signal to thread 20354
W20260709 12:17:46.873034 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08002faf40 after lost signal to thread 20355
I20260709 12:17:46.877032 21986 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.881032 21986 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.883024 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:46.867607 21934 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.887327 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:46.887490 21934 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:46.890259 21934 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:46.884085 21986 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:46.900976 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800373940 after lost signal to thread 21072
W20260709 12:17:46.907799 20201 debug-util.cc:398] Leaking SignalData structure 0x7b080032ce60 after lost signal to thread 21972
W20260709 12:17:46.908293 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08003333e0 after lost signal to thread 21973
W20260709 12:17:46.908983 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800051b80 after lost signal to thread 21990
W20260709 12:17:46.909384 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7fe0 after lost signal to thread 21992
I20260709 12:17:46.910519 20076 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 296) took 1039 ms. Trace:
I20260709 12:17:46.910913 20076 rpcz_store.cc:276] 0709 12:17:45.871148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.930225 (+ 59077us) service_pool.cc:224] Handling call
0709 12:17:46.910453 (+980228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7,"reported_tablets":5}
W20260709 12:17:46.925895 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 857101us
I20260709 12:17:46.927284 21963 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:46.927875 21963 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.929688 21980 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:46.930047 21963 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.930533 21963 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:46.930233 21980 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:46.931013 21963 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:46.932417 21980 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:46.932931 21963 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:46.933452 21963 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:46.933897 21963 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.934302 21978 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:46.934787 21983 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:46.934919 21978 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:46.935336 21983 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:46.939168 21983 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:46.939646 21963 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.942605 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:46.942888 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:46.944883 21978 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:46.945554 21915 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.946086 21915 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.947350 20173 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:46.948210 21915 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.948837 21985 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.952198 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:46.933827 21922 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:46.953464 21922 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.953938 21940 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.955883 21962 tablet_copy_client.cc:538] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:46.954460 21940 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:46.949385 21985 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.958564 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:46.963102 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:46.964228 21983 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:46.964754 21983 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:46.965174 21984 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.965703 21984 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.971855 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:46.972443 20247 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:46.973869 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:46.973948 21987 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:46.982636 21987 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:46.976939 21984 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.977811 21973 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:46.978839 21922 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.971293 21983 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:46.966413 21915 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.971426 21946 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.981935 20173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:46.983676 21987 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:46.989233 20173 raft_consensus.cc:606] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:46.989843 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:46.991938 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:46.992051 21945 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.992692 21988 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:46.995808 22009 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:46.996313 21965 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:17:47.008020 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52460.9us
I20260709 12:17:46.997224 21915 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:46.998073 21973 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.001955 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.015754 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.016310 20324 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:47.001111 21946 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.003738 21945 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.005156 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.005812 21990 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:47.010114 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.012887 20249 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:47.002877 21985 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.015059 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.023749 20253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:47.024365 20253 raft_consensus.cc:606] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:47.006677 21988 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.013391 21968 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.018553 21866 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.011173 21965 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:47.040611 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:47.035584 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:47.041640 20256 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:47.036347 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53438
I20260709 12:17:47.017000 21984 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.042505 20247 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.042762 20247 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.046736 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.011296 22009 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.047391 20324 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:47.020234 21900 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.048092 21984 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.052809 21988 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.053198 21984 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.053320 21988 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.053753 21984 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.053905 21988 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.054242 21984 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.050555 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.051234 21967 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.058024 21979 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:47.067713 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:47.057955 21986 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.071070 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.071509 21988 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.071800 22014 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.061319 21997 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.072535 22012 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.061184 21980 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:47.080063 21966 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:47.043637 21866 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.083706 20247 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.072369 22014 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.088798 20253 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:47.088984 21972 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:47.085886 20256 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:47.035584 21968 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.093360 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.096001 20324 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:47.097039 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.097064 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.105170 20247 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.106098 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.109694 22009 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.111672 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:47.110944 20144 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb4da77a6bb24e4f94abb2f4bd8a7f9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:47.082392 21997 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.076558 21976 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.076380 21979 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.089473 21972 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.118352 21973 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.074496 21986 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.138757 22014 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.139714 20330 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:47.035614 21990 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.107142 21963 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:47.104925 21946 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.050081 21900 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.145534 20330 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:17:47.144320 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 103793us
I20260709 12:17:47.134738 21997 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.146978 20172 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:47.148507 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.140336 21979 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:47.149225 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 127659us
I20260709 12:17:47.152406 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.151798 20330 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:47.156188 20330 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:47.116746 21980 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.160414 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.161800 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.162137 21968 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:47.067170 21967 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.162794 22017 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.150599 22014 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.164783 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.165180 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.104204 22012 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.150480 21940 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:47.154358 21945 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.168136 20330 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:47.173326 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.165781 21989 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.159061 21915 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:47.178599 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.176862 21973 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.181710 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.153002 21963 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.184340 21986 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.184541 22012 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.165972 21984 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.145426 21966 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.193272 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.155737 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.227237 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.186867 21940 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.175298 22014 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.180639 21967 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.140894 21976 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.176728 21989 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.238739 21979 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.239915 21966 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.241439 21979 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.242110 21989 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:47.195514 21945 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.242933 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.163367 22017 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.245563 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.187798 21973 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:47.256587 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.264472 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:47.267750 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 71729.3us
I20260709 12:17:47.271770 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.275847 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.276718 21042 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:17:47.278434 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.243692 21940 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.253139 21945 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.280969 22015 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.285059 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.285239 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.286043 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:47.287068 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.286731 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.286432 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:47.286706 21980 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.288355 20326 raft_consensus.cc:606] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.287705 20323 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:47.275830 21993 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.290637 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.289480 21900 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.295993 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.292706 22018 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.292243 21915 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.321934 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.324700 20321 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:17:47.330072 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.336220 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:47.338191 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.339150 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.340472 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:47.341039 20324 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.343896 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.346096 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:47.284916 21965 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:47.350154 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.323702 21900 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.350672 20328 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:47.351318 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:47.327759 21972 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:17:47.352427 22021 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:47.351958 22019 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.354629 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.352171 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.360915 21995 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:47.335821 22022 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.361968 21972 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.391121 21973 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.396672 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:47.336372 21993 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.391875 22019 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.405157 22014 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.432798 20324 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:17:47.405623 21866 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.297214 22015 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.401453 21922 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:47.437316 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.437638 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.424113 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.347792 22018 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.443742 21945 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.431991 22019 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.446544 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.447144 21038 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:47.448316 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.449465 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.454339 21963 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.455039 22017 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.456203 21993 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:47.456862 21966 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:47.438649 21990 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.440230 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:17:47.476990 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58442.7us
I20260709 12:17:47.479414 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.481781 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.482178 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.484230 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:47.485329 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.497013 21969 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.499358 20076 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:47.506820 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 95731.2us
I20260709 12:17:47.425257 22022 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.507826 21962 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
W20260709 12:17:47.545111 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 266692us
W20260709 12:17:47.549032 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66933.1us
I20260709 12:17:47.462984 21976 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.478895 21940 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.472970 22015 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:47.545934 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 259991us
I20260709 12:17:47.563125 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.561448 21995 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:47.570341 21999 tablet_copy_client.cc:538] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:47.575171 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.578833 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.580482 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.577732 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.552484 21980 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.584040 21985 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:47.585597 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.583384 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.592638 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.599864 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.582463 21922 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.584956 22022 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.593372 21983 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.605621 21915 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.608263 21990 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.596711 21985 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:47.631855 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 119406us
I20260709 12:17:47.629796 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:47.640844 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.643072 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.618039 22030 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.641041 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:47.647524 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.648219 20249 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 1.
I20260709 12:17:47.651439 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.651530 22031 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:17:47.652732 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.639214 22024 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:47.673985 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:17:47.674885 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 64000.6us
I20260709 12:17:47.672176 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.677335 22020 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.679164 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.679340 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.679636 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.674736 22024 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.680974 22024 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.681141 22018 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.681937 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.684057 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.686231 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:47.689785 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.683393 21989 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:47.692044 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.692627 22033 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.693027 22033 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:47.693411 22033 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.693584 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.696776 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.698770 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.699697 22014 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:47.701975 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.704651 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:47.706107 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:47.707659 22029 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:47.708081 22029 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.708446 22029 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.709442 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.689301 22034 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.710083 20254 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:17:47.720999 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.696409 21985 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.697943 21989 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.729418 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:47.733145 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55283.6us
I20260709 12:17:47.730564 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.734283 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.735175 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.735348 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:47.737541 20172 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:47.737831 20172 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:47.737848 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.738544 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.741297 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.738662 20172 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.713378 22034 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.725252 21900 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:47.751756 21973 raft_consensus.cc:993] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:47.740586 21968 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.752563 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:47.754194 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.754376 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.736230 21989 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.757246 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.757354 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:17:47.758756 22038 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:17:47.758880 21973 raft_consensus.cc:1081] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:47.760340 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.760711 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:47.759176 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:47.769719 22044 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:47.745523 22034 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.774566 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.674261 21995 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:47.778012 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.763236 22033 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.779551 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.766242 21900 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:47.783052 21900 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.778211 22044 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:47.789168 22044 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.791347 21999 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:47.795782 22024 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.791497 21968 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.804239 20252 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:47.807260 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.807884 20327 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:47.809706 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:47.775825 22019 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.811893 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.812328 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:47.817402 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.818218 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.820168 21969 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.817246 21990 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.821967 22024 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.828276 20174 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:47.827126 21983 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.832491 22043 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.833063 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.835472 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:47.838869 22009 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:47.840605 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:47.831231 21989 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:47.846424 20323 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:47.848536 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.852365 20252 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:47.856647 20256 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:47.857111 21989 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:47.857688 21946 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.858711 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.860749 20256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53438
I20260709 12:17:47.861320 20256 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.861660 20256 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.839150 22031 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.837584 22043 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.862927 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.865017 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.868076 22026 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.844165 21969 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.870894 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:47.870563 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:47.879494 22046 ts_tablet_manager.cc:933] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:47.873482 21979 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.881839 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:47.872249 22026 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.896868 22033 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.897271 21986 raft_consensus.cc:993] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:47.897779 21986 raft_consensus.cc:1081] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:47.900044 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:47.902371 22019 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:47.904945 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:47.905231 20256 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.914623 20256 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:47.925845 21997 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.004s
I20260709 12:17:47.927788 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:47.928169 20174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:47.928710 20174 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.929035 20174 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.926321 21997 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:47.935981 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:47.937384 20322 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:47.940263 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.050586 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.055229 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.072085 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:48.073127 20171 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:48.073607 20171 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:47.940958 21997 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:48.092629 20172 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:48.100338 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 49937.4us
I20260709 12:17:48.104197 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.114180 22035 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.120976 20174 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.123342 20174 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:48.122819 22029 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.124758 20171 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.129237 20171 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.135279 22042 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.135658 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.146196 22029 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:48.151293 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:48.091519 22044 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:48.162447 20254 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:48.165249 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.166417 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:48.168447 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:48.169001 20250 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.177223 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.181252 22037 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:48.192214 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.196889 22017 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:48.197610 22017 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.202983 20248 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:48.190352 22034 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:48.207844 20253 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:48.208905 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57429.7us
I20260709 12:17:48.201406 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.214664 22034 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:48.220450 20172 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
W20260709 12:17:48.226720 21980 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:17:48.222138 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:48.224709 22029 raft_consensus.cc:993] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:48.225792 22040 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:48.240113 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.241545 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.238962 20171 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:48.248252 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1128) took 1173 ms. Trace:
I20260709 12:17:48.248736 20322 rpcz_store.cc:276] 0709 12:17:47.067025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.067132 (+   107us) service_pool.cc:224] Handling call
0709 12:17:47.067395 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:47.937855 (+870460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.239929 (+302074us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54000cdd54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:48.240086 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000201984}
I20260709 12:17:48.249927 20250 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:48.254201 22044 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:48.256382 21988 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:48.257054 22029 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.257807 22029 raft_consensus.cc:1081] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
W20260709 12:17:48.260393 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.265765 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.267998 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:48.269716 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.271055 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.271808 20322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42166
I20260709 12:17:48.272388 20322 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.273326 20179 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:48.275318 20322 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.276619 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:48.282094 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:48.289589 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:48.277701 22017 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.329360 20295 leader_election.cc:400] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:48.330987 20295 leader_election.cc:403] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:48.334498 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:48.313537 21976 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.324855 21984 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:48.333139 21978 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.303064 21963 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:48.353761 20175 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:48.327817 21983 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:48.327266 22030 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:48.392196 22030 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.392756 21966 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:48.392767 22030 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:48.393469 21966 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:48.393975 22030 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.394409 21966 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.395336 22030 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.392153 21983 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.406407 20322 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.422087 22046 tablet_copy_client.cc:323] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.65:39563
I20260709 12:17:48.423938 20322 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:48.399096 21983 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:17:48.419793 21995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.013s	sys 0.005s
W20260709 12:17:48.420351 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.018s	sys 0.002s
W20260709 12:17:48.446772 21995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.014s	sys 0.005s
I20260709 12:17:48.453394 22013 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:48.455536 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.068s	sys 0.183s
W20260709 12:17:48.441061 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.019s	sys 0.002s
I20260709 12:17:48.473721 21946 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:48.472204 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.070s	sys 0.183s
W20260709 12:17:48.474998 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 663708us
I20260709 12:17:48.450649 21984 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:48.476977 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:48.487022 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 139706us
I20260709 12:17:48.463850 21972 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:48.460110 21922 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:48.484972 21983 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.488852 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:48.492141 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:48.489364 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 183551us
W20260709 12:17:48.482981 22050 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:17:48.494050 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:48.501026 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:48.490051 21986 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.509244 20076 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 299) took 1164 ms. Trace:
I20260709 12:17:48.510609 20250 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:48.506942 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:48.490280 21972 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:48.509650 20076 rpcz_store.cc:276] 0709 12:17:47.344708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.344880 (+   172us) service_pool.cc:224] Handling call
0709 12:17:48.509147 (+1164267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:47.566504 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:47.567076 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:47.567102 (+    26us) write_op.cc:435] Acquired schema lock
0709 12:17:47.567115 (+    13us) tablet.cc:662] Decoding operations
0709 12:17:47.567391 (+   276us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:47.567447 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:47.567472 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:47.567735 (+   263us) tablet.cc:701] Row locks acquired
0709 12:17:47.567748 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:17:47.567858 (+   110us) write_op.cc:270] Start()
0709 12:17:47.567944 (+    86us) write_op.cc:276] Timestamp: P: 1783599467567827 usec, L: 0
0709 12:17:47.567960 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:17:47.568585 (+   625us) log.cc:844] Serialized 541 byte log entry
0709 12:17:48.099257 (+530672us) op_driver.cc:464] REPLICATION: finished
0709 12:17:48.483546 (+384289us) write_op.cc:301] APPLY: starting
0709 12:17:48.483678 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:48.483786 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:48.483941 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:48.484199 (+   258us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:48.484364 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:48.484420 (+    56us) write_op.cc:312] APPLY: finished
0709 12:17:48.484613 (+   193us) log.cc:844] Serialized 23 byte log entry
0709 12:17:48.484790 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.484884 (+    94us) write_op.cc:454] Released schema lock
0709 12:17:48.484925 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:48.485334 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.485365 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135072,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":375316,"apply.run_cpu_time_us":1856,"apply.run_wall_time_us":10505,"num_ops":1,"prepare.queue_time_us":61247,"prepare.run_cpu_time_us":21983,"prepare.run_wall_time_us":49148,"raft.queue_time_us":287703,"raft.run_cpu_time_us":81002,"raft.run_wall_time_us":321931,"replication_time_us":531118,"thread_start_us":505426,"threads_started":4,"wal-append.queue_time_us":68270}]]}
I20260709 12:17:48.518200 21976 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:48.493198 21997 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:48.492398 21993 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:48.504781 21900 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.536110 21984 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:48.563480 20144 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:48.536715 20074 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.521991 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:48.519487 22040 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:48.574626 22040 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:48.575119 22040 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.574627 20175 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.577324 21962 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:48.578362 21962 tablet_bootstrap.cc:492] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:48.579142 21962 ts_tablet_manager.cc:1403] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 1.072s	user 0.035s	sys 0.035s
W20260709 12:17:48.542351 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.507108 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.548689 21993 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.522771 21983 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.523761 21972 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:48.541219 22013 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
W20260709 12:17:48.600986 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 93941.2us
I20260709 12:17:48.602109 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.605273 20073 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:17:48.600004 22048 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.501847 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:48.603979 21993 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:48.604230 21997 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.625465 21978 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.626662 21988 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.625957 21978 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:17:48.634214 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 132434us
I20260709 12:17:48.635004 21972 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.640583 21962 raft_consensus.cc:359] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:17:48.665414 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 379968us
I20260709 12:17:48.667073 20190 tablet_copy_service.cc:140] P f5c544fad8874e818acaad733a9d14f1: Received BeginTabletCopySession request for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:60784)
I20260709 12:17:48.667650 20190 tablet_copy_service.cc:161] P f5c544fad8874e818acaad733a9d14f1: Beginning new tablet copy session on tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:60784: session id = 8aef67aa330543a191ab5ab5dc30e84c-cb4da77a6bb24e4f94abb2f4bd8a7f9e
I20260709 12:17:48.644654 20175 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:48.647503 22048 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:17:48.650882 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47392.4us
I20260709 12:17:48.655962 21993 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.683684 20322 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:48.685679 22044 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.687626 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:48.662161 21962 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:48.692181 20255 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:48.696523 21041 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:48.698846 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:48.699481 20255 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:48.699784 20255 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:48.700496 20255 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.701773 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:48.701959 20255 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.704741 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:48.707239 22060 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:17:48.708267 22040 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:48.709336 22060 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:48.709731 22060 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:48.710533 22060 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:48.714732 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:48.719442 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.720150 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:48.724046 20328 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:48.724598 20327 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:48.690294 22048 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.726711 21986 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:48.727214 21986 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:48.678342 21978 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.728209 21986 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:48.729122 21978 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:48.730118 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.731957 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:48.733057 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.742062 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.745208 21984 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.745805 21034 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:48.752933 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.754914 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:48.756018 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:48.762657 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:48.710541 22040 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:48.727478 22048 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:48.752245 22060 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.759279 22029 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:48.809466 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.763196 21962 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:48.816164 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:48.816569 21993 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:48.830394 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:48.833099 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 146512us
I20260709 12:17:48.821928 22017 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.834357 21999 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:48.850430 21962 ts_tablet_manager.cc:1434] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.250s	user 0.009s	sys 0.001s
I20260709 12:17:48.860126 21039 raft_consensus.cc:1217] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:48.883575 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-8271323bedc7421a87f787fc100b6efe received from {username='slave'} at 127.0.0.1:40218
I20260709 12:17:48.889940 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-8271323bedc7421a87f787fc100b6efe on tablet 8271323bedc7421a87f787fc100b6efe with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:48.904476 21999 tablet_bootstrap.cc:492] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:48.939218 20323 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:48.941465 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:48.959041 22044 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:48.960371 22048 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:48.960757 22048 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:48.961684 22048 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:48.967270 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.969142 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:48.980376 21989 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:48.973482 21999 ts_tablet_manager.cc:1403] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 1.182s	user 0.021s	sys 0.038s
I20260709 12:17:48.987470 22048 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.971885 21965 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:48.977933 21963 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:17:49.027693 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 58660.4us
I20260709 12:17:49.036685 20250 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:49.123859 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:49.035718 21922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60778 (request call id 2) took 3622 ms. Trace:
I20260709 12:17:49.099498 21986 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:49.181314 21999 raft_consensus.cc:359] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:49.182577 21999 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
W20260709 12:17:49.185626 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48802us
I20260709 12:17:49.144259 21972 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:49.135282 21987 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:49.198812 22076 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:49.207510 20176 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:49.190104 21972 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:49.213296 21968 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:49.213806 21968 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:49.213542 21972 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:49.214727 21968 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:49.216045 22075 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:17:49.215195 21972 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:49.244541 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.188719 21999 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:49.253121 21999 ts_tablet_manager.cc:1434] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.265s	user 0.009s	sys 0.000s
I20260709 12:17:49.131671 21922 rpcz_store.cc:276] 0709 12:17:45.402761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.405323 (+  2562us) service_pool.cc:224] Handling call
0709 12:17:45.413096 (+  7773us) log.cc:844] Serialized 506 byte log entry
0709 12:17:49.024618 (+3611522us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":377,"raft.queue_time_us":15321,"raft.run_cpu_time_us":1694,"raft.run_wall_time_us":2677,"thread_start_us":62943,"threads_started":1,"wal-append.queue_time_us":53424,"wal-append.run_cpu_time_us":15866,"wal-append.run_wall_time_us":1317915}
I20260709 12:17:49.260507 20340 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-ae0621ca652d416d9284323ec7eb2363 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:17:49.261001 20340 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-ae0621ca652d416d9284323ec7eb2363 on tablet ae0621ca652d416d9284323ec7eb2363 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:49.221637 21983 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:17:49.270644 20322 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:49.273082 20327 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:49.286082 20190 tablet_copy_source_session.cc:215] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:17:49.281654 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46476.1us
I20260709 12:17:49.281121 22035 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:49.322326 20074 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.325379 20074 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 3, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:49.335175 20328 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:49.326738 22062 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:17:49.346719 20324 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:49.320824 21034 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEARNER]: Advancing to term 4
I20260709 12:17:49.357125 20179 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:49.370126 22088 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:49.373654 22046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.388870 22087 raft_consensus.cc:1064] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:49.395656 21988 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:49.396399 21988 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:49.403049 21988 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:49.411743 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.396749 22087 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:49.406831 21966 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:17:49.415863 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:49.426738 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:49.410836 20253 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:49.439137 21968 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.453891 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:49.460776 21988 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:49.471259 20073 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.488528 21900 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.489187 21900 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:49.536600 21900 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:49.543367 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:49.549157 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:49.549817 20174 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:49.553826 20075 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.562359 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:49.702654 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:49.704643 22035 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:49.705052 22035 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.705375 22035 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:49.729167 20248 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:49.811874 22057 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.834321 20175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42088
I20260709 12:17:49.837566 20175 raft_consensus.cc:606] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:17:49.859220 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 103549us
W20260709 12:17:49.879385 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 130503us
I20260709 12:17:49.836601 22046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53128 (request call id 196) took 2095 ms. Trace:
I20260709 12:17:49.882004 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:49.886175 20324 raft_consensus.cc:606] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:17:49.884426 21043 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:49.858409 22057 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:49.936579 22035 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:49.949252 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 115429us
W20260709 12:17:49.950933 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48662.7us
I20260709 12:17:49.926975 21968 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:50.024303 22035 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:49.885705 22046 rpcz_store.cc:276] 0709 12:17:47.741401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.741516 (+   115us) service_pool.cc:224] Handling call
0709 12:17:47.881685 (+140169us) ts_tablet_manager.cc:934] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
0709 12:17:49.371361 (+1489676us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:49.464200 (+ 92839us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:49.509956 (+ 45756us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:49.730315 (+220359us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:49.770389 (+ 40074us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:49.831847 (+ 61458us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:49.835315 (+  3468us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":83141,"tablet-copy.queue_time_us":78733,"thread_start_us":497741,"threads_started":2}
I20260709 12:17:50.058806 22046 tablet_copy_client.cc:806] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:50.059538 22046 tablet_copy_client.cc:670] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
W20260709 12:17:50.079798 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 82652us
I20260709 12:17:50.081135 22057 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.031193 22105 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:17:50.150806 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 197015us
I20260709 12:17:50.174589 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:50.176270 20173 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:50.188783 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 236772us
I20260709 12:17:50.195680 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:50.206691 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:50.232092 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:50.234028 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:50.248508 20323 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.252946 20323 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:50.305033 22033 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.305963 22033 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.309100 22087 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.309573 22040 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.309981 22087 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.310321 22040 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.333299 21966 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.333581 22079 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.334182 21972 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.334235 21966 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.334575 22079 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.335140 21972 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.328217 20173 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
W20260709 12:17:50.342716 20219 consensus_peers.cc:597] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94a451623b3d4ba9b27eb7e8b56cb47a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:50.343924 22020 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:50.344839 22020 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.337378 21966 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.349231 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.379344 21987 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.380365 21987 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.383461 22088 raft_consensus.cc:993] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:50.384502 22078 raft_consensus.cc:1081] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:17:50.386062 22020 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:50.386943 22033 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.388322 22040 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.400544 21963 raft_consensus.cc:993] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: : Instructing follower 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:50.401273 21963 raft_consensus.cc:1081] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Signalling peer 85fa447fc35d4f88ab7c85630749ec78 to start an election
I20260709 12:17:50.401393 20254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:17:50.402251 20254 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.402666 20254 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.411257 22087 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.430047 22079 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:50.447683 22040 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.448483 22040 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.450994 22040 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.455184 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.456100 20325 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:50.456923 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.457300 22123 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:50.457821 20327 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:50.461144 22087 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:50.461179 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.464003 20176 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:50.464039 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.461679 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.464912 20248 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:50.465407 20178 raft_consensus.cc:2368] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:50.465658 21987 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:50.466837 21972 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.467461 21972 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.468108 21972 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.468259 20254 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.470700 21972 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:50.471293 21968 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.506718 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.508073 20295 leader_election.cc:400] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:50.508414 20295 leader_election.cc:403] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:50.509791 22009 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:50.510012 22084 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.510242 22009 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.510718 22009 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.517844 20327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:42162
I20260709 12:17:50.519178 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.519681 20254 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.517740 21968 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.531955 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:50.532550 22046 tablet_copy_client.cc:538] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:50.533068 21036 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 2: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:17:50.534698 20327 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.535156 20327 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.537566 21972 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.537686 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.538354 20173 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:50.538215 21972 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.527315 21968 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:50.544217 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.544946 20175 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:17:50.547366 21972 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:17:50.551743 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 64877.7us
I20260709 12:17:50.562687 20327 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.561000 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:50.573007 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.574062 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.577926 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.579244 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.586352 20254 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:50.579847 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:50.580545 20175 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:50.581182 22009 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.581874 21986 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.585709 20173 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:50.591305 20176 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.592734 20248 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:50.595919 20327 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:50.596073 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:50.596661 20175 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:50.597625 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:50.599886 22119 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.600323 22119 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.600663 22119 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.601027 22129 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.601639 22129 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.598646 20324 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:50.604785 20253 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:50.596903 20175 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:50.615818 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.616477 20173 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:50.614082 22020 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:50.620824 22020 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:50.625327 22020 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:50.624642 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 58406.5us
I20260709 12:17:50.638866 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.606168 21986 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:50.619153 20175 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.639767 22040 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:50.653213 20175 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.650192 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.650897 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.654537 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.624589 22087 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:50.701822 20330 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:50.684626 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:50.705106 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.706398 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.708290 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:50.708856 21984 raft_consensus.cc:476] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:17:50.709172 20327 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.710350 22009 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:50.737331 20328 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:50.713163 21986 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:50.713299 22064 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.714016 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:50.705801 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55712.9us
W20260709 12:17:50.700829 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86151.6us
I20260709 12:17:50.733971 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.711141 22129 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:50.741380 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.742062 22084 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:50.742333 20250 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:50.740041 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:50.743314 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:50.742113 21976 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.744221 20178 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:50.744330 21976 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:50.748152 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.748407 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.749015 20330 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:50.749469 21976 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.750501 22046 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:50.750658 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:50.752341 22133 ts_tablet_manager.cc:933] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:50.751457 21037 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:17:50.701555 22040 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.752341 22009 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:50.757477 21986 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:50.757942 21986 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.758351 21986 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.760010 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:50.760715 20322 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:50.761116 20322 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:50.762666 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:50.765118 20322 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.753621 22087 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:50.766204 20322 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.746155 22064 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.771077 22064 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.762370 22009 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:50.776659 22009 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.784673 20325 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:50.827152 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.832154 20323 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:17:50.761771 22040 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.839767 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:17:50.840785 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55225.5us
I20260709 12:17:50.746266 22119 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.840886 22129 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:50.848721 22112 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.851493 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:50.884133 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.850977 22129 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.899937 22129 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:50.900115 20248 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:50.898428 20255 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:50.904620 20324 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:50.908811 20175 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:50.916787 20176 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:50.879848 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:50.879033 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:50.939090 20322 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:17:50.956774 20256 raft_consensus.cc:2368] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:50.959022 20252 raft_consensus.cc:2393] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 2: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:50.963944 22119 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.895215 22112 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:50.969233 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 104905us
I20260709 12:17:50.767203 22087 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.924322 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:50.969135 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68044.2us
W20260709 12:17:50.975474 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 51259.5us
I20260709 12:17:50.976457 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.982355 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:50.980410 22079 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:50.986652 22079 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:50.984323 21972 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.987666 21972 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.988055 21972 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.991771 22132 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:50.991859 22084 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:50.992403 22132 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:50.992627 22084 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:50.994801 22132 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:50.994527 22084 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:50.997035 21972 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.011962 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:51.046684 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 64407.5us
I20260709 12:17:51.063144 22133 tablet_copy_client.cc:323] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:17:51.064612 22030 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:51.065306 22030 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.065769 22030 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.067658 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.068536 20179 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.066949 22020 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.071801 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.072628 20247 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.073418 22020 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.092039 22127 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:51.092803 22127 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.093276 22127 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.095819 22112 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.097216 22079 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:51.100381 22064 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.101560 21036 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:17:51.102833 22064 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:51.110078 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81243.8us
I20260709 12:17:51.057628 20295 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:17:51.111308 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100958us
W20260709 12:17:51.127765 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 80223.9us
I20260709 12:17:51.130649 21968 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:51.161916 22139 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:51.164713 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 159244us
I20260709 12:17:51.173283 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.177238 20247 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:51.181115 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:51.181809 20173 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:17:51.157639 21968 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:51.190853 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:51.193647 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:51.195312 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:51.196110 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:51.199398 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.200165 22112 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:51.200712 22112 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.201089 22112 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.200098 22033 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:51.203079 22033 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.203470 22033 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.182873 21972 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.209740 22064 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:51.210264 22064 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.210677 22064 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.211813 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:51.213495 21968 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.215938 20295 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.216728 22142 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:51.217083 22142 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:51.217394 22142 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.171993 21984 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
W20260709 12:17:51.223165 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.231990 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.232897 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:51.237495 22040 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.225036 20179 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
W20260709 12:17:51.246755 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 194037us
I20260709 12:17:51.249861 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.244401 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.261526 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:51.269797 22009 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.240170 21986 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:51.273324 21986 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:51.278141 20252 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:17:51.275133 22112 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.280752 22040 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.281335 22112 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.281435 21035 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:51.283648 22127 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.285809 22127 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.291249 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:51.310989 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.316838 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:51.319999 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 162113us
I20260709 12:17:51.321839 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.322458 20247 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.319370 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:17:51.328858 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 135295us
I20260709 12:17:51.328171 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:51.310066 22145 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:51.335477 20174 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.289302 22033 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.341099 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:51.347769 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.348498 21972 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:51.348982 21972 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.348644 20179 raft_consensus.cc:2368] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:51.347695 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.354979 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.355301 22009 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:51.355605 20321 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.364214 20295 leader_election.cc:400] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:51.364532 20295 leader_election.cc:403] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:51.351730 21972 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.381145 22119 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:51.374689 20321 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:51.385834 20174 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:17:51.391424 22129 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.365065 22033 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.350090 22030 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.387804 22119 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:51.395843 22030 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.395640 22119 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.374593 22064 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.400861 20247 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:51.398862 22084 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:51.391348 22145 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:51.406432 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 78381.4us
I20260709 12:17:51.406983 20323 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:51.409860 22149 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:51.410696 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:51.410434 22149 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.380594 22138 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:51.411326 21040 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:17:51.409874 22145 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.416019 22129 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.420735 21036 raft_consensus.cc:2368] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3.
I20260709 12:17:51.425777 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.426802 22030 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:51.427279 22030 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:17:51.427997 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 87005.1us
I20260709 12:17:51.417903 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.430919 22030 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.431733 22064 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.433619 22087 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:51.436111 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:51.436739 21043 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.441495 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 94a451623b3d4ba9b27eb7e8b56cb47a from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:17:51.442039 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 94a451623b3d4ba9b27eb7e8b56cb47a from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-94a451623b3d4ba9b27eb7e8b56cb47a
I20260709 12:17:51.442454 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.444218 20323 raft_consensus.cc:2368] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8.
I20260709 12:17:51.444300 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:51.443358 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.445237 21035 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:17:51.445286 20325 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:51.446868 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:51.449788 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.450687 20323 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:51.454535 20219 leader_election.cc:400] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3.
I20260709 12:17:51.455845 20330 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:51.457482 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.458040 20247 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.467420 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.468173 20325 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.473662 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.474548 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.475319 20179 raft_consensus.cc:2368] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3.
I20260709 12:17:51.459609 21972 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:51.476775 20172 raft_consensus.cc:2368] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:51.477766 21972 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.479075 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:51.479724 20174 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 1.
I20260709 12:17:51.479842 20295 leader_election.cc:400] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:51.480176 20295 leader_election.cc:403] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:51.480803 21986 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.482926 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.483793 22111 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:51.484380 22111 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:51.485364 22111 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.494105 20325 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:51.500687 22145 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.365710 22142 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:51.453922 21968 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:51.508569 22149 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.509167 20073 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 4, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.510846 21043 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:17:51.511677 21986 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
W20260709 12:17:51.515899 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44482.9us
I20260709 12:17:51.524063 20324 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:51.541252 20247 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:17:51.547108 21968 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:51.548805 20180 raft_consensus.cc:2368] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 9.
I20260709 12:17:51.548417 21968 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.541085 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:51.553015 21972 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:51.557157 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.557988 20254 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:51.560496 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.564788 22142 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:51.571921 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.572683 20324 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:51.620678 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 278947us
I20260709 12:17:51.617551 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:51.579222 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.572198 22145 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.623468 21043 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.623473 20174 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.634140 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.635053 20254 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.637904 21043 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:51.606508 20075 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.645915 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:51.651122 20254 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:51.651938 20075 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.652906 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.656708 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.661456 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:51.660257 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.666476 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:51.667989 20295 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.683092 22046 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:51.684423 22132 raft_consensus.cc:1064] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:51.674590 22140 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:51.687754 22091 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:51.688197 22140 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:51.688344 22091 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:51.689112 21972 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:51.689190 22140 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.689366 22091 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:51.691088 22145 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:51.691671 22145 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.693933 22145 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.672179 22127 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:51.694625 22127 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:51.695676 22127 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.698753 22046 tablet_bootstrap.cc:492] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:17:51.581593 22111 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:17:51.700702 20174 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:51.689749 21972 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.703416 22142 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:51.709024 21972 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.709466 22142 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.710029 22142 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:51.713141 22111 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:51.718550 20330 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:51.717657 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:51.724627 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.725770 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.726938 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:51.727535 21036 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.729920 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:51.701359 22046 ts_tablet_manager.cc:1403] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.951s	user 0.048s	sys 0.017s
I20260709 12:17:51.736153 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:51.713726 22111 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.745885 22141 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:51.755980 22141 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:51.757853 22111 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:51.758469 22141 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:51.746619 22145 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.687346 22132 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.753162 20074 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.711125 22142 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:51.760190 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134266us
I20260709 12:17:51.744081 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:51.773033 22152 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:51.773581 22152 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:51.773615 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:51.773846 22145 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:51.774529 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:51.774672 22152 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:51.775450 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:51.776121 22142 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.776284 20178 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:17:51.785399 20294 leader_election.cc:400] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:51.786304 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:51.763453 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:51.790194 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:51.798466 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:51.800164 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.801154 20254 raft_consensus.cc:2368] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:51.850222 20178 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:17:51.860003 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.860900 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.861724 20254 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:17:51.863912 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:51.774596 22145 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.918839 20255 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:51.922379 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.927603 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.918505 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:51.937747 22157 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:17:51.942220 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 143876us
I20260709 12:17:51.943361 22046 raft_consensus.cc:359] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:51.944522 22046 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:17:51.945257 22046 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:51.947300 22046 ts_tablet_manager.cc:1434] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.215s	user 0.009s	sys 0.004s
I20260709 12:17:51.948361 22104 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:51.948635 20173 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:51.926999 22087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40214 (request call id 19) took 2633 ms. Trace:
I20260709 12:17:51.950235 21963 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:51.961699 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 296146us
I20260709 12:17:51.974530 21008 leader_election.cc:400] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3.
I20260709 12:17:51.976361 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:51.975431 21008 leader_election.cc:403] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:51.974165 20250 raft_consensus.cc:2368] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:51.983922 20294 leader_election.cc:400] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3.
I20260709 12:17:51.985608 21008 leader_election.cc:400] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 9.
I20260709 12:17:51.986445 21008 leader_election.cc:403] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:51.996373 20254 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:51.996279 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:52.004338 21007 leader_election.cc:400] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8.
I20260709 12:17:51.950883 22157 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:51.981335 22146 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3.
I20260709 12:17:51.960044 22087 rpcz_store.cc:276] 0709 12:17:49.288468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.288630 (+   162us) service_pool.cc:224] Handling call
0709 12:17:49.408986 (+120356us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b5400396320. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae75520 00007f5ddaefeb42 00007f5ddaefd800 00007f5ddfebed29 00007f5dd943d1d4 00007f5dd943d162 00007f5dd943d091 00007f5dd943d00c 00007f5dd943c2c2 00007f5dd923348c
0709 12:17:49.490834 (+ 81848us) log.cc:844] Serialized 506 byte log entry
0709 12:17:50.106257 (+615423us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b2c00000448. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9800a0a 00007f5dd9800693 00007f5dd9800631 00007f5ddaf34b52 00007f5ddaf34cf5 00007f5ddae71691 00007f5ddae51eaa 00007f5ddae58d53 00007f5ddae58cd9 00007f5ddae58c69
0709 12:17:50.116013 (+  9756us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b180017ce20. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaf34d01 00007f5ddae71691 00007f5ddae51eaa 00007f5ddae58d53 00007f5ddae58cd9 00007f5ddae58c69 00007f5ddae58c31 00007f5ddae57dfd 0000000000388634 0000000000388479
0709 12:17:51.889134 (+1773121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75605,"raft.queue_time_us":235818,"raft.run_cpu_time_us":6655,"raft.run_wall_time_us":176163,"spinlock_wait_cycles":300392960,"thread_start_us":420210,"threads_started":2,"wal-append.queue_time_us":447731,"wal-append.run_cpu_time_us":2172,"wal-append.run_wall_time_us":1098783}
I20260709 12:17:52.026269 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:52.028244 20190 tablet_copy_service.cc:342] P f5c544fad8874e818acaad733a9d14f1: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-cb4da77a6bb24e4f94abb2f4bd8a7f9e received from {username='slave'} at 127.0.0.1:60784
I20260709 12:17:52.028766 20190 tablet_copy_service.cc:434] P f5c544fad8874e818acaad733a9d14f1: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-cb4da77a6bb24e4f94abb2f4bd8a7f9e on tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:52.028955 22157 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:51.980044 22145 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:52.009588 22165 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.015851 20324 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:51.989476 21968 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:52.018086 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:52.022279 20322 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:52.040445 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:52.081290 22143 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:17:52.051213 21039 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:52.085865 21040 raft_consensus.cc:1217] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:52.085639 22165 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:52.082175 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 94852.8us
W20260709 12:17:52.085801 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78669.4us
I20260709 12:17:52.092270 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:52.093035 20322 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.046880 22009 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:52.075723 22167 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:52.090688 22165 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:52.096877 22165 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:52.098050 22165 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:52.023483 21036 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:17:52.072279 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:52.115770 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:52.131870 22162 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 9.
I20260709 12:17:52.113837 22164 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:17:52.106119 21040 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:52.110587 22111 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:52.133675 22111 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:52.134598 22111 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:52.136868 22104 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:52.086851 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:52.143270 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:52.116147 22173 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:52.136904 21972 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:52.146287 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:52.109970 21035 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:17:52.165356 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.165529 22180 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:52.166114 22180 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:52.101649 22157 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:52.172626 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:52.173913 22173 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:52.167079 22180 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:52.171451 21972 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.178448 21963 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:52.216135 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:52.218590 20322 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:52.211760 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:52.178037 21968 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.196554 22111 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.253701 20325 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:52.256918 22127 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:52.220932 21963 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:52.260849 21963 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:52.215626 21972 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:52.253149 22173 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:52.187023 22172 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:52.267757 20075 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 6, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:52.293023 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81650.8us
I20260709 12:17:52.293804 20172 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:52.295133 20179 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:52.304256 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:52.305280 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:52.310381 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53921.2us
I20260709 12:17:52.312634 21963 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:52.314201 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74659.7us
I20260709 12:17:52.327785 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:17:52.329466 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 116260us
I20260709 12:17:52.330502 22104 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:52.173885 22138 consensus_queue.cc:1175] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "85fa447fc35d4f88ab7c85630749ec78" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:52.334097 20253 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:52.334116 21035 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:52.344131 20294 leader_election.cc:400] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:17:52.326658 22162 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:52.327767 22139 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:52.355885 20294 consensus_peers.cc:597] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94a451623b3d4ba9b27eb7e8b56cb47a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.360679 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:52.364044 20253 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:52.365011 21039 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:52.351475 20180 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:52.384469 20250 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:52.358083 21968 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:17:52.483791 20180 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:52.400799 20325 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:52.454526 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51871.9us
W20260709 12:17:52.468987 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.455389 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.765910 22195 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
W20260709 12:17:52.671058 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 320694us
I20260709 12:17:52.461561 21968 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.394s
I20260709 12:17:52.498364 22191 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:52.806526 22167 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:52.849160 21986 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.599846 22139 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:52.915730 22183 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:52.916549 22183 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:52.926231 22183 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:52.939359 22111 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.002s
I20260709 12:17:52.940075 22204 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:52.909914 22167 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:52.908100 21986 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:52.953694 22091 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:52.960238 22176 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:52.961023 22176 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:52.964358 21986 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:52.902544 22191 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:52.954555 22091 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.020247 22091 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:52.997407 22176 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:52.981436 22139 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:53.089790 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 235054us
I20260709 12:17:53.083976 22209 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:17:53.084503 22180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.086s	sys 0.123s
I20260709 12:17:53.082440 22167 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.102705 20247 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:17:53.099155 22180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.086s	sys 0.124s
I20260709 12:17:53.092756 22176 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:53.112316 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.113220 22176 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.113613 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.119483 22197 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:17:53.115660 22209 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.128304 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.132771 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.140231 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:53.148136 22217 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.148808 22217 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.152719 22035 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:17:53.154171 22214 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:53.154803 22214 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.157086 22214 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.158393 22217 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.158658 22176 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:53.158965 22214 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.161680 22214 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.172027 22214 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.149830 22091 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:53.197327 22127 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.203984 20324 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:53.172260 20266 tablet_copy_source_session.cc:215] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:53.204738 20324 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:53.211489 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:53.224395 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:53.224606 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:53.225147 20321 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:17:53.214309 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50296us
I20260709 12:17:53.210587 20324 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.232192 20324 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:53.199120 21972 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.233143 20266 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:40218 (request call id 364) took 1783 ms. Trace:
I20260709 12:17:53.234336 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:53.236734 22222 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:17:53.237648 20266 rpcz_store.cc:276] 0709 12:17:51.440932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.441207 (+   275us) service_pool.cc:224] Handling call
0709 12:17:52.110396 (+669189us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5400396320. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaf024a5 00007f5ddaf023ee 00007f5ddfe98036 00007f5ddfea1a3e 00007f5dd776527b 00007f5ddfea19ba 00007f5ddfe9cacc 00007f5ddfe97c7b 00007f5ddfe8c8d1
0709 12:17:52.125958 (+ 15562us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54002fbf54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaf023f7 00007f5ddfe98036 00007f5ddfea1a3e 00007f5dd776527b 00007f5ddfea19ba 00007f5ddfe9cacc 00007f5ddfe97c7b 00007f5ddfe8c8d1 00007f5ddef404b4 00007f5ddef40442
0709 12:17:53.172141 (+1046183us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54002fbf54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5ddfe981bb 00007f5ddfea1a3e 00007f5dd776527b 00007f5ddfea19ba 00007f5ddfe9cacc 00007f5ddfe97c7b 00007f5ddfe8c8d1 00007f5ddef404b4 00007f5ddef40442
0709 12:17:53.224620 (+ 52479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219579264}
I20260709 12:17:53.245357 20323 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:53.240144 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:53.239063 20180 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:53.225346 22152 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.263734 20176 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:53.233496 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:53.266836 20330 raft_consensus.cc:606] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:53.226950 22129 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:53.204710 22127 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.309132 22219 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:53.310385 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:53.308243 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44069.4us
I20260709 12:17:53.245471 22183 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.290400 22138 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.351140 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:53.360373 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:53.363168 20256 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:17:53.363718 20256 pending_rounds.cc:85] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 4
I20260709 12:17:53.368611 20254 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:53.364022 20256 pending_rounds.cc:107] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:53.372002 20256 raft_consensus.cc:2889] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:53.372802 20324 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:17:53.373286 20324 pending_rounds.cc:85] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 9
I20260709 12:17:53.373687 20324 pending_rounds.cc:107] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:17:53.311411 22129 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.319695 22152 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.373974 20324 raft_consensus.cc:2889] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:53.335819 22183 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:53.346297 22221 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:17:53.383826 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.417433 22127 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.362682 22138 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:53.419425 22152 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.420285 22138 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.384269 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:53.390576 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.390820 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:53.430145 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45986.5us
W20260709 12:17:53.438565 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 127053us
I20260709 12:17:53.382808 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a451623b3d4ba9b27eb7e8b56cb47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:53.450744 22227 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:53.421175 22129 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.374148 22142 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:17:53.484212 22152 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.485097 22152 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.488046 22152 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.476604 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:53.455940 22138 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.512315 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:53.524307 22216 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 12:17:53.529059 22188 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:17:53.529760 22216 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.530409 22216 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.531549 22183 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:53.519377 22138 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.527527 22204 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:53.533352 22204 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.534498 22138 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:53.556895 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 243294us
I20260709 12:17:53.620143 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:53.652657 22127 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:53.653129 22127 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.653499 22127 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:53.663260 21039 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:17:53.548187 22221 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.617364 22216 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.615198 22138 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.812633 22087 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:53.814477 21986 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.864041 22084 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.864792 22084 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.867132 22084 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.872044 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:53.830066 22142 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.811792 22221 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.832047 22111 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:53.826893 22138 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.900116 22020 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.874418 22204 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:53.903923 22020 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.920239 22232 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:53.920967 22232 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:53.922299 22020 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:53.891928 22084 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:53.849619 22181 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:17:53.874976 21986 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.887874 22087 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:53.892268 22142 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:53.923545 22232 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:53.967762 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.012s
I20260709 12:17:53.904904 22111 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:53.976222 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.004s	sys 0.012s
W20260709 12:17:53.977901 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 546188us
I20260709 12:17:53.979682 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:17:53.969004 22226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.014s
I20260709 12:17:53.934527 22084 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:53.992381 22226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.004s	sys 0.014s
I20260709 12:17:54.015962 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:54.012656 20296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.025s	sys 0.105s
W20260709 12:17:54.028409 20296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.026s	sys 0.105s
W20260709 12:17:53.995436 22214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.002s	sys 0.029s
I20260709 12:17:54.035048 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.011986 22176 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:54.038163 22214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.002s	sys 0.029s
I20260709 12:17:54.041476 22176 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:54.080924 20255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.019s	sys 0.045s
I20260709 12:17:54.073751 22176 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:54.081321 20255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.020s	sys 0.045s
W20260709 12:17:54.087953 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86431us
I20260709 12:17:54.105638 22127 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:54.082994 22237 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:54.083511 22216 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:17:54.106848 22229 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.654s	user 0.008s	sys 0.006s
I20260709 12:17:54.107877 21986 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.108457 22221 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.109335 22084 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.110260 22138 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.081203 22238 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:54.074566 22204 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:17:54.146608 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 100982us
W20260709 12:17:54.163450 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 68489.8us
W20260709 12:17:54.160857 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 128858us
I20260709 12:17:54.133478 22252 raft_consensus.cc:993] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:54.171761 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:54.172559 20323 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:54.172610 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.173170 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:54.179355 22154 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:54.164880 22142 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:54.150978 22216 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.148284 22237 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:54.211527 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 128326us
I20260709 12:17:54.213798 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.213994 22248 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:54.217317 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 238) took 1860 ms. Trace:
I20260709 12:17:54.217759 21036 rpcz_store.cc:276] 0709 12:17:52.356808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.360408 (+  3600us) service_pool.cc:224] Handling call
0709 12:17:52.420938 (+ 60530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:52.462483 (+ 41545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.466933 (+  4450us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:53.333067 (+866134us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b2c000bb028. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:17:53.333579 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:17:53.453429 (+119850us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:53.453482 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.453567 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.106263 (+652696us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:17:54.208321 (+102058us) raft_consensus.cc:1685] finished
0709 12:17:54.209667 (+  1346us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.217222 (+  7555us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63221,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"spinlock_wait_cycles":75319552,"thread_start_us":119284,"threads_started":1,"wal-append.queue_time_us":118715}
I20260709 12:17:54.220417 22235 raft_consensus.cc:1081] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:54.195647 22173 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.192584 22181 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:17:54.172465 22238 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.214792 22248 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.232038 20177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:54.232620 20177 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:54.233002 20177 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.209772 22127 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.236729 22257 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:17:54.241647 22243 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:17:54.242238 22237 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:54.233403 22173 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:17:54.239059 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 63342.1us
I20260709 12:17:54.244984 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.250926 22216 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:54.251447 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2370) took 1005 ms. Trace:
I20260709 12:17:54.253307 22238 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.254299 22176 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:54.251847 20176 rpcz_store.cc:276] 0709 12:17:53.246503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.246645 (+   142us) service_pool.cc:224] Handling call
0709 12:17:53.252484 (+  5839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.266450 (+ 13966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.251231 (+984781us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b540031a1d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:54.251385 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12684672}
I20260709 12:17:54.253361 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1732) took 1033 ms. Trace:
I20260709 12:17:54.260383 22209 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.261449 22111 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.263242 22139 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.237404 22257 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.264138 22087 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.257332 20173 rpcz_store.cc:276] 0709 12:17:53.219656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.220280 (+   624us) service_pool.cc:224] Handling call
0709 12:17:53.220459 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.338002 (+117543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:53.338046 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:53.338100 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:53.338149 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.253133 (+914984us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000a5854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:54.253185 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.253305 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269774720}
I20260709 12:17:54.270292 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 202) took 2106 ms. Trace:
I20260709 12:17:54.270635 20330 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:54.288605 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.271277 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.275446 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.289667 20324 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:17:54.276237 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.277065 22176 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:54.283464 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:17:54.283437 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68251us
I20260709 12:17:54.285893 22205 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:54.285056 20177 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:54.293870 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.296738 20174 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:17:54.300349 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.295725 22248 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.305140 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.305330 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.301124 22177 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.306540 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.306620 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.316532 20177 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.284549 22262 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:17:54.301872 22225 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.837s	user 0.005s	sys 0.024s
I20260709 12:17:54.321077 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.306139 22177 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:54.301774 22087 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.336549 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:54.331972 22262 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.337733 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.302687 22127 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:17:54.325533 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.347470 22260 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.347766 21984 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:54.349561 21984 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:54.351209 22194 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:54.351517 20074 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 2 to 3, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:54.352591 22194 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:54.352921 22194 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:54.353255 20074 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 8, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.350327 21984 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:54.360832 22258 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:17:54.288389 20075 rpcz_store.cc:276] 0709 12:17:52.164287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.174837 (+ 10550us) service_pool.cc:224] Handling call
0709 12:17:54.270204 (+2095367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:52.324290 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:52.334707 (+ 10417us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:52.334745 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:17:52.334757 (+    12us) tablet.cc:662] Decoding operations
0709 12:17:52.335140 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:52.335210 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:52.335236 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:52.335438 (+   202us) tablet.cc:701] Row locks acquired
0709 12:17:52.335452 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:17:52.343154 (+  7702us) write_op.cc:270] Start()
0709 12:17:52.348369 (+  5215us) write_op.cc:276] Timestamp: P: 1783599472335556 usec, L: 0
0709 12:17:52.348391 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:52.460030 (+111639us) log.cc:844] Serialized 536 byte log entry
0709 12:17:54.074783 (+1614753us) op_driver.cc:464] REPLICATION: finished
0709 12:17:54.142935 (+ 68152us) write_op.cc:301] APPLY: starting
0709 12:17:54.143057 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:54.143175 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:54.143343 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:54.143697 (+   354us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:54.143947 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:54.144015 (+    68us) write_op.cc:312] APPLY: finished
0709 12:17:54.144323 (+   308us) log.cc:844] Serialized 23 byte log entry
0709 12:17:54.144556 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:54.144672 (+   116us) write_op.cc:454] Released schema lock
0709 12:17:54.144738 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:54.145199 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:54.145239 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":67201,"apply.run_cpu_time_us":2273,"apply.run_wall_time_us":2268,"num_ops":1,"prepare.queue_time_us":2197,"prepare.run_cpu_time_us":3483,"prepare.run_wall_time_us":237300,"replication_time_us":1703346,"thread_start_us":51861,"threads_started":1}]]}
I20260709 12:17:54.370498 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.370731 22209 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.339140 22087 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:54.372620 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 919249us
I20260709 12:17:54.348088 22260 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.322849 22205 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.354965 20074 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67), now has a pending config: VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65), VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66), VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67), NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:54.382869 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.378890 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.386507 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.387058 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.387342 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.387408 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.375450 20326 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:54.390362 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.353744 22194 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:54.375777 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.408361 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:54.427613 22257 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.428148 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:54.429850 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 650) took 1270 ms. Trace:
I20260709 12:17:54.430200 21043 rpcz_store.cc:276] 0709 12:17:53.159872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.427844 (+1267972us) service_pool.cc:224] Handling call
0709 12:17:54.429751 (+  1907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:54.448660 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:54.464149 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60826.3us
W20260709 12:17:54.464295 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68796.4us
I20260709 12:17:54.374795 22209 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:54.470309 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.391746 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 241) took 1194 ms. Trace:
I20260709 12:17:54.473292 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.474252 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.394068 22164 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.403817 22235 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.433271 22091 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:54.438225 22140 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.410110 22152 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:17:54.507778 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81504.8us
I20260709 12:17:54.884254 21963 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:54.696345 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:54.402546 22177 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.438517 22259 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:54.683794 20179 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:54.716660 22251 raft_consensus.cc:1064] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:17:54.515172 20327 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:54.505033 22238 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:17:54.998046 20171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.023s	sys 0.080s
W20260709 12:17:55.023437 20171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.023s	sys 0.080s
W20260709 12:17:54.894634 22264 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 12:17:54.688835 22201 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.719591 22214 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:54.718962 22262 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.703908 22064 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.651916 22142 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:55.012652 22111 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.820510 22257 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:54.893630 22163 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.644007 22172 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.040038 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.998054 22087 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:54.998584 22035 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:54.569116 22212 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:54.718468 22211 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:55.041801 22009 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.051530 22157 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.016605 22141 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:54.722756 21984 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:54.571269 22260 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:55.065429 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 262) took 1264 ms. Trace:
W20260709 12:17:55.080716 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.016s	sys 0.012s
I20260709 12:17:55.027070 22152 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.047772 22180 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:55.062603 22205 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:54.512501 22235 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:55.109730 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.016s	sys 0.012s
I20260709 12:17:55.100749 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:54.512806 22164 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:55.068503 22248 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:17:55.132754 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 118664us
I20260709 12:17:55.082928 22176 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.035293 22238 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.038136 22091 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:55.169353 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:55.136736 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:55.057592 22201 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.137796 22226 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:55.138609 22228 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:55.042135 21963 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.081099 22087 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:17:55.141593 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.048681 22214 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.060555 22064 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.065852 22111 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.139616 22262 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.060427 22142 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.088987 22035 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.030298 22140 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.107671 20328 rpcz_store.cc:276] 0709 12:17:53.791696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.792732 (+  1036us) service_pool.cc:224] Handling call
0709 12:17:53.823789 (+ 31057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:53.976380 (+152591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:53.976417 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.004143 (+ 27726us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.173764 (+169621us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:54.173802 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.025180 (+851378us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540040a1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:55.025253 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.025322 (+    69us) raft_consensus.cc:1685] finished
0709 12:17:55.025342 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.055972 (+ 30630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10956,"raft.queue_time_us":1361,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":24836,"spinlock_wait_cycles":349896960,"thread_start_us":124782,"threads_started":1,"wal-append.queue_time_us":212899}
I20260709 12:17:55.075436 22172 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:54.476289 21035 rpcz_store.cc:276] 0709 12:17:53.195251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.195388 (+   137us) service_pool.cc:224] Handling call
0709 12:17:53.196110 (+   722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:53.196724 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:53.196766 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:53.199092 (+  2326us) log.cc:844] Serialized 564 byte log entry
0709 12:17:53.373957 (+174865us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:53.379027 (+  5070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.383378 (+  4351us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.265870 (+882492us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:17:54.372527 (+106657us) raft_consensus.cc:1685] finished
0709 12:17:54.372554 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.389234 (+ 16680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11463552,"thread_start_us":124326,"threads_started":1,"wal-append.queue_time_us":239089}
I20260709 12:17:55.169955 22176 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:55.190348 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 55169us
I20260709 12:17:55.110275 22209 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:55.200842 20173 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:55.085242 22257 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.124503 22180 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.103704 22009 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.146068 22261 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:17:55.221320 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.000s	sys 0.057s
I20260709 12:17:55.249065 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:55.249394 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.000s	sys 0.057s
I20260709 12:17:55.221783 20255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "85fa447fc35d4f88ab7c85630749ec78"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:55.249423 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:17:55.249751 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 782637us
I20260709 12:17:55.250053 20255 raft_consensus.cc:606] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:17:55.250290 20328 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:55.110206 22157 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:17:55.217644 22221 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.126251 22211 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.232834 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.235256 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:17:55.224089 22258 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:55.212035 22205 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.146220 22248 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.217569 22232 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.101810 22163 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.144762 22212 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.249775 20254 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:55.346135 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.346921 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.287545 22272 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.285741 20256 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:55.250995 22209 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:55.347692 20253 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:55.226883 22262 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.344785 22273 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:55.116122 22141 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.218240 22087 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.347281 20247 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:55.360111 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:55.365733 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:55.367538 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:55.368714 20254 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.363922 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:17:55.355726 22133 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.117s	user 0.007s	sys 0.005s
I20260709 12:17:55.216262 22226 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.375758 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.317919 22221 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:55.279718 22227 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:17:55.227694 22228 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.284785 22261 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:55.379881 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:55.475447 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 194607us
I20260709 12:17:55.504448 20254 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:56.153704 22271 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:56.154492 22271 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:56.157265 22283 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:17:56.158066 22271 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.158823 22271 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:55.377369 22272 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.159755 22271 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.163144 22272 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:55.440634 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:56.063174 22111 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:55.698652 22152 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:55.353708 22232 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.166280 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:56.168200 22232 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.170130 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.552824 21984 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:55.355679 22164 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:55.501420 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.163856 22218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.001s	sys 0.031s
I20260709 12:17:55.695327 22138 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:55.368029 22246 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:55.459647 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:17:56.196331 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.020s	sys 0.028s
I20260709 12:17:56.196750 22163 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:55.472796 22258 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:17:56.203140 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.369798 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:56.201488 20329 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:55.475085 22216 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:56.124330 22064 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:55.542505 20251 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:17:56.184486 22266 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.957s	user 0.001s	sys 0.000s
I20260709 12:17:56.128697 22200 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:56.192538 22201 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:56.201790 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.021s	sys 0.028s
I20260709 12:17:56.209491 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:56.217001 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 843362us
I20260709 12:17:56.042497 22219 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:56.186944 22214 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.186430 22176 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.197650 22111 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:56.198676 22272 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.212065 22183 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:17:56.225561 20253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.003s	sys 0.008s
W20260709 12:17:56.225898 20253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.008s
W20260709 12:17:56.207639 22218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.001s	sys 0.032s
I20260709 12:17:56.212608 22211 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:55.366313 22209 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.214797 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:55.437589 22273 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:56.205356 22257 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:55.380138 22205 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.207357 22276 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.148610 22248 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.210244 22271 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.205964 22246 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.210711 21034 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:56.238447 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:56.241962 22133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53112 (request call id 648) took 5710 ms. Trace:
I20260709 12:17:56.242808 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:56.220835 22180 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.236938 22141 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.234397 22285 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.215505 22200 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.229837 22272 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.248533 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:56.237684 22183 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.250754 22087 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.251657 22228 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:17:56.253999 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 814970us
I20260709 12:17:56.266469 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:56.214493 22216 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.238469 22262 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.256817 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2402) took 1120 ms. Trace:
W20260709 12:17:56.269718 20326 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.000s	sys 0.012s
W20260709 12:17:56.270186 20326 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.001s	sys 0.013s
I20260709 12:17:56.024310 22251 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.221673 22219 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.243824 22276 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.292395 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:56.257593 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 656) took 1022 ms. Trace:
W20260709 12:17:56.362452 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 96074us
I20260709 12:17:56.268390 20321 rpcz_store.cc:276] 0709 12:17:55.136403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.137711 (+  1308us) service_pool.cc:224] Handling call
0709 12:17:55.138071 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.302356 (+164285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.302395 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.302440 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:55.302485 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.256634 (+954149us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002d9bd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:56.256668 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.256771 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377228544}
I20260709 12:17:56.303172 22221 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.323299 22273 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.315549 22272 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.247383 22248 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:56.313050 22226 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.270967 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:56.316701 22205 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.369932 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:56.369287 21039 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:56.271277 22246 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.321022 22183 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.374366 22248 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.318882 22298 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:56.387418 22200 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.388767 22248 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.383026 22216 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.390235 22276 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.253513 22133 rpcz_store.cc:276] 0709 12:17:50.531410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.534071 (+  2661us) service_pool.cc:224] Handling call
0709 12:17:50.752808 (+218737us) ts_tablet_manager.cc:934] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
0709 12:17:53.327104 (+2574296us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:54.205884 (+878780us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:54.210057 (+  4173us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:56.198427 (+1988370us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:56.220867 (+ 22440us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:56.241790 (+ 20923us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:56.241859 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":54900,"tablet-copy.queue_time_us":200784,"thread_start_us":326460,"threads_started":2}
I20260709 12:17:56.396267 22133 tablet_copy_client.cc:806] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:56.396916 22133 tablet_copy_client.cc:670] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:56.397702 22219 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.397794 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:56.400585 22173 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.406478 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1252) took 1175 ms. Trace:
I20260709 12:17:56.406829 20330 rpcz_store.cc:276] 0709 12:17:55.231181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.400238 (+1169057us) service_pool.cc:224] Handling call
0709 12:17:56.400647 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.400897 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.400936 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.406240 (+  5304us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:56.406283 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.406329 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.406425 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.411983 21963 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.472676 22140 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.548785 22142 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.583767 22236 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:56.583844 22142 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:56.584570 22236 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.584599 22142 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:56.589491 22212 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:56.590466 22252 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:56.593222 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 387) took 1238 ms. Trace:
I20260709 12:17:56.593669 20247 rpcz_store.cc:276] 0709 12:17:55.356160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.370037 (+ 13877us) service_pool.cc:224] Handling call
0709 12:17:56.592349 (+1222312us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:17:56.592598 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.592801 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.592834 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.592885 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:56.592921 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.592988 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.593123 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21445888}
I20260709 12:17:56.598233 22142 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.601665 22236 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.595521 20247 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:56.608935 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2378) took 2227 ms. Trace:
I20260709 12:17:56.609299 20178 rpcz_store.cc:276] 0709 12:17:54.381896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.382029 (+   133us) service_pool.cc:224] Handling call
0709 12:17:54.401505 (+ 19476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.433783 (+ 32278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.433805 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.433859 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:54.433891 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.608636 (+2174745us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54002378d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:56.608670 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.608762 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73682688}
I20260709 12:17:56.613070 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1249) took 1510 ms. Trace:
W20260709 12:17:56.614146 22249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.006s	sys 0.017s
W20260709 12:17:56.614555 22249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.006s	sys 0.017s
I20260709 12:17:56.613498 20326 rpcz_store.cc:276] 0709 12:17:55.102533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.113599 (+ 11066us) service_pool.cc:224] Handling call
0709 12:17:55.148557 (+ 34958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.169111 (+ 20554us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:56.270587 (+1101476us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.612702 (+342115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.612762 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:56.612815 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.612889 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.613005 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1145106,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":2467,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":1381454,"threads_started":2,"wal-append.queue_time_us":135734}
I20260709 12:17:56.625388 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:56.626986 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:56.628304 20326 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.637466 20326 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:17:56.864277 22285 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:56.864951 22285 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:56.867934 22285 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:56.868532 22285 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:17:56.869436 20253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.001s
I20260709 12:17:56.869143 22285 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.001713 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.003984 20255 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:17:57.005800 20255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1211) took 1688 ms (client timeout 1780 ms). Trace:
W20260709 12:17:57.006290 20255 rpcz_store.cc:269] 0709 12:17:55.317065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.355050 (+ 37985us) service_pool.cc:224] Handling call
0709 12:17:57.005563 (+1650513us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54003caad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:57.005685 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932367744}
I20260709 12:17:57.007710 22272 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.008498 22272 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.009312 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.010772 22272 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:17:57.012486 20256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.038s	sys 0.046s
W20260709 12:17:57.012835 20256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.039s	sys 0.046s
I20260709 12:17:57.013516 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1209) took 1733 ms. Trace:
I20260709 12:17:57.013844 20256 rpcz_store.cc:276] 0709 12:17:55.279669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.355228 (+ 75559us) service_pool.cc:224] Handling call
0709 12:17:56.216048 (+860820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.216429 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.216473 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.236276 (+ 19803us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.013170 (+776894us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:57.013209 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.013271 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.013312 (+    41us) raft_consensus.cc:1685] finished
0709 12:17:57.013323 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.013455 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1914,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3130,"thread_start_us":765260,"threads_started":1,"wal-append.queue_time_us":144615}
I20260709 12:17:57.014662 22285 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:56.365370 21034 rpcz_store.cc:276] 0709 12:17:55.233269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.237809 (+  4540us) service_pool.cc:224] Handling call
0709 12:17:56.255234 (+1017425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.019637 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.021322 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.023413 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.025753 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.026451 20256 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:57.028560 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.030200 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.033088 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.035786 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.038285 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.039281 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.040714 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:17:57.041317 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.043545 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.044664 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.045302 20178 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:57.045861 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.046535 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.047096 20178 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:57.047922 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.048167 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.048476 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.048568 20179 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:57.049183 20174 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:57.049407 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.042002 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.050640 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.050993 22214 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.051347 20172 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:17:57.051627 22214 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.052011 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.053789 22214 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.054253 22214 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.054580 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.054736 22214 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:57.054246 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.056567 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.055895 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.048174 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.058709 22214 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.048782 20173 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:57.056391 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.059504 20178 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:17:57.059722 22142 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:57.060228 22142 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.062326 22142 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.064841 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 243) took 2777 ms. Trace:
I20260709 12:17:57.065330 20175 rpcz_store.cc:276] 0709 12:17:54.287501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.287703 (+   202us) service_pool.cc:224] Handling call
0709 12:17:54.287977 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.338353 (+ 50376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.338386 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.338464 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:54.338498 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.064561 (+2726063us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5400111a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:57.064619 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.064763 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115355392}
W20260709 12:17:57.066788 20144 connection.cc:256] RPC call timeout handler was delayed by -2.0902887309998732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 12:17:57.067548 20255 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:57.067618 22214 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.067972 22142 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.067736 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.068439 22142 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.068375 22214 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.068972 22142 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.069188 22296 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.069633 22296 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.070016 22296 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.070537 22214 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.071041 22214 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.071377 20295 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.071525 22214 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.072314 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.072455 22305 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:57.072917 22305 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.073272 22305 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.073649 22214 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.074608 22188 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.075188 22188 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.077741 22152 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.078306 22152 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.079902 22272 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.080513 22272 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.081060 22305 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.082433 22152 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.083326 22188 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.084504 22009 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.086097 22009 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:57.086591 22009 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.090900 22188 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.083341 22305 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.092236 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.094904 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.095624 21035 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:57.097744 22009 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.100656 22194 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.090965 22142 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.103713 22142 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.073905 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.112684 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.113444 22289 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:57.113821 22289 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.114195 22289 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.115168 22209 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.115653 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.114195 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.117136 21043 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:57.118079 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.118647 21043 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:57.119761 21035 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:57.122220 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2376) took 2741 ms. Trace:
I20260709 12:17:57.122464 22289 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.105304 22188 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.135486 22289 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.125057 22296 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.130436 22281 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.136397 22281 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.131217 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.138685 20248 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:17:57.067756 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6996887309999238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 12:17:57.131695 22112 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.132629 21043 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEARNER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:57.141701 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:57.142275 20175 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.142668 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:17:57.140298 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6042887309997695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 12:17:57.143251 20180 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:57.143415 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4215069609999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:17:57.143963 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3981069609999395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 12:17:57.144316 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2523069609999311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 12:17:57.144618 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2523069609999311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 12:17:57.144907 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1704069610000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 12:17:57.145200 22296 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.145406 22289 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:57.145898 22289 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.146270 22289 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:57.145226 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0977394039998671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 12:17:57.149428 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:17:57.149410 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0805061009998553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 12:17:57.150048 20174 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.133596 20171 rpcz_store.cc:276] 0709 12:17:54.381280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.381426 (+   146us) service_pool.cc:224] Handling call
0709 12:17:54.399970 (+ 18544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.400274 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.400292 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.431884 (+ 31592us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.023887 (+592003us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:55.023957 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.024054 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.121991 (+2097937us) raft_consensus.cc:1685] finished
0709 12:17:57.122015 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.122156 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6287,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":22422,"thread_start_us":591595,"threads_started":1,"wal-append.queue_time_us":703939}
I20260709 12:17:57.153501 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:57.154090 20178 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.154860 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.156889 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.158294 20171 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:17:57.158420 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:57.159091 20179 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.140772 22112 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.160651 22112 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.162715 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:57.186098 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.188019 20171 raft_consensus.cc:2410] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:17:57.203882 22035 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.214123 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.214877 21038 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:57.218426 22235 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.246083 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2403) took 2109 ms. Trace:
I20260709 12:17:57.246601 20325 rpcz_store.cc:276] 0709 12:17:55.136740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.218077 (+ 81337us) service_pool.cc:224] Handling call
0709 12:17:55.238688 (+ 20611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.313718 (+ 75030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.313763 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.313821 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:55.313865 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.245833 (+1931968us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54000cdd54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:57.245893 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.246020 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171992832}
I20260709 12:17:57.248335 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.248775 20180 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:57.250036 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.251720 20175 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:17:57.253305 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.254184 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:57.253305 21039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 660) took 1876 ms (client timeout 2107 ms). Trace:
W20260709 12:17:57.254933 21039 rpcz_store.cc:269] 0709 12:17:55.372308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.440263 (+ 67955us) service_pool.cc:224] Handling call
0709 12:17:57.248582 (+1808319us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54006829d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:57.248714 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471123328}
I20260709 12:17:57.256757 21963 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.257170 21963 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.257510 21963 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.252566 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.254892 20172 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:57.264019 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.265580 22152 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.266026 22152 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.266500 22152 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.266440 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.265760 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.269402 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.269956 20175 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:57.265019 22188 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:57.276157 22188 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.276731 22227 raft_consensus.cc:993] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:57.277204 22227 raft_consensus.cc:1081] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:17:57.277052 22188 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.253167 22248 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.279958 22248 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.280736 22248 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.281473 22289 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.268154 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:57.285264 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:57.268112 22172 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.287503 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:57.287695 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:57.288261 20177 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.283859 20174 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:57.293484 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.295466 22272 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:17:57.295912 22279 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.983s	user 0.001s	sys 0.042s
I20260709 12:17:57.297163 22272 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:57.297426 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1241) took 2812 ms. Trace:
I20260709 12:17:57.297559 22272 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.297966 22272 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.297829 20324 rpcz_store.cc:276] 0709 12:17:54.485537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.505325 (+ 19788us) service_pool.cc:224] Handling call
0709 12:17:54.505704 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.520385 (+ 14681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.520418 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.009171 (+488753us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.197540 (+188369us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:55.197583 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.197661 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.295260 (+2097599us) spinlock_profiling.cc:243] Waited 930 us on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:17:57.297111 (+  1851us) raft_consensus.cc:1685] finished
0709 12:17:57.297131 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.297336 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6429,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":170391,"spinlock_wait_cycles":2139520,"thread_start_us":147428,"threads_started":1,"wal-append.queue_time_us":277789}
I20260709 12:17:57.300673 20178 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:57.302520 20179 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:57.285017 22214 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:57.292675 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.304647 20295 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.306631 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.299537 22172 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:17:57.342938 20177 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:17:57.344270 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.307997 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.305799 22236 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:57.308878 21968 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:57.308578 22235 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:57.308698 22104 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.307803 22214 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.352823 20179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:17:57.355028 20179 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:57.355458 20179 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.354822 22248 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:57.353785 21968 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.356313 22248 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.345629 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:56.314147 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.344347 22289 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.357753 22214 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.352717 22138 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.362574 22138 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.354462 22235 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.362807 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.364555 22172 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:57.372826 22172 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.373216 22172 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.373590 22172 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.364778 20251 raft_consensus.cc:2410] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:57.365146 22104 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.377440 22104 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.377354 22112 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.378026 22104 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.365783 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.366298 22138 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.340277 21963 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.388247 22152 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.388695 21963 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.389292 21963 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.389673 21963 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.390041 21963 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.390301 22152 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:17:57.390615 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.522s (SENT) [suppressed 1 similar messages]
I20260709 12:17:57.391987 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.385555 22112 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.400645 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:57.401257 20178 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.401602 20179 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.379549 21037 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:57.364012 22236 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.404237 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.407976 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.409807 20179 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.402979 22204 raft_consensus.cc:2764] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:57.403256 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1515) took 1208 ms. Trace:
I20260709 12:17:57.421011 20178 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:57.422219 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.422648 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.414641 22152 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:57.392616 21968 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:57.428316 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0141199159997996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 12:17:57.436446 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.437229 22138 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:57.437966 21963 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.439972 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.440177 21963 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.392414 22235 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.416251 20251 rpcz_store.cc:276] 0709 12:17:56.194546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.313805 (+119259us) service_pool.cc:224] Handling call
0709 12:17:57.400895 (+1087090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.427443 22226 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:57.447808 21963 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:17:57.452289 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.452914 21041 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:57.455356 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.455821 22316 raft_consensus.cc:2764] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:57.455991 20247 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:57.456152 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.457634 22316 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.458067 22316 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.458441 22316 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.459965 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.460728 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.413509 22248 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.463640 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.464402 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.465057 21037 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:57.467705 22236 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.470165 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.447192 22138 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:57.473075 22226 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.481846 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.484901 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:57.485481 21039 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.442524 22214 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.486310 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.489195 22191 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.494287 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.502079 22127 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:57.509770 22214 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.511344 20255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f631101c7754614902057ac50b914e5"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:17:57.490549 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.514056 22272 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.514887 21039 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:57.492646 22226 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.521874 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:57.548662 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.559810 21038 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.520751 22172 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.533385 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 393) took 1364 ms. Trace:
I20260709 12:17:57.535120 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1206) took 2298 ms. Trace:
I20260709 12:17:57.543356 20255 raft_consensus.cc:606] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:57.544468 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 58270.1us
I20260709 12:17:57.566242 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.569470 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.564698 20252 rpcz_store.cc:276] 0709 12:17:55.236263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.236861 (+   598us) service_pool.cc:224] Handling call
0709 12:17:55.279697 (+ 42836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.369938 (+ 90241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.369984 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.370045 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:55.370096 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.534848 (+2164752us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b5400374454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:57.534896 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.535022 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206981888}
I20260709 12:17:57.575281 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.576043 20247 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.578608 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:57.579265 21007 connection.cc:256] RPC call timeout handler was delayed by -1.4804893130001346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:17:57.581673 21007 connection.cc:256] RPC call timeout handler was delayed by -1.3004893130002984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 12:17:57.561968 22035 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.574167 22154 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.587248 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.591066 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1250) took 2434 ms. Trace:
I20260709 12:17:57.592412 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.602747 20247 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:57.584056 22035 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.606941 22035 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.594200 22154 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.564529 20250 rpcz_store.cc:276] 0709 12:17:56.168658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.174720 (+  6062us) service_pool.cc:224] Handling call
0709 12:17:56.175052 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.215263 (+ 40211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.215311 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.215369 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:56.215409 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.533118 (+1317709us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54000d9654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:57.533174 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.533320 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81626368}
I20260709 12:17:57.612469 22154 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.615798 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.617712 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:57.618743 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 74338.6us
I20260709 12:17:57.621290 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.613109 22272 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.610702 20322 rpcz_store.cc:276] 0709 12:17:55.156824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.375835 (+2219011us) service_pool.cc:224] Handling call
0709 12:17:57.376209 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.376435 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:57.410359 (+ 33924us) log.cc:844] Serialized 14 byte log entry
0709 12:17:57.590638 (+180279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.590695 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:57.590763 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.590855 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.590996 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8437,"prepare.queue_time_us":33188,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":8890,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3395,"thread_start_us":173403,"threads_started":2,"wal-append.queue_time_us":169290}
I20260709 12:17:57.637964 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.599637 22152 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:57.694824 20323 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:57.694736 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:57.695861 20325 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:57.699133 22152 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.704057 22172 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:57.704823 22310 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.078s	user 0.004s	sys 0.002s
I20260709 12:17:57.694357 22194 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.710153 22194 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:57.712093 22320 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:17:57.712545 22194 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.712585 21038 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:57.718304 22238 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.719134 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.720245 20174 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:57.721689 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.722851 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.723685 20174 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:57.723852 22104 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.726176 22104 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.727133 20174 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:57.727990 20177 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:57.729133 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.734195 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.735826 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.736611 20174 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:57.739322 20177 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:57.743391 22281 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.746333 22197 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:57.746784 22197 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.748855 22197 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:57.749245 22197 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.749686 22197 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.750016 22157 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:17:57.754467 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.738281 22238 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:57.760288 20248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1205) took 2520 ms (client timeout 1728 ms). Trace:
I20260709 12:17:57.744212 22035 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:57.761087 20248 rpcz_store.cc:269] 0709 12:17:55.234133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.234931 (+   798us) service_pool.cc:224] Handling call
0709 12:17:57.753476 (+2518545us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54001964d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:57.754519 (+  1043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4258323712}
I20260709 12:17:57.753880 22197 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.782469 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.784788 22188 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:57.761000 22238 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:57.792979 22238 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.794116 20074 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 304) took 5595 ms. Trace:
I20260709 12:17:57.796248 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1516) took 1597 ms. Trace:
I20260709 12:17:57.796478 22316 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.798569 22316 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.786952 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.783378 20177 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:17:57.790623 22261 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.792204 22154 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.796658 20254 rpcz_store.cc:276] 0709 12:17:56.199242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.265316 (+ 66074us) service_pool.cc:224] Handling call
0709 12:17:57.796179 (+1530863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.787274 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.801280 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.819123 21963 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:57.819609 22162 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:57.823626 21963 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.824112 21963 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.801616 22197 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.831137 22197 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.833380 22197 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.818125 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.834985 22221 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:57.835369 22221 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.835616 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.835808 22221 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.836659 22316 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:57.836820 21069 debug-util.cc:398] Leaking SignalData structure 0x7b08002af8a0 after lost signal to thread 18964
I20260709 12:17:57.837129 22316 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:57.837508 22316 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:57.838176 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800245140 after lost signal to thread 20112
I20260709 12:17:57.839803 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.842483 20177 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:57.843972 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.844740 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.840780 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.849404 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.849589 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.850140 20251 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:57.850294 20250 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:17:57.846714 22157 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:57.852360 22157 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.853130 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:57.853729 21040 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:57.854549 22157 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:57.856618 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:57.861754 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:17:57.862478 20323 raft_consensus.cc:606] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:57.860453 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.867764 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.871969 20248 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:57.866756 22251 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.861933 22188 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:57.873394 22326 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:57.873611 22251 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:57.874691 22251 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.875877 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.876731 20251 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:57.876953 22064 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:57.877432 22035 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.877525 22064 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.880801 22188 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:57.881202 22188 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:57.883322 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.885782 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.886628 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.886729 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.887372 20247 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:17:57.891819 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:17:57.894598 21008 connection.cc:256] RPC call timeout handler was delayed by -1.2859191039999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:17:57.890720 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:57.897457 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.898762 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.900353 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.901934 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.904892 22188 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.906155 22188 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.908027 22316 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.909955 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:57.910310 20248 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:57.911906 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:57.896099 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.912834 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.920419 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.921245 20254 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:57.894132 22211 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:57.922945 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:57.923152 22211 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:57.923528 21040 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.924233 22211 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.922566 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.911947 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.794531 20074 rpcz_store.cc:276] 0709 12:17:52.199008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.199161 (+   153us) service_pool.cc:224] Handling call
0709 12:17:52.394272 (+195111us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5de0cb6e9c 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:17:57.794018 (+5399746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:55.053518 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:55.206189 (+152671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:55.206246 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:17:55.206277 (+    31us) tablet.cc:662] Decoding operations
0709 12:17:55.207124 (+   847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:55.207182 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:55.207210 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:17:55.207682 (+   472us) tablet.cc:701] Row locks acquired
0709 12:17:55.207710 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:17:55.207925 (+   215us) write_op.cc:270] Start()
0709 12:17:55.208103 (+   178us) write_op.cc:276] Timestamp: P: 1783599475207860 usec, L: 0
0709 12:17:55.208135 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:17:55.209082 (+   947us) log.cc:844] Serialized 1621 byte log entry
0709 12:17:56.250034 (+1040952us) op_driver.cc:464] REPLICATION: finished
0709 12:17:56.333849 (+ 83815us) write_op.cc:301] APPLY: starting
0709 12:17:56.333990 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:56.334402 (+   412us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:56.334585 (+   183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:56.335341 (+   756us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:56.335638 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:17:56.335707 (+    69us) write_op.cc:312] APPLY: finished
0709 12:17:56.336102 (+   395us) log.cc:844] Serialized 35 byte log entry
0709 12:17:56.336342 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:56.336476 (+   134us) write_op.cc:454] Released schema lock
0709 12:17:56.336539 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:56.362880 (+ 26341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:56.364864 (+  1984us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31,"reported_tablets":3,"spinlock_wait_cycles":6242048,"child_traces":[["op",{"apply.queue_time_us":83496,"apply.run_cpu_time_us":2961,"apply.run_wall_time_us":3146,"num_ops":3,"prepare.queue_time_us":595106,"prepare.run_cpu_time_us":13053,"prepare.run_wall_time_us":316419,"raft.queue_time_us":90999,"raft.run_cpu_time_us":8990,"raft.run_wall_time_us":116859,"replication_time_us":1041718,"thread_start_us":690803,"threads_started":4,"wal-append.queue_time_us":255675,"wal-append.run_cpu_time_us":9900,"wal-append.run_wall_time_us":1863811}]]}
I20260709 12:17:57.933847 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.934158 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.934661 20253 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:57.925779 22196 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.925940 22257 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.938848 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:57.937438 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.933871 22064 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:57.950721 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:57.951309 21042 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:57.952039 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:57.946762 22212 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:17:57.952996 22020 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:57.954191 22212 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:57.954315 22020 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:57.954576 22212 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:57.954833 22020 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:57.955778 22020 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.949959 22261 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:57.957401 22020 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.957638 22261 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:57.958019 22261 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:57.958416 22221 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:57.959642 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.961367 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:57.962713 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.955492 22212 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:57.965773 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:57.966382 20255 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:57.966426 22212 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:57.956401 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800313ca0 after lost signal to thread 20204
I20260709 12:17:57.933250 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.972915 21040 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:57.973960 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:17:57.968201 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.984266 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:57.985643 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:57.989777 20255 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:57.974815 21042 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:57.958863 22261 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:17:58.002393 20294 connection.cc:256] RPC call timeout handler was delayed by -1.4431223920000775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 12:17:58.002489 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.003961 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.004714 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.005779 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.948697 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:58.006623 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.012177 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.947527 22257 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:58.015540 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.015898 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.016777 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.981992 22035 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:58.021064 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.981601 22194 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.025796 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.028808 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.019598 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:58.035045 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:57.988972 22281 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.035308 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.049232 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.049607 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.050213 20180 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:58.054821 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:58.059811 22157 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:58.060240 20145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.791s	user 0.003s	sys 0.019s
I20260709 12:17:58.060631 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.024984 22257 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:58.063535 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 192607us
I20260709 12:17:58.062983 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:57.988368 22181 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:17:58.023782 22261 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:58.027491 22035 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:17:58.064651 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800359660 after lost signal to thread 20280
W20260709 12:17:58.070555 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 142850us
I20260709 12:17:58.061334 22145 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:58.061429 22127 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.072049 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.068226 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:58.077328 21041 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:58.062091 22298 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:58.060272 22157 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.061120 22236 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:58.084533 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:17:58.081019 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.081313 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:58.079877 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.071524 22152 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:58.074878 21069 debug-util.cc:398] Leaking SignalData structure 0x7b080032dea0 after lost signal to thread 20281
I20260709 12:17:58.073153 22035 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.086963 22221 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.110415 22238 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.111004 22343 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.107448 22298 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.112732 22236 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.113564 22191 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:58.113946 22191 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:58.087706 22274 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:58.084573 22248 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:58.115854 22274 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:58.116336 22274 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.116640 22248 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.091606 22218 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:58.077750 22145 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:58.136340 20179 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.077910 22154 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:58.095767 22331 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:17:58.101141 21963 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.093115 22157 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:58.109339 20255 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:58.106271 20250 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.091034 21968 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.149370 20177 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:58.116844 22226 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:58.130893 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.134342 20180 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.114846 22191 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.092027 22227 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.138175 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.145175 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:58.148314 20175 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:58.114864 22236 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.157877 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.161551 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:58.158726 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:58.148957 21963 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.169170 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.169412 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.138939 22145 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.132293 22218 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:17:58.170821 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 113622us
I20260709 12:17:58.136566 22152 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:58.157263 22226 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:17:58.171442 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800340da0 after lost signal to thread 20354
I20260709 12:17:58.169066 22183 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:58.168903 22252 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.171919 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 253) took 1076 ms. Trace:
I20260709 12:17:58.180969 22218 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.191934 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.197613 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.202240 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.168574 22035 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.181962 22236 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:58.231974 22035 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.233433 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.234370 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:58.234778 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.235906 22226 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.178800 22257 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.248914 22226 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:58.249248 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.255345 20176 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:17:58.255272 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71356.7us
I20260709 12:17:58.256494 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.257799 20176 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.250168 22298 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:58.259545 20176 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:58.185230 21968 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:58.247416 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.270304 22342 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:58.270529 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.270807 22342 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:58.271486 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:58.272370 22140 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.273116 22140 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.273304 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:58.197240 22183 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.197494 22152 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.196576 21036 rpcz_store.cc:276] 0709 12:17:57.094729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.095473 (+   744us) service_pool.cc:224] Handling call
0709 12:17:57.252445 (+156972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.283507 (+ 31062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.284839 (+  1332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.285828 (+   989us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:57.287350 (+  1522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.299884 (+ 12534us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.156604 (+856720us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54006829d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:58.170929 (+ 14325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352941440}
I20260709 12:17:58.275785 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.277091 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.279464 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.280877 20321 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:58.281961 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.284344 20172 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:17:58.283876 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.288492 20322 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.254021 22238 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:58.304138 22248 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.307680 22326 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.311046 22091 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:58.310863 22157 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.313002 22183 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.321415 20321 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:17:58.278991 22197 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:58.331856 22197 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:58.332301 22197 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.284390 22335 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:58.345031 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 61246.8us
I20260709 12:17:58.346082 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:58.342722 20329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2401) took 3219 ms (client timeout 2054 ms). Trace:
I20260709 12:17:58.351486 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.337724 22335 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:17:58.347519 20329 rpcz_store.cc:269] 0709 12:17:55.120016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.136221 (+ 16205us) service_pool.cc:224] Handling call
0709 12:17:58.335957 (+3199736us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400087fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:58.339498 (+  3541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319722880}
I20260709 12:17:58.350518 22236 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.278600 22342 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.365640 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:58.366571 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.369618 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.370862 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:58.376703 22216 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:58.381047 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2398) took 3262 ms. Trace:
W20260709 12:17:58.382040 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.358949 22335 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.386075 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1783) took 1169 ms. Trace:
W20260709 12:17:58.389024 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800399280 after lost signal to thread 21072
I20260709 12:17:58.386557 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:58.392208 22257 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.382973 22351 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.401326 20327 rpcz_store.cc:276] 0709 12:17:55.118729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.119488 (+   759us) service_pool.cc:224] Handling call
0709 12:17:55.120329 (+   841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.438191 (+317862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.438237 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.438293 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:55.438342 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.380801 (+2942459us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400327b54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:58.380846 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.380984 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730341760}
I20260709 12:17:58.405242 20171 rpcz_store.cc:276] 0709 12:17:57.217055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.241281 (+ 24226us) service_pool.cc:224] Handling call
0709 12:17:58.385321 (+1144040us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:17:58.385532 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.385721 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.385746 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:58.385787 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:58.385830 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.385886 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.385990 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24352512}
W20260709 12:17:58.410420 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.421546 22342 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.402454 22196 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:58.426465 20254 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.408222 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.432294 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.433686 22347 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:58.433959 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.434276 22347 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.400777 22316 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.435712 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.436488 22347 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.436367 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.436851 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.438879 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.439540 22352 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:58.439972 22352 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:58.440305 22352 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:58.406872 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800399220 after lost signal to thread 21073
I20260709 12:17:58.445677 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:58.404511 22252 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.443282 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:58.446280 20249 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:17:58.446966 22196 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:58.468434 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:58.406422 22216 consensus_queue.cc:1243] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:58.483731 22345 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:58.406565 22248 consensus_queue.cc:1175] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e929b30888874ed59248f1229cecd3c6" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:58.496516 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:58.441615 22212 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:58.496107 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.441994 22343 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:58.483001 22351 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:58.543972 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.558300 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.534271 20250 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:58.540714 20219 connection.cc:256] RPC call timeout handler was delayed by -1.8673053009999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:17:58.562443 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.457856 22236 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.461302 22358 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.518106 20251 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:58.517514 21037 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.442175 22145 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.561786 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:58.564845 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 155581us
I20260709 12:17:58.575274 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.566110 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.573814 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.574270 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.484669 22261 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:17:58.556545 22221 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:58.552294 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 56252.1us
I20260709 12:17:58.495579 22138 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:17:58.562688 22351 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:58.558053 22343 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:58.591276 22343 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.587836 22197 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.586782 20328 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:58.589547 21038 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:58.590826 22351 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.579205 22157 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:58.595638 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:17:58.595712 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 135116us
I20260709 12:17:58.596513 20328 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:58.585201 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.602583 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.560238 22212 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.605233 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.607571 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.608948 20174 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.609282 20177 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:58.614183 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.616787 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:17:58.622385 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.569340 22196 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.613822 22204 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:58.625106 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.614524 20328 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.626291 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:17:58.627712 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47723us
I20260709 12:17:58.630156 22197 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:58.598685 22329 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.649561 20251 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:58.613426 22330 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.621675 22104 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:58.640802 22204 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:17:58.661887 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100158us
I20260709 12:17:58.667613 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.685052 20327 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:58.688050 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 60678.6us
I20260709 12:17:58.688825 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.688339 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.694689 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.676702 22104 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:17:58.701012 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.687841 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:58.687227 22261 consensus_queue.cc:1243] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:17:58.703728 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.690675 22345 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.706298 22226 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.714993 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:58.716536 20219 connection.cc:256] RPC call timeout handler was delayed by -1.4650053010000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:17:58.717255 20219 connection.cc:256] RPC call timeout handler was delayed by -1.4650053010000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 12:17:58.718182 22362 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.720062 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.721508 22212 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:58.727074 20327 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:17:58.707821 22364 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.684116 22361 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:17:58.732697 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.717285 22064 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.740664 22104 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:58.741847 22274 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.003s
I20260709 12:17:58.730896 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.733319 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.745151 20323 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:17:58.734890 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.724442 22133 tablet_copy_client.cc:538] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:58.735158 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.753265 20321 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:58.754113 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.735466 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.734583 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.755751 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.732828 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.748270 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.728008 22330 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.760957 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.762053 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.762717 20323 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:58.763582 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.766631 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.768324 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.769093 20321 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:58.771339 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.774210 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.751487 22140 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.774643 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.774871 20325 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:58.777326 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.749768 22145 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.778540 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.729141 22138 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:17:58.781354 20253 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:17:58.783494 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.788765 20256 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:17:58.767623 22179 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:58.768155 22341 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.793975 20248 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:58.712936 22204 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.796190 21034 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.799846 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.799921 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.800946 22368 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:58.816026 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 154985us
I20260709 12:17:58.760617 22274 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.811192 20323 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:17:58.819419 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52847.3us
I20260709 12:17:58.814462 20329 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:58.805944 21040 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:58.816819 20073 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:58.819818 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.820811 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.821779 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.824640 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.825155 20175 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:58.822000 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:58.814275 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.826181 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:58.824118 20325 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:58.825515 20073 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 4, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added, no longer has a pending config: VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65), VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66), VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67), NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:17:58.823473 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.835089 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.840487 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.841470 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.843360 20323 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:58.849938 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.852329 20175 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:17:58.852725 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.854041 22152 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.842700 21035 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.861966 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.843847 22132 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:17:58.870958 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.862398 22368 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:58.876770 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.855963 22374 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.880918 22352 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.881711 22351 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.883216 22352 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:58.883767 20326 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.872576 22321 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:58.888149 22368 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:58.879261 20321 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:58.891762 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:58.892921 20249 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:58.893285 20249 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:58.894198 20252 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:58.894060 20249 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.895046 20249 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:58.898269 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.889183 22368 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:17:58.901875 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 269) took 2628 ms. Trace:
I20260709 12:17:58.902164 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:58.902930 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.902248 20330 rpcz_store.cc:276] 0709 12:17:56.273573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.407902 (+134329us) service_pool.cc:224] Handling call
0709 12:17:58.336139 (+1928237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.336377 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:58.346475 (+ 10098us) log.cc:844] Serialized 14 byte log entry
0709 12:17:58.406775 (+ 60300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:58.406829 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:58.406875 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.406941 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:58.901718 (+494777us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400087fd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:58.901818 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6191,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1559,"raft.queue_time_us":3192,"raft.run_wall_time_us":4516,"spinlock_wait_cycles":4441508864,"thread_start_us":59875,"threads_started":1,"wal-append.queue_time_us":69641}
I20260709 12:17:58.904284 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:58.905601 20329 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.906299 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:58.907699 20325 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:58.911984 22035 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:58.915855 22360 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.397s	user 0.003s	sys 0.001s
I20260709 12:17:58.916869 22343 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.918994 22343 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:58.872881 22274 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:58.907310 22218 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.698s	user 0.000s	sys 0.013s
I20260709 12:17:58.929638 22218 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.930940 21039 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.932359 20249 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:58.934813 22351 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:17:58.935554 22357 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.451s	user 0.001s	sys 0.000s
I20260709 12:17:58.887485 22335 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.938637 21042 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.939764 22335 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:58.945047 22218 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:58.951241 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.027s	sys 0.021s
W20260709 12:17:58.951594 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.028s	sys 0.022s
W20260709 12:17:58.951849 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 782227us
I20260709 12:17:58.955293 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:58.956660 21041 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.959005 22362 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:58.959190 20177 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:58.959431 22362 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:58.960537 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:17:58.960367 22362 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:58.961869 22362 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.962430 20171 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:58.963903 20180 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:58.966691 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.968569 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.969506 20329 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:17:58.967954 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.975999 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.980018 20330 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:58.976872 20325 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:17:58.982003 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.989944 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:58.991904 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.992167 22375 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:58.992720 22375 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:58.993515 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:17:58.993643 22375 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:58.928210 22321 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:58.978933 22212 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:59.004130 20179 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:59.018976 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:59.027086 20256 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:59.027628 20256 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:59.030489 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:58.978601 22335 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:17:58.979080 22274 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:59.039410 22218 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:59.039845 22218 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:59.040314 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.040684 22218 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.041436 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.042033 22218 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.042182 22191 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.036141 20256 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.043735 20256 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.043360 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.046254 20324 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:17:59.046808 21038 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:59.045540 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.047840 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.049314 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.050418 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.048245 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.052354 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.051416 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.055186 20322 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:17:59.060154 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.060765 20324 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.061528 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.063349 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.065641 22091 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:59.066704 22091 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:59.069574 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:59.073585 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.087113 20256 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:59.110769 21038 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:59.074800 20325 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:59.067024 22091 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:59.124652 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:17:59.125777 20324 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:17:59.127331 20256 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:59.133870 22238 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:59.134326 22238 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:17:59.135336 22238 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.136688 22238 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.143393 20328 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.146418 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.146816 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.147315 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.147749 21037 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:17:59.147778 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1542) took 1169 ms. Trace:
I20260709 12:17:59.151721 20255 rpcz_store.cc:276] 0709 12:17:57.978602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.049347 (+ 70745us) service_pool.cc:224] Handling call
0709 12:17:59.147610 (+1098263us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54003c9bd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:59.147721 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112356608}
I20260709 12:17:59.153129 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.153967 21036 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:17:59.154780 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:59.156032 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 264) took 1141 ms. Trace:
I20260709 12:17:59.156520 20172 rpcz_store.cc:276] 0709 12:17:58.015059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.016576 (+  1517us) service_pool.cc:224] Handling call
0709 12:17:59.155769 (+1139193us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54000c53d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:17:59.155922 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605596032}
I20260709 12:17:59.157402 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:17:59.161623 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.112094 22252 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:17:59.123225 22345 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:17:59.165138 22345 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.109277 22342 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:17:59.168279 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.174422 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.058570 22188 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:17:59.180066 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.206619 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:59.211865 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:59.167724 22133 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:17:59.067490 22020 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 12:17:59.108660 22183 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:17:59.233090 20324 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:59.067375 22343 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:17:59.186543 22347 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.255873 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.248288 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.247881 22352 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.167461 22236 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:17:59.248706 22227 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:17:59.221952 20172 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:59.258590 22212 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:59.243671 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63707.7us
I20260709 12:17:59.246639 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.284680 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:59.219543 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 94966.5us
I20260709 12:17:59.167306 22345 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:59.191414 22342 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.286124 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.288198 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.292629 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:59.271546 22352 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:59.294435 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:17:59.305318 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.307144 22212 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:59.309634 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.336805 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:17:59.290540 22020 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.296427 22352 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:59.339530 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.345250 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.308574 22275 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:59.309290 22345 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.359012 20328 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:59.266922 22091 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:59.367345 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 56502.2us
I20260709 12:17:59.309257 22384 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:59.337900 22355 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:17:59.368395 20328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1253) took 4096 ms (client timeout 1555 ms). Trace:
I20260709 12:17:59.303124 22369 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 12:17:59.375902 20328 rpcz_store.cc:269] 0709 12:17:55.272505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.347022 (+ 74517us) service_pool.cc:224] Handling call
0709 12:17:58.586624 (+3239602us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400284ea0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefbe18 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:59.142658 (+556034us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5400284ea0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6da1d 00007f5ddae541a4 00007f5ddaed6447 00007f5ddaeeefe7 00007f5ddaef07de 00007f5ddaefc27c 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591
0709 12:17:59.368294 (+225636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935426688}
I20260709 12:17:59.347404 22020 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:17:59.372814 22176 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:17:59.367085 22343 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.390815 20329 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:59.390815 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.374154 22275 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:17:59.388409 22381 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:17:59.385268 22020 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:59.392771 22386 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:17:59.380834 22345 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:59.390827 22091 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.410298 22342 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:59.384927 22227 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:59.391113 22236 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 12:17:59.436933 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 78753.8us
I20260709 12:17:59.439862 22138 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:59.440377 22138 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:59.441387 22138 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:59.445875 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 140668us
I20260709 12:17:59.447810 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:17:59.449687 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 79280.5us
I20260709 12:17:59.451009 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.452944 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.454823 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.456463 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.455138 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:59.444221 22355 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:17:59.452945 22384 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.459486 22393 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.463819 22235 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.430956 22275 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.463089 22384 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.464538 22347 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.474928 22020 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.478199 22020 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:59.468184 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.481266 22218 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.484578 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.486373 22384 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.487717 22395 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:59.487677 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.457329 22212 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:59.489403 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.488190 22395 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:59.493775 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:59.495925 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.505390 21041 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:59.493516 22384 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.507833 22162 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.509037 22395 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.510417 22395 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.511734 22347 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.521059 20326 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:59.524296 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:17:59.517226 22020 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.526641 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:59.525224 21043 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:59.530412 22157 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:59.530843 22157 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:59.531754 22352 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.533944 22352 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:59.534560 20325 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:59.535807 22138 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:59.517273 22394 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:59.539871 22157 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.540398 22298 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.537566 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.542539 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:17:59.543246 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.543747 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.548013 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.548261 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.549434 22236 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.546767 22362 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.550168 22236 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.550348 22362 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.551447 20322 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:59.552675 22362 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:59.517807 22321 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:59.555950 22321 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.558303 22321 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:59.558904 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 668) took 1356 ms. Trace:
I20260709 12:17:59.529071 22384 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.559326 21039 rpcz_store.cc:276] 0709 12:17:58.202146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.206172 (+  4026us) service_pool.cc:224] Handling call
0709 12:17:58.206519 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.931276 (+724757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.558681 (+627405us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400462154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:59.558843 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665545984}
I20260709 12:17:59.560793 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 285) took 1009 ms. Trace:
I20260709 12:17:59.561136 21040 rpcz_store.cc:276] 0709 12:17:58.551125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.628971 (+ 77846us) service_pool.cc:224] Handling call
0709 12:17:58.629322 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.820981 (+191659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.560577 (+739596us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54007805d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:59.560734 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405733120}
I20260709 12:17:59.572146 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.588527 21040 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:17:59.589267 21040 pending_rounds.cc:85] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 5
I20260709 12:17:59.589502 21040 pending_rounds.cc:107] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
W20260709 12:17:59.590497 22154 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:17:59.591236 22138 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:59.589766 21040 raft_consensus.cc:2917] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:17:59.593010 21040 raft_consensus.cc:2889] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.592347 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:59.594549 20251 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
W20260709 12:17:59.604743 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.604862 22157 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.609931 22236 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.567523 22395 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.611670 22035 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:17:59.612221 22035 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.614931 22035 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:59.626650 20325 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:59.621054 22347 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:59.628487 20321 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:59.631284 22321 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:17:59.631856 22321 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.633889 22321 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:59.634794 20176 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:59.620972 22352 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:17:59.636754 22352 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:59.637126 22352 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:59.637993 22352 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.644214 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.653594 22352 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.659796 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:17:59.660493 20329 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.665299 20321 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:59.670248 20248 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:59.670425 22358 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:59.670873 22358 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:17:59.674108 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.677430 21039 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:17:59.677927 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.675194 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.678141 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:17:59.678236 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:17:59.675729 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.678898 21042 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:17:59.681099 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.681919 20325 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:17:59.685441 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.687515 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.687808 20321 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:59.691753 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:17:59.708223 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.713459 21043 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:59.713459 20248 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:59.714524 20256 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:59.714913 20256 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:17:59.711869 22035 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:17:59.721125 20256 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.686964 22275 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.672672 22358 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.724730 22132 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:59.717051 22152 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:17:59.741206 20329 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:59.728545 22154 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.743078 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:59.752128 20255 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:59.743757 20256 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.686208 22257 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:17:59.691514 22176 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:17:59.720096 22138 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:17:59.750159 22035 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:59.764236 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:17:59.765079 20248 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:17:59.751361 22154 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.769382 22358 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.816102 22154 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:17:59.820107 22400 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:17:59.825664 20256 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:59.844128 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.812922 22035 consensus_queue.cc:1243] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:17:59.852674 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.860674 22403 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:17:59.863226 22409 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:59.871392 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:59.872568 22257 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.874181 22368 raft_consensus.cc:1064] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
W20260709 12:17:59.874631 22368 raft_consensus.cc:1068] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Unable to promote non-voter 8aef67aa330543a191ab5ab5dc30e84c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:17:59.876339 22257 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:59.880453 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:17:59.869534 22035 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.856561 22316 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:17:59.859579 22132 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:17:59.886454 22275 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:59.886598 22204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.007s	sys 0.028s
I20260709 12:17:59.888856 22191 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.887063 22409 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:17:59.906680 22204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.008s	sys 0.028s
I20260709 12:17:59.917927 22191 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:17:59.895402 22035 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:17:59.949395 22409 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.960270 22218 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.959755 22409 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:17:59.960757 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.960855 22218 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:17:59.963169 22218 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:17:59.963266 22409 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:17:59.969951 22035 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:17:59.971299 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:17:59.972175 20324 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:17:59.917797 22152 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:59.950206 22204 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:59.949532 22191 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.949939 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 673) took 1717 ms. Trace:
W20260709 12:17:59.982497 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 94127.7us
I20260709 12:17:59.984742 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:17:59.986028 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.987365 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:17:59.982882 22204 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:17:59.985865 22152 consensus_queue.cc:1243] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:00.016019 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:00.016165 22414 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.017050 22414 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.017266 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:00.018489 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:17:59.985754 22316 consensus_queue.cc:1243] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:00.019696 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:00.020171 22316 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.020828 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:00.023783 22413 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.983536 21035 rpcz_store.cc:276] 0709 12:17:58.232234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.236852 (+  4618us) service_pool.cc:224] Handling call
0709 12:17:58.248756 (+ 11904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.865523 (+616767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.927517 (+1061994us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400472f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:17:59.937143 (+  9626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338853632}
I20260709 12:18:00.024209 22413 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:00.021010 22316 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.025533 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:00.026427 21041 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.023209 22152 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.027763 22413 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.026911 22414 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:00.035820 22414 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:00.036212 22414 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.039947 22152 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:00.040043 22204 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.039891 22132 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.041322 22204 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.042974 22154 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:00.029706 22191 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.044055 22154 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.044394 22154 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:00.045744 22191 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:00.046258 22133 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:00.045310 22154 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.051268 22154 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.058027 22133 tablet_bootstrap.cc:492] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:18:00.058452 20073 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 315) took 6713 ms. Trace:
I20260709 12:18:00.059526 22133 ts_tablet_manager.cc:1403] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.947s	user 0.031s	sys 0.020s
W20260709 12:18:00.085580 22261 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:18:00.062660 20073 rpcz_store.cc:276] 0709 12:17:53.344667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.344849 (+   182us) service_pool.cc:224] Handling call
0709 12:18:00.058360 (+6713511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:58.879547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:59.063153 (+183606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:59.067277 (+  4124us) write_op.cc:435] Acquired schema lock
0709 12:17:59.073100 (+  5823us) tablet.cc:662] Decoding operations
0709 12:17:59.230233 (+157133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:59.230344 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:59.230382 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:59.230751 (+   369us) tablet.cc:701] Row locks acquired
0709 12:17:59.230773 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:17:59.230971 (+   198us) write_op.cc:270] Start()
0709 12:17:59.231102 (+   131us) write_op.cc:276] Timestamp: P: 1783599479230923 usec, L: 0
0709 12:17:59.231128 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:17:59.258986 (+ 27858us) log.cc:844] Serialized 987 byte log entry
0709 12:17:59.530381 (+271395us) op_driver.cc:464] REPLICATION: finished
0709 12:17:59.654709 (+124328us) write_op.cc:301] APPLY: starting
0709 12:17:59.663799 (+  9090us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:59.686365 (+ 22566us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:59.716347 (+ 29982us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:59.724810 (+  8463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:59.725032 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:59.725091 (+    59us) write_op.cc:312] APPLY: finished
0709 12:17:59.725320 (+   229us) log.cc:844] Serialized 29 byte log entry
0709 12:17:59.725502 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:59.725602 (+   100us) write_op.cc:454] Released schema lock
0709 12:17:59.725645 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:59.726027 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:59.726056 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":90298,"apply.run_cpu_time_us":2783,"apply.run_wall_time_us":99056,"num_ops":2,"prepare.queue_time_us":44958,"prepare.run_cpu_time_us":41906,"prepare.run_wall_time_us":543834,"raft.queue_time_us":47515,"raft.run_cpu_time_us":16981,"raft.run_wall_time_us":87145,"replication_time_us":299079,"thread_start_us":283784,"threads_started":4,"wal-append.queue_time_us":188070}]]}
W20260709 12:18:00.090369 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 61541.8us
I20260709 12:18:00.092610 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:00.096222 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:00.104844 22132 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.095052 22316 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.107270 22272 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:00.114454 22272 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:00.115046 22272 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.117440 22409 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:00.117842 22409 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:00.118646 22409 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.119998 22272 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:00.122045 22409 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:00.123414 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.108233 22413 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:00.111428 22257 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.104878 22191 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:18:00.113255 22204 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:18:00.126367 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:00.131367 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:00.128031 22257 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:00.137394 22035 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:00.137806 22035 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.138156 22035 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:00.141899 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.147535 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.151242 22415 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.151887 22415 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:00.173971 22226 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.174474 22226 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:00.175400 22226 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.177004 22226 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.160053 22415 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:00.202287 22414 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:00.208536 22413 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:00.211839 22414 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:00.729427 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:00.764820 22226 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.007s
I20260709 12:18:01.103179 22425 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.104966 22425 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.107964 22162 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.108821 22425 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.109679 22425 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.109470 22162 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.110591 22425 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.116461 22426 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.117216 22425 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.117442 22426 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.117981 22425 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:01.118333 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 954538us
I20260709 12:18:01.119457 22425 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.120664 22426 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.122713 22425 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:01.174937 22298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.013s	sys 0.006s
W20260709 12:18:01.175587 22298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.014s	sys 0.007s
W20260709 12:18:01.209260 20109 debug-util.cc:398] Leaking SignalData structure 0x7b080003dd40 after lost signal to thread 18964
W20260709 12:18:01.217317 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 1.09217e+06us
I20260709 12:18:01.218943 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:01.220391 22321 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.223711 22321 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:01.223894 22415 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:01.225556 22321 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.226095 22411 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:01.226765 22411 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:01.228394 22411 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.229828 22411 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.241961 22321 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:01.242324 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:01.245926 22235 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.245277 22321 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.246750 22235 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.248003 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:01.249752 22235 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.250141 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:01.252151 22316 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:01.252744 22316 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.254633 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:01.255622 22321 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:01.256027 22321 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:01.256439 22321 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.260052 22162 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.271406 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:01.272753 22411 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:01.275709 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:01.280712 22321 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.283627 22321 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.284364 22316 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.284447 22411 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:01.288329 22369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.003s	sys 0.007s
I20260709 12:18:01.288797 20176 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:01.289394 22369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.004s	sys 0.007s
I20260709 12:18:01.296437 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:01.300927 20175 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:01.304297 22370 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.012s	sys 0.005s
W20260709 12:18:01.304759 22370 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.012s	sys 0.005s
I20260709 12:18:01.312781 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.313804 20180 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.316633 20174 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.318513 20174 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.330502 22235 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.315254 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.360314 20171 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:01.373575 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.374447 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.385032 22235 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.387235 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:01.389043 20180 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.401095 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.403457 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.390657 22235 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.391633 20174 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.405232 20173 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:01.412313 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.412467 20173 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:01.412988 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0540462540000135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:18:01.413931 20173 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.409390 20171 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:18:01.415587 20171 pending_rounds.cc:85] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:01.415961 20171 pending_rounds.cc:107] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 12:18:01.416446 20171 raft_consensus.cc:2917] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:18:01.417233 20171 raft_consensus.cc:2889] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:01.418125 20180 raft_consensus.cc:2410] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:01.389320 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.416203 22321 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.420274 20177 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.421717 22411 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.422130 22411 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:01.420162 22298 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.424053 20172 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:01.423583 22411 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.424443 22298 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.425494 22411 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.427066 22298 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.430058 22369 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.430891 22369 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.431802 22236 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.432555 22236 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.433254 22369 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.433825 22369 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.434510 22369 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.435210 22236 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.429603 22235 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.436776 22369 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.436450 22235 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.442196 22235 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.448941 22152 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:01.455991 20075 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.472271 20075 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 9, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.485332 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.486344 22235 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.493670 22235 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.496922 22235 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:01.501765 20143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.389s	user 0.028s	sys 0.011s
W20260709 12:18:01.502424 20143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.029s	sys 0.011s
I20260709 12:18:01.507669 22152 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.474952 22133 raft_consensus.cc:359] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:01.508450 22133 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:18:01.508417 22152 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.509585 22133 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:01.511859 22152 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.513383 22369 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.514403 22369 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.515225 22235 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.515450 22236 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.516016 22235 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:01.516280 22236 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.516810 22369 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.517377 22369 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.518079 22369 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.518661 22236 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.519265 22236 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.519719 22298 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.519939 22236 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.520445 22298 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.522145 22236 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.522497 22298 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.522703 22236 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.523054 22298 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.518671 22235 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
W20260709 12:18:01.525142 22352 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.371s	user 0.018s	sys 0.018s
I20260709 12:18:01.525220 22235 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:01.526389 22352 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.018s	sys 0.018s
I20260709 12:18:01.526098 22235 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.527508 22133 ts_tablet_manager.cc:1434] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 1.461s	user 0.014s	sys 0.011s
W20260709 12:18:01.527933 22133 ts_tablet_manager.cc:1467] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Tablet startup took 1462ms
I20260709 12:18:01.528810 22235 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.532977 22369 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.523373 22236 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.537599 22298 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.538516 20075 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.539883 22369 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.540614 22298 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.541344 22298 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.541989 22298 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.540684 22369 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:01.555271 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 435465us
I20260709 12:18:01.558821 22201 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.187950 22035 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.559798 22201 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.561973 22035 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.563051 22201 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.563759 22275 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:01.564683 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.564787 22275 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.552736 22431 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.574498 20175 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:01.574875 22138 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.574739 22431 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.571846 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.568828 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.572090 22194 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:01.573657 22347 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:01.575901 20178 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:01.587400 22355 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.593164 22368 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.593358 22347 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.593580 22355 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.594157 22176 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.594061 22368 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.594825 22176 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.583460 22157 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.586443 22138 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.587656 22132 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:01.588232 20177 raft_consensus.cc:2410] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:01.588083 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.588743 22194 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.590430 22431 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.591076 22384 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.606389 22384 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:01.592018 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:01.600400 20109 debug-util.cc:398] Leaking SignalData structure 0x7b080003a640 after lost signal to thread 20112
I20260709 12:18:01.550935 22235 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.617925 22437 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:01.596263 22275 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.604736 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:01.596287 22355 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.609969 22132 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:01.597232 22176 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:01.636051 20109 debug-util.cc:398] Leaking SignalData structure 0x7b0800333e60 after lost signal to thread 20204
W20260709 12:18:01.636575 20109 debug-util.cc:398] Leaking SignalData structure 0x7b08002a24a0 after lost signal to thread 20205
I20260709 12:18:01.596568 22341 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.596309 22154 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.623418 22347 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.642549 22434 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:01.645637 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.644922 20109 debug-util.cc:398] Leaking SignalData structure 0x7b08003acfe0 after lost signal to thread 20280
I20260709 12:18:01.623075 22035 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:01.654031 20109 debug-util.cc:398] Leaking SignalData structure 0x7b080039f520 after lost signal to thread 20354
I20260709 12:18:01.518087 22257 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.639828 22235 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.639756 22275 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:01.655939 22415 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.647195 20171 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
W20260709 12:18:01.683912 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 79551.6us
I20260709 12:18:01.619104 22437 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:18:01.690728 20109 debug-util.cc:398] Leaking SignalData structure 0x7b080038ade0 after lost signal to thread 21072
W20260709 12:18:01.692200 20109 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac860 after lost signal to thread 21073
I20260709 12:18:01.645231 22435 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.653261 22321 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.698550 22035 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.698872 22132 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.699780 20256 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:01.700237 22436 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.700359 22162 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:01.707931 22432 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.695916 22257 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.694489 22369 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.711069 22375 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.683722 22194 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:01.713953 20109 debug-util.cc:398] Leaking SignalData structure 0x7b0800366ba0 after lost signal to thread 22227
I20260709 12:18:01.708551 22176 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.728924 22411 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.729351 22176 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.729717 22411 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.730047 22235 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.730473 22132 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.709127 22355 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:01.731957 22355 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.732277 22201 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.733982 22436 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.734413 22355 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.734856 22432 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:01.720130 22434 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.737751 22218 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:01.738298 20322 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.733013 22275 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:01.683166 22157 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.739813 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:01.720029 22162 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.750401 22176 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.750864 22162 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.750998 22138 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.751662 22138 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.752066 22440 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.752283 22138 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.752667 22440 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.692433 22154 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.718068 22368 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:01.722045 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.743572 22438 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.750180 22194 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.695694 22341 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.756413 20321 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.756291 22435 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.756975 22275 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.757783 22138 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.716374 22415 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.721380 22321 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.766443 22194 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.767414 22375 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:01.770306 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.771064 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:01.771435 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.772013 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.772130 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.778262 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:01.750488 22441 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.780433 20321 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:01.780004 22441 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:01.783066 22411 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.783730 22411 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.784220 22411 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.787659 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.787928 22411 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.788563 20321 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:01.790373 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:01.791576 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.793262 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.793576 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.789038 22440 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.754957 22298 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.699815 22384 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.796329 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.796341 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.795430 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.793933 22415 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.798985 20321 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:18:01.799583 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 62539.3us
I20260709 12:18:01.802392 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:01.798166 20327 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:01.795284 22432 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:01.807878 20325 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
W20260709 12:18:01.528337 22133 ts_tablet_manager.cc:1469] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Trace:
0709 12:17:50.531410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.534071 (+  2661us) service_pool.cc:224] Handling call
0709 12:17:50.752808 (+218737us) ts_tablet_manager.cc:934] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
0709 12:17:53.327104 (+2574296us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:54.205884 (+878780us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:54.210057 (+  4173us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:56.198427 (+1988370us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:56.220867 (+ 22440us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:56.241790 (+ 20923us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:56.241859 (+    69us) inbound_call.cc:177] Queueing success response
0709 12:17:59.109108 (+2867249us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:18:00.066370 (+957262us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:18:00.120005 (+ 53635us) tablet_replica.cc:261] Starting instrumentation
0709 12:18:00.123141 (+  3136us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":54900,"mutex_wait_us":1099,"raft.queue_time_us":178,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"tablet-copy.queue_time_us":200784,"tablet-download-pool.queue_time_us":154,"tablet-download-pool.run_cpu_time_us":10545,"tablet-download-pool.run_wall_time_us":2317626,"thread_start_us":326460,"threads_started":2}
I20260709 12:18:01.809792 20326 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:01.813073 20328 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:18:01.814810 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.818243 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.806908 22425 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.821106 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:01.824950 22341 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.825883 22157 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.826689 22236 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.816071 22368 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.773976 22218 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.805874 22138 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.837709 22375 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:01.840967 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.841274 22444 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:01.850626 20172 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.850374 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:01.852744 20326 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:01.853408 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.829468 22425 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:01.858338 22194 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.858939 22154 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.858747 22138 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.860841 22441 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:01.859086 20248 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:01.853084 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:01.774792 22438 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:01.872195 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69889.2us
I20260709 12:18:01.874369 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.876291 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.877050 22194 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.877760 22437 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.877647 22368 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.877822 22194 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.878512 22341 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.879218 22341 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.879940 22157 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.880179 22368 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.880641 22157 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.881561 22341 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.881807 22434 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.882164 22341 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:01.882381 22434 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.883076 22157 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.882957 22434 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.867086 22347 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.877341 20174 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:01.875485 20176 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:01.880908 22368 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.883647 22375 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:01.864342 22384 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.889294 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.888995 20256 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:01.891726 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:01.893314 22425 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.894907 22425 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.895859 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:01.896391 20250 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.896755 22275 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.898144 22436 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.903152 20326 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:01.907490 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.908565 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:01.909523 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.882808 22341 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:01.913622 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 95990.8us
I20260709 12:18:01.917994 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:01.923281 22194 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.924268 22375 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.926565 22375 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:01.910372 22444 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:01.931627 22444 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.932199 22435 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.932375 20256 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:01.935720 22438 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.935431 22446 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.938763 22162 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.918160 22035 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.939285 22446 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:01.943734 20321 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.944412 20322 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:01.883662 22218 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.950671 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.888352 22347 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.945647 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.965087 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:01.964679 20324 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:01.917615 22238 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.968551 20329 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:18:01.970971 20174 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:01.972607 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:01.972507 22238 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.974921 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:01.975275 22434 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:01.975863 20250 raft_consensus.cc:2376] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5. Re-sending same reply.
I20260709 12:18:01.914958 22275 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:18:01.990877 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:01.920449 22368 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:01.993466 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:02.006748 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.986581 22238 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:02.013840 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:01.980863 22035 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:02.015369 20250 raft_consensus.cc:2376] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3. Re-sending same reply.
I20260709 12:18:02.000546 22442 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.023015 22238 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:02.017629 22201 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.023237 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:02.023694 22201 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.024262 20250 raft_consensus.cc:2376] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2. Re-sending same reply.
I20260709 12:18:02.023279 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.014541 22347 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.034636 22138 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.035261 22238 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.035873 20330 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:02.037171 22218 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:02.037037 22446 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.037807 22218 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.038465 22218 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.040233 22162 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:02.040930 22162 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.041427 22162 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.042502 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:02.043653 22454 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:02.045817 20326 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:02.024289 22201 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.048887 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.056109 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.056407 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:02.056769 22453 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:18:02.057106 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.057670 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.057839 20175 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.020473 22447 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.054895 20249 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.057118 20253 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
W20260709 12:18:02.064921 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.068873 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:02.031538 22321 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.070690 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.044106 22454 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:02.083123 22454 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.084889 22454 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.074565 22445 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.070530 22316 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:18:02.088049 22445 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.076045 22218 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.076547 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.078584 22162 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.079159 22238 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.079770 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.080807 22341 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.065404 22442 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.081460 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.070683 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.029559 22035 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.097275 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.063242 22447 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:02.098642 20323 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:02.018203 22443 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 12:18:02.104120 20254 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:02.111495 20175 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.091451 22445 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.122512 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.122503 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.133279 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.134371 20178 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:02.134588 22035 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.135361 21035 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 1.
I20260709 12:18:02.135716 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:02.136662 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.137319 20176 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:02.137393 20252 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:02.135368 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.135830 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:02.137238 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 108653us
I20260709 12:18:02.120841 22447 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.149443 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.149586 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.149448 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.149138 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.137249 22236 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:02.152441 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.152817 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:02.147257 22450 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:18:02.141656 22238 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:02.145154 22132 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:02.160725 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.162307 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:02.163723 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.163894 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.164203 20321 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:02.164583 22457 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.165104 22368 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.167551 22448 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:02.168972 20179 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:02.174906 21040 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:02.183375 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.196787 20254 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:02.201617 22457 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:02.201668 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.203279 21039 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:02.204164 22457 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.204694 21042 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:02.199704 22238 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.208668 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:02.209334 20254 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.209908 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:02.211477 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.212015 22415 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.212425 22415 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:02.212809 22415 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.213019 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.200703 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:02.174244 22132 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:02.217970 20322 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:02.218950 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.220022 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.220781 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.223091 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.181696 22448 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:02.224385 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.225486 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.231613 20177 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.228220 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:02.230195 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.232404 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.232700 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.231666 20254 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.224064 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.237421 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.242098 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.242828 20328 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:02.217969 20294 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.511s (SENT)
I20260709 12:18:02.240921 20321 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
W20260709 12:18:02.244982 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.247092 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.248202 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:02.226642 20323 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:02.248288 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.247725 20325 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:02.249666 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.250504 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.235244 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.251467 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:02.273646 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.295035 22464 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:18:02.295197 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.296306 21036 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:02.297618 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.299022 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.299680 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.300338 21043 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:02.301481 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.302631 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.237128 22257 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.303860 22257 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:02.304124 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57651us
I20260709 12:18:02.305063 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:02.306685 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:02.307242 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.307686 22445 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:02.308492 22445 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:02.308580 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.308908 22445 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:02.309338 22445 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:02.250099 22425 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.310118 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.311527 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.321466 20248 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:02.312587 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.310720 22425 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.323644 20251 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.324330 22448 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.324810 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.325214 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.325641 22425 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:02.325790 22448 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.326222 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.326416 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.326929 20251 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:02.327693 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.327764 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.328265 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.318691 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.318931 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.329954 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.330494 20323 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:02.327701 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.328940 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.331466 20326 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:02.316717 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:02.295209 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.332372 20172 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:02.317773 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.249917 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.304275 22257 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.329728 20321 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:02.329689 20254 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:02.335968 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.329044 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.338522 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.348241 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.349522 20254 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:02.356609 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:02.354100 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:02.358284 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.360369 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:02.361085 20174 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:02.362190 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.359154 20178 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.366024 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.295274 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.351159 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 277) took 1050 ms. Trace:
I20260709 12:18:02.374894 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.367493 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.339694 22457 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:02.375517 20330 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:02.366699 21043 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:02.379081 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:02.376845 20324 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:02.372954 20179 rpcz_store.cc:276] 0709 12:18:01.289124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.570239 (+281115us) service_pool.cc:224] Handling call
0709 12:18:01.574777 (+  4538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.181835 (+607058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.339603 (+157768us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54000c5dd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:02.339774 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365382400}
W20260709 12:18:02.383548 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 167787us
I20260709 12:18:02.384557 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:02.329980 22447 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.360502 22425 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.340484 21037 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:18:02.392577 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86003.4us
I20260709 12:18:02.392644 20180 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:02.377573 22457 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:02.397644 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.382853 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.389271 22368 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:02.377434 21035 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:02.411311 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-94a451623b3d4ba9b27eb7e8b56cb47a received from {username='slave'} at 127.0.0.1:40218
I20260709 12:18:02.421804 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-94a451623b3d4ba9b27eb7e8b56cb47a on tablet 94a451623b3d4ba9b27eb7e8b56cb47a with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:02.426258 21043 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:18:02.403944 22457 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:02.455749 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.471382 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.503925 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 77172.2us
I20260709 12:18:02.383373 22132 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:02.395722 22425 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:02.524587 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.517220 21038 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:02.419404 22442 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.415154 20251 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
W20260709 12:18:02.564800 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 134545us
I20260709 12:18:02.566102 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:02.506699 22368 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:02.513913 22238 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.404927 22236 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 12:18:02.506680 22384 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:18:02.582679 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:02.578249 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.584086 21041 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:18:02.583158 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:02.615404 20250 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
W20260709 12:18:02.624507 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.582027 22316 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:02.640141 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:02.641198 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 256623us
W20260709 12:18:02.654439 20294 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.528s (SENT) [suppressed 36 similar messages]
I20260709 12:18:02.616708 22138 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.611135 22321 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:02.668191 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.669421 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.671180 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.671707 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.672315 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.643965 22474 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:18:02.674274 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:02.681145 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 108440us
W20260709 12:18:02.684368 22473 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:18:02.685194 22201 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 12:18:02.685642 22201 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.687980 21039 raft_consensus.cc:2368] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5.
I20260709 12:18:02.675884 22442 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.689075 22442 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.689481 22442 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.696152 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.697525 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.697712 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.698335 21041 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:02.698937 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.699168 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.700183 21042 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:02.700457 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.706614 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:02.706692 21041 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:02.709764 22384 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.710197 22384 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:02.710583 22384 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.714049 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:02.664321 22138 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:02.713627 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:02.719051 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:02.719820 22415 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 12:18:02.720060 22035 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:02.720465 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:02.720865 22035 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.720440 22415 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.721293 22035 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:02.721769 22035 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.723810 22458 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.724337 22458 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:02.724803 22458 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.734886 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:02.682263 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.738587 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.739550 20249 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:02.715517 22347 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.713405 22447 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.736685 22138 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.744169 22321 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:02.723495 22415 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.766108 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.766759 20249 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:02.749745 22201 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:02.768972 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86909.3us
I20260709 12:18:02.753427 22347 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:02.773836 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:02.777681 20294 leader_election.cc:336] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 2.043s (SENT)
W20260709 12:18:02.769827 22476 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:02.716840 22368 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:02.773700 22347 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.769423 22321 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:02.803125 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.823298 21042 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:18:02.778458 22425 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:02.809785 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:02.827685 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57406.5us
W20260709 12:18:02.797976 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 338220us
I20260709 12:18:02.764875 22035 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.830803 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.830042 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:02.840149 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.821671 22415 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:02.840955 20249 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:02.802930 22152 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.845386 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.860575 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.804476 22316 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.849700 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.858101 22457 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:02.894618 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 172157us
I20260709 12:18:02.895843 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:02.896947 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:02.898612 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.900895 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 132888us
I20260709 12:18:02.901760 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:02.904734 20248 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:02.801014 22445 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.905124 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:02.895241 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:02.915045 20294 leader_election.cc:336] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 2.141s (SENT)
W20260709 12:18:02.920629 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 90708.6us
I20260709 12:18:02.892652 22316 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:02.926690 22479 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:18:02.932281 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:02.936285 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.939713 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.940853 22415 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:02.942016 20255 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:02.944998 22316 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.946904 20176 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:02.904911 22152 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:02.919785 20251 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:02.933332 22494 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:02.968199 22494 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:02.970520 22494 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:02.933300 22321 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:02.946501 22489 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:02.983316 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.966905 22442 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:02.983981 20247 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:18:02.984004 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 72316.1us
I20260709 12:18:02.963135 22138 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:02.988529 22484 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:02.989318 22485 raft_consensus.cc:1064] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:18:02.989261 22457 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.974787 22445 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:02.963443 22487 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 12:18:03.006240 20249 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:02.948246 22316 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.007663 20256 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:03.007758 22316 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:03.008796 22483 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:18:03.010843 22316 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:02.960008 22478 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.012543 22478 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.012213 22485 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.012904 22478 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:03.015523 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.996213 20294 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 2.147s (SENT)
I20260709 12:18:02.988008 22368 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.957057 22488 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:02.987073 22489 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:02.991546 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86510.1us
I20260709 12:18:02.974723 22384 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.027899 22368 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:03.035804 22368 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.037810 22341 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:18:03.038033 22257 consensus_meta.cc:287] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.002s
I20260709 12:18:03.038316 22341 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:03.038569 22257 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.041157 22478 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.052748 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.053920 22152 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.055217 22457 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:03.048427 22035 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.032738 22489 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.061403 22458 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:03.053020 22448 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.008s
I20260709 12:18:03.075299 21040 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:18:03.081313 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.081605 22138 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.083207 22257 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:03.083972 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.086591 22368 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.005816 22415 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:03.087910 22471 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.676s	user 0.002s	sys 0.005s
I20260709 12:18:03.089035 22384 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.039332 22341 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.090087 22341 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.092289 22442 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:03.092830 22497 consensus_queue.cc:1175] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:03.097738 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 196025us
I20260709 12:18:03.068163 22458 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.112916 22499 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:03.120910 22478 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:03.121258 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.073422 22486 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:18:03.124185 22497 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:03.127866 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:03.128690 20323 raft_consensus.cc:606] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.129066 20323 raft_consensus.cc:614] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:03.132856 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 89999.6us
I20260709 12:18:03.133365 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:03.134096 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 92136us
I20260709 12:18:03.138474 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.138747 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.140075 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.141319 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.142539 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:03.162304 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.161742 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.163867 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.169620 21039 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:03.151764 22496 raft_consensus.cc:2764] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:18:03.168094 22482 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.328s	user 0.000s	sys 0.004s
I20260709 12:18:03.179862 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 307) took 6359 ms. Trace:
I20260709 12:18:03.174345 22486 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.177129 20076 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 3 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:03.185055 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.179159 22368 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.179837 22236 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:03.180370 22489 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.148293 22347 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.173170 22502 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.181265 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.181592 22132 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.181293 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:03.187655 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 257877us
I20260709 12:18:03.194917 20250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:18:03.198367 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.199307 20329 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:03.249933 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.200714 20323 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:03.255295 22347 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.258059 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.263403 20250 raft_consensus.cc:606] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.274943 20250 raft_consensus.cc:614] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:03.264420 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.265224 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.265407 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.193400 22502 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.284693 22502 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.284938 22489 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.266583 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.286517 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.287147 21036 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:03.287725 22432 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.287961 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.288096 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.288232 22432 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.289111 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:03.289487 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 108299us
I20260709 12:18:03.290517 22432 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:03.292914 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.293650 21038 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.295840 22489 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:03.297451 22504 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.275354 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.300483 21040 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:03.274081 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:03.265769 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.278890 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.279048 21034 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:18:03.279690 21035 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 1.
I20260709 12:18:03.279851 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.183370 20075 rpcz_store.cc:276] 0709 12:17:56.812091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.847047 (+ 34956us) service_pool.cc:224] Handling call
0709 12:18:03.171702 (+6324655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:01.750770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:01.751533 (+   763us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:01.751630 (+    97us) write_op.cc:435] Acquired schema lock
0709 12:18:01.751670 (+    40us) tablet.cc:662] Decoding operations
0709 12:18:01.752429 (+   759us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:01.752544 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:01.752575 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:01.753061 (+   486us) tablet.cc:701] Row locks acquired
0709 12:18:01.753117 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:18:01.753317 (+   200us) write_op.cc:270] Start()
0709 12:18:01.753495 (+   178us) write_op.cc:276] Timestamp: P: 1783599481753249 usec, L: 0
0709 12:18:01.753542 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 12:18:01.812498 (+ 58956us) log.cc:844] Serialized 1303 byte log entry
0709 12:18:02.236425 (+423927us) op_driver.cc:464] REPLICATION: finished
0709 12:18:02.578456 (+342031us) write_op.cc:301] APPLY: starting
0709 12:18:02.578574 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:02.578760 (+   186us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:02.578962 (+   202us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:02.643493 (+ 64531us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:02.699863 (+ 56370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:18:02.699950 (+    87us) write_op.cc:312] APPLY: finished
0709 12:18:02.700383 (+   433us) log.cc:844] Serialized 35 byte log entry
0709 12:18:02.700620 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:02.700724 (+   104us) write_op.cc:454] Released schema lock
0709 12:18:02.700789 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:02.701350 (+   561us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:02.701393 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38625,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":307411,"apply.run_cpu_time_us":3675,"apply.run_wall_time_us":122867,"num_ops":3,"prepare.queue_time_us":159767,"prepare.run_cpu_time_us":64168,"prepare.run_wall_time_us":222536,"raft.queue_time_us":124700,"raft.run_cpu_time_us":33127,"raft.run_wall_time_us":177386,"replication_time_us":473414,"thread_start_us":375096,"threads_started":4,"wal-append.queue_time_us":171584}]]}
I20260709 12:18:03.283265 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.304541 20256 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:03.302208 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:03.335325 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 169749us
I20260709 12:18:03.276810 22321 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.337622 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.298650 22486 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:03.358650 22508 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:03.316354 22347 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:03.360049 22347 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:03.359530 22508 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.361126 22347 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.369350 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.310006 22499 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.386101 22236 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.386843 22257 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:03.387744 22513 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:18:03.387607 22257 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.386893 22236 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.389542 22236 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.363507 21035 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:03.398551 21038 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:03.398864 22493 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:03.399732 22493 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.400360 22257 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.401535 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:03.402792 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.403484 20254 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:03.404131 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:03.405426 22498 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.405926 22498 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.341393 22321 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.414247 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.416575 20254 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:03.420202 21038 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:03.421551 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:03.419775 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 113007us
I20260709 12:18:03.422478 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:03.402529 22499 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.424770 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:03.411947 22496 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:03.413362 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 107428us
I20260709 12:18:03.420485 22321 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.430173 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.437577 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:03.431975 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.442977 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:03.445736 20323 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:03.446221 20325 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:03.428224 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.444768 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:03.449815 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:03.450001 20255 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:03.425217 22499 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.470973 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:03.471153 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.564760 20322 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:03.471889 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.427845 22132 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:03.450551 20249 raft_consensus.cc:2376] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4. Re-sending same reply.
I20260709 12:18:03.447738 22384 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:03.484639 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:03.573490 20323 raft_consensus.cc:606] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.485116 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:03.448099 22496 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:03.485862 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:03.489916 22509 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:18:03.491947 22508 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:03.494022 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.501340 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.507715 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.508812 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.472016 22432 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:18:03.448333 22478 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.448873 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:03.571174 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 99400us
I20260709 12:18:03.573968 20323 raft_consensus.cc:614] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:03.482812 22415 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:03.568162 22511 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.572247 22257 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.612103 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:03.613265 20180 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:03.615628 20176 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:03.615751 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:03.616549 20172 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:03.615353 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:03.625303 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.608901 22511 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.630565 22511 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.609092 22257 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.631862 22257 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.631304 22499 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.634240 22499 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:03.611490 22415 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:03.637923 22415 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.607806 22493 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:03.640187 20251 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:03.648734 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:03.650573 20172 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.632010 22496 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.639758 22494 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:03.636477 22502 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:03.655918 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.645838 22512 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.661854 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:03.662459 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 95756.9us
I20260709 12:18:03.668709 20180 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:03.668376 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.670166 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:03.672031 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.669765 22132 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.680637 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:03.682147 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 111112us
I20260709 12:18:03.677362 22132 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.686164 22132 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.677614 22432 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.677297 22493 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.669224 22494 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.699067 21037 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:03.693801 22432 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:03.694965 22493 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.702692 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:03.712172 20172 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:03.712533 22432 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.712384 22493 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.732309 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:03.734441 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 285638us
I20260709 12:18:03.735224 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.723610 22502 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:03.736634 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:03.736847 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 56338.9us
I20260709 12:18:03.723958 22522 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.721539 20251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
W20260709 12:18:03.737123 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58015.2us
I20260709 12:18:03.721097 22512 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.705304 22236 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.739782 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.746836 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.715612 22321 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.738353 22503 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.759368 22503 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:03.751932 20295 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.753544 21007 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:03.753669 22507 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.430s	user 0.002s	sys 0.006s
I20260709 12:18:03.758242 22132 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.758872 22524 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:03.738668 22478 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:03.760764 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.761839 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.748893 22512 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.748534 22499 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.766420 20323 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:03.768627 22512 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.754371 20251 raft_consensus.cc:606] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.769240 20251 raft_consensus.cc:614] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:03.769304 22517 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:03.752027 22501 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:03.759881 22503 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.751078 22486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53418 (request call id 90) took 1741 ms. Trace:
I20260709 12:18:03.763749 22518 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:03.837598 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74659.2us
W20260709 12:18:03.837774 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 73916.7us
I20260709 12:18:03.839172 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:03.840678 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 80002.8us
I20260709 12:18:03.841768 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.771629 22501 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:03.783979 22478 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.782788 22494 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.853012 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:03.841426 22504 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:18:03.857007 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 89811.4us
I20260709 12:18:03.859303 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:03.860895 22521 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:03.861159 22516 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.861814 22535 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:03.864494 22132 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.774044 22486 rpcz_store.cc:276] 0709 12:18:02.009456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.013517 (+  4061us) service_pool.cc:224] Handling call
0709 12:18:02.166029 (+152512us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b4c00311dc0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd91c4a20 00007f5dd91d5a29 00007f5dd919b644 00007f5dd91c2f2d 00007f5dd91c2b93 00007f5ddae511af 00007f5ddae50f3e 00007f5ddaed6888 00007f5ddaef375c 00007f5ddaef476a 00007f5ddaef391b
0709 12:18:02.166792 (+   763us) log.cc:844] Serialized 501 byte log entry
0709 12:18:03.747352 (+1580560us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10982,"raft.queue_time_us":11692,"raft.run_cpu_time_us":1272,"raft.run_wall_time_us":1269,"spinlock_wait_cycles":6221184,"thread_start_us":30741,"threads_started":1,"wal-append.queue_time_us":85898,"wal-append.run_cpu_time_us":1967,"wal-append.run_wall_time_us":1004023}
I20260709 12:18:03.867033 22321 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.870635 22516 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:03.794078 22517 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:18:03.872818 22517 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.872822 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:03.874473 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:03.875533 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:03.877249 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.877902 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.878532 21041 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:18:03.873324 22517 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:03.880378 22517 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.880519 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.881002 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.881424 21034 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.883884 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.884076 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.885057 21040 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:03.852538 22525 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.886184 22525 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.886670 22525 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.892838 22236 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:03.894027 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:03.847592 22499 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.908601 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:03.909478 20252 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.848351 22478 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:03.916360 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 77001us
I20260709 12:18:03.916718 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:03.924338 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:03.925449 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:03.926347 21039 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:03.858276 22504 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:03.867439 22257 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:03.991415 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:03.992112 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 67893us
I20260709 12:18:03.896273 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8271323bedc7421a87f787fc100b6efe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:03.995368 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:04.029407 20063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 133312us
I20260709 12:18:03.909955 22519 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:04.030179 22519 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:03.907011 22499 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:04.002621 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:03.919400 22535 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.922694 22478 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.911320 22132 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.004176 22347 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:04.024766 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:03.928846 22236 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.927552 22516 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:18:04.029721 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:03.921833 22536 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:04.038982 20177 raft_consensus.cc:2410] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:04.063740 22533 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:04.064512 22536 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.001959 21037 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.065052 22536 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.063968 22496 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:04.067770 22496 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:04.068230 22496 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:04.069317 22533 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:04.050173 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.031136 22519 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.073732 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:04.073815 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:04.033452 22530 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:04.057533 20175 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:04.058530 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:04.041918 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.049227 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:04.078404 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:04.028609 22486 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:04.055862 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.092553 20179 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:04.074911 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71631.2us
W20260709 12:18:04.059211 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65243.4us
I20260709 12:18:04.094174 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:03.915431 22524 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:18:04.075960 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:04.045723 22499 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.095502 22321 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.050521 22535 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:04.079691 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.081802 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.109457 20180 raft_consensus.cc:2410] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:04.077653 20249 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:04.094938 20254 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:04.094220 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.095022 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:04.101576 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 110251us
I20260709 12:18:04.111012 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:04.018851 22517 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.057071 22347 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:04.061367 22236 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:04.078990 20247 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:04.025832 22522 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:04.102232 20255 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:04.106761 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.060984 22132 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.095233 22486 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.124109 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.124818 20177 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:04.115646 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:04.080076 22542 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:04.114408 22347 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.134042 22542 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.137288 22542 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:04.121191 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.140240 20180 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:04.108669 22526 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 12:18:04.116415 20256 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:04.144888 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.146454 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.148023 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.149439 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.159386 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.107033 22415 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:04.107056 22489 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:04.156594 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.127367 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.114902 22541 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:04.117064 22236 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.121307 22519 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.119192 22524 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.127010 22486 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.196375 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.185988 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.187812 20178 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.112035 22535 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.032228 22501 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.080185 22511 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.185205 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.185439 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.112838 22321 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.201328 22522 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:04.226963 22522 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.227371 22522 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:04.100914 22504 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.232161 22504 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:04.234061 22532 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 12:18:04.236953 22543 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:04.237519 22543 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:04.185324 22415 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.238536 22543 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.239877 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.194429 22502 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:04.242717 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.243384 22545 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:04.243772 22545 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:04.244175 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.244732 22545 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.239882 20176 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:04.220382 22538 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:04.248095 22538 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.249157 22501 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.221109 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:04.221547 22546 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:04.186862 22541 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:04.195765 22489 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.226521 20173 raft_consensus.cc:2368] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
W20260709 12:18:04.276104 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.107321 22530 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:04.292861 22534 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:18:04.293165 22511 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:04.191617 22516 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:04.326669 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.329223 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 218294us
I20260709 12:18:04.373783 20324 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:18:04.358397 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.322044 22546 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:04.456328 22537 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:18:04.455158 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.459420 20325 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:04.459941 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:04.462714 20294 connection.cc:256] RPC call timeout handler was delayed by -1.1439230299999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 12:18:04.455158 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.469647 20330 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:04.459053 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:04.474810 20328 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:18:04.478477 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 129387us
I20260709 12:18:04.477644 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:04.485848 20321 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:04.485057 20325 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.385569 22347 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.489420 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:04.490171 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:04.492641 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 377067us
W20260709 12:18:04.504184 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 334759us
I20260709 12:18:04.438787 22498 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:04.506892 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.508606 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.509896 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:04.512174 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.516148 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52674.2us
I20260709 12:18:04.394552 22516 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:04.521977 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.473707 22545 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.524102 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.550894 20177 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:04.574149 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.557408 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 50712us
I20260709 12:18:04.512624 22518 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:04.557255 22368 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.671595 22368 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:04.673709 20293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.027s	sys 0.046s
W20260709 12:18:04.674142 20293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.027s	sys 0.046s
I20260709 12:18:04.660449 22485 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:04.676121 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.676450 21039 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:04.682598 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:04.605788 22453 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:04.524185 22497 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:04.542888 22442 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:04.696417 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.683516 20328 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:04.475416 22541 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.696184 22555 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:04.703265 22497 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.700474 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:04.703608 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.704444 20324 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:04.701224 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.703830 22555 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.660683 22498 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.675637 22485 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:04.720873 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.721168 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.721552 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.725988 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:04.727396 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:04.728016 20254 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.728866 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.729684 20173 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:04.713653 22554 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:18:04.713469 22550 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 12:18:04.733770 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 222380us
I20260709 12:18:04.741533 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.742241 20326 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:04.738289 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.742781 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.743374 20173 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.748075 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.712376 22517 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:04.703717 22442 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.752633 22530 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:04.752514 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:04.753319 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.746376 22558 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:04.756094 22559 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.756455 22560 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.724498 22458 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:04.760938 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.745473 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:04.750411 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.721045 22538 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:04.702759 22518 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:04.768414 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.770713 22555 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:04.776571 22529 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:04.781021 22566 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:04.781507 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 43621.4us
I20260709 12:18:04.780169 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.724203 22321 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:04.790529 20254 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:18:04.855571 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.722604 22498 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:04.795092 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:04.864952 20252 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.943s	user 0.014s	sys 0.017s
I20260709 12:18:04.796873 22558 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.797631 22257 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:04.799098 20247 consensus_meta.cc:287] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.681s	user 0.023s	sys 0.011s
I20260709 12:18:04.802749 20324 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:04.873934 20247 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:18:04.767935 22525 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.013s
I20260709 12:18:04.806294 20175 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:04.798882 22504 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.566s	user 0.001s	sys 0.033s
I20260709 12:18:04.806407 22560 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:04.815765 22511 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:04.817692 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 72600us
I20260709 12:18:04.880124 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.818373 22564 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:04.827168 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:04.834715 22478 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.761s	user 0.014s	sys 0.021s
I20260709 12:18:04.794602 22497 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:04.836265 22442 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:04.848591 21034 consensus_meta.cc:287] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.966s	user 0.004s	sys 0.031s
W20260709 12:18:04.847261 22493 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.108s	user 0.012s	sys 0.000s
W20260709 12:18:04.792994 20179 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.700s	user 0.021s	sys 0.015s
I20260709 12:18:04.952034 20179 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:18:04.865605 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 71082.2us
I20260709 12:18:04.953567 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:04.866360 20252 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:04.869210 20173 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:04.954213 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:04.704896 22546 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.956525 21039 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:04.956775 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:04.872965 22321 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:04.881856 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:04.894567 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.503s (SENT)
I20260709 12:18:04.969672 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 446) took 1509 ms. Trace:
I20260709 12:18:04.969282 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:04.894901 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:04.906239 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.975044 20252 rpcz_store.cc:276] 0709 12:18:03.445248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.445408 (+   160us) service_pool.cc:224] Handling call
0709 12:18:03.908374 (+462966us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:18:04.954419 (+1046045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82566528}
W20260709 12:18:04.870994 22496 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.000s
I20260709 12:18:04.955166 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.877566 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:04.980676 20175 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:04.810328 22458 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:04.982867 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:05.000480 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:05.001616 20175 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:05.002378 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:05.004503 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 109724us
I20260709 12:18:04.993213 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.009958 20171 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:04.953253 22368 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:04.977756 22519 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:04.974910 22321 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:04.902372 22525 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.034503 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:04.952214 21034 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:04.958317 22347 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:04.977553 22511 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:05.029860 20144 leader_election.cc:400] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5.
I20260709 12:18:05.067896 20144 leader_election.cc:403] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:04.955034 22566 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:05.044159 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 164145us
I20260709 12:18:05.074249 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:04.969514 22493 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:05.006879 22536 consensus_meta.cc:287] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.941s	user 0.007s	sys 0.015s
I20260709 12:18:05.028630 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.079843 20179 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:04.969429 22504 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:18:04.951763 22478 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.065017 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:05.036126 22497 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:05.031627 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:05.065897 22533 raft_consensus.cc:2764] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:05.076709 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:05.008879 22432 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.260s	user 0.014s	sys 0.037s
I20260709 12:18:05.051949 22442 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:05.081916 20176 raft_consensus.cc:2368] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:18:05.054139 22516 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.083108 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:05.124924 20173 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.991843 22496 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:05.095899 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 201390us
I20260709 12:18:05.099907 20329 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:05.031000 22561 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:18:05.076941 21037 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.012s	user 0.018s	sys 0.004s
I20260709 12:18:05.027122 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:05.135426 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 58795.3us
I20260709 12:18:05.102690 22497 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:05.105845 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 136318us
I20260709 12:18:05.107164 20177 raft_consensus.cc:2368] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:18:05.141136 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:05.108412 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:05.069764 22519 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:05.081462 22512 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.312s	user 0.015s	sys 0.008s
I20260709 12:18:05.116503 20330 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:05.117092 22522 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.889s	user 0.025s	sys 0.023s
I20260709 12:18:05.120123 22432 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.122786 20180 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:18:05.123721 22347 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:05.082554 22564 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:05.118063 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:05.081863 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 318) took 1194 ms (client timeout 1530 ms). Trace:
I20260709 12:18:05.084900 22538 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5.
I20260709 12:18:05.083266 22511 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:05.060695 22568 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 12:18:05.104650 20178 consensus_meta.cc:287] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.902s	user 0.017s	sys 0.021s
I20260709 12:18:05.171586 20178 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:05.099659 22132 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.138155 20179 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:18:05.119606 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:05.179191 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59713us
I20260709 12:18:05.146138 20173 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:05.147977 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.154004 20180 pending_rounds.cc:85] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 2
I20260709 12:18:05.182868 20180 pending_rounds.cc:107] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:05.183148 20180 raft_consensus.cc:2889] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:05.154947 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:05.158329 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50009.2us
I20260709 12:18:05.160673 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:05.161473 20175 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:05.188118 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:05.086098 22536 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.084975 22518 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:18:05.150702 22497 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.166116 21035 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:05.156399 21037 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:05.153950 22566 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:05.202270 20171 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:05.207834 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:05.209470 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:05.165997 22516 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:05.220705 20179 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:05.157315 22564 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:05.181120 22503 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.389s	user 0.009s	sys 0.005s
I20260709 12:18:05.171988 22485 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.196679 22553 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:05.125909 22321 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.243695 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:05.244109 22321 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:05.244932 20173 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:05.248592 22511 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.254240 22561 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:05.254835 22561 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:05.256246 22570 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:18:05.255848 22561 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.257799 22558 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.259083 22478 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:05.201736 22132 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:05.262362 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.228164 22535 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.029s
W20260709 12:18:05.265409 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 129142us
I20260709 12:18:05.159781 22512 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:05.161564 21034 rpcz_store.cc:269] 0709 12:18:03.877804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.880215 (+  2411us) service_pool.cc:224] Handling call
0709 12:18:05.072522 (+1192307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:05.165197 22522 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.211535 22498 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.268584 20179 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:05.273418 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:05.269858 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:05.274274 20171 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:05.230262 22578 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:05.275537 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:05.271997 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 154021us
I20260709 12:18:05.226632 22516 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:05.278971 20254 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:05.229930 22564 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:05.238922 22555 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:05.237576 22415 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.310920 20250 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:05.313009 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:05.265846 22132 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.318683 20323 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:18:05.318954 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:05.267477 21037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 312) took 1401 ms. Trace:
I20260709 12:18:05.270939 22448 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.328413 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:05.330535 20326 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:05.333092 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.238641 22503 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.304795 22516 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.341324 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:05.327267 22501 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.074s	user 0.017s	sys 0.022s
I20260709 12:18:05.346446 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:05.347956 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.354840 20248 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:05.350405 22574 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:18:05.367182 22545 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.801s	user 0.005s	sys 0.005s
W20260709 12:18:05.370537 22559 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
W20260709 12:18:05.374218 22499 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.267s	user 0.018s	sys 0.018s
W20260709 12:18:05.378219 22236 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.158s	user 0.011s	sys 0.023s
I20260709 12:18:05.379289 22432 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:05.425443 22576 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:18:05.425614 22536 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:05.426772 22577 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:18:05.382685 22524 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.183s	user 0.024s	sys 0.008s
I20260709 12:18:05.392870 22493 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.427450 22524 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:05.306480 22368 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:18:05.351763 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:05.428599 21035 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:05.384091 22486 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.087s	user 0.016s	sys 0.003s
I20260709 12:18:05.273690 22535 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.384584 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.346899 22581 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:05.321208 22132 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:05.388137 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.391750 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 115117us
I20260709 12:18:05.439457 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:05.385982 22546 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:05.398113 20324 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:05.398800 20321 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:05.417783 22499 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.445295 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.446488 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:05.446581 22499 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.398622 22559 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:05.420433 22497 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:05.422222 22585 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 12:18:05.441522 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.329574 21037 rpcz_store.cc:276] 0709 12:18:03.859787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.874512 (+ 14725us) service_pool.cc:224] Handling call
0709 12:18:03.923031 (+ 48519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.213551 (+1290520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.236769 (+ 23218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:05.345873 22448 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.423360 22236 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:05.395951 22504 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:05.428494 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.379403 22557 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:05.437582 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.302472 22519 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.437376 22486 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.520222 20322 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:05.444242 22535 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:05.444562 22560 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.447295 20328 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:05.447245 20325 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:05.440909 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:05.417587 22489 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.460304 20248 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:05.422833 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:05.510439 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.468802 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.448843 20251 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.449052 22524 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:05.459692 22496 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.525909 20255 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:05.533010 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:05.514320 22504 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.512620 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:05.535300 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 94474.6us
I20260709 12:18:05.533690 20250 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:05.514510 22557 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:05.546103 20253 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:05.553817 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 107061us
I20260709 12:18:05.556746 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:05.561736 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:05.529785 22536 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:05.563871 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:05.527886 22524 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:05.567304 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:05.569322 21041 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:05.570019 20250 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:05.554301 22504 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:05.546787 22589 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:05.575320 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:05.553900 22546 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.524178 22493 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:18:05.564891 22560 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:05.616396 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2491) took 1119 ms. Trace:
I20260709 12:18:05.579655 22528 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:18:05.566752 22257 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:05.577059 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:05.572533 22524 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:05.611038 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1872) took 1593 ms. Trace:
I20260709 12:18:04.780123 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:05.564735 22581 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:05.557601 22559 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:18:05.616832 20330 rpcz_store.cc:276] 0709 12:18:04.471521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.477340 (+  5819us) service_pool.cc:224] Handling call
0709 12:18:05.589397 (+1112057us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54002daad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:05.589532 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446256896}
I20260709 12:18:05.621162 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:05.621724 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:05.623075 22540 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:05.626601 20250 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:18:05.626863 22579 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:18:05.627487 21035 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:05.622221 20178 rpcz_store.cc:276] 0709 12:18:03.993161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.012713 (+ 19552us) service_pool.cc:224] Handling call
0709 12:18:05.586246 (+1573533us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003e7454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:05.586353 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264569728}
I20260709 12:18:05.629347 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:05.630249 22549 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.387s	user 0.016s	sys 0.000s
I20260709 12:18:05.631042 22448 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:05.631912 22497 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.632859 22257 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:05.634491 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:05.635728 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:05.635800 22236 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:05.636833 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:05.636977 22541 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.637523 20330 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:05.572279 22536 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.638257 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:05.636003 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1860) took 1717 ms. Trace:
I20260709 12:18:05.640532 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:05.640466 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:05.641289 22257 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:05.616067 22560 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.644075 20330 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:05.646040 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:05.646538 20330 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.645195 22560 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.617324 22512 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.643703 20172 rpcz_store.cc:276] 0709 12:18:03.918355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.918560 (+   205us) service_pool.cc:224] Handling call
0709 12:18:03.918905 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.991114 (+ 72209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:03.991154 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.001358 (+ 10204us) log.cc:844] Serialized 26 byte log entry
0709 12:18:04.060172 (+ 58814us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:04.060223 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:04.060310 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.577703 (+1517393us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:05.635650 (+ 57947us) raft_consensus.cc:1685] finished
0709 12:18:05.635675 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.635901 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71760,"raft.queue_time_us":157995,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":16402,"spinlock_wait_cycles":21210880,"thread_start_us":5527,"threads_started":1,"wal-append.queue_time_us":151223}
I20260709 12:18:05.653445 22486 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.656126 22257 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:05.660661 22595 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:05.667639 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:05.613374 22557 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.588145 22546 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.679193 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:05.663708 22503 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.679226 22530 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:05.690610 20250 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:05.692291 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:05.694654 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.694945 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.695537 20173 raft_consensus.cc:2376] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5. Re-sending same reply.
I20260709 12:18:05.696764 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.700771 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:05.701488 21035 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.703861 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.705165 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.705405 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:05.706055 20325 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:05.706909 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:05.691398 22497 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:05.697801 22528 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:18:05.709694 22528 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:05.710080 22528 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:05.710564 20325 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:05.712846 22536 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:05.714501 21038 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:05.717593 22458 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:05.721400 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.722306 20177 raft_consensus.cc:2368] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5.
I20260709 12:18:05.722247 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:05.723301 22458 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:05.723706 22458 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:05.724084 22458 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.728264 22573 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:05.728781 22573 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:05.731521 22573 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.733043 22573 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.683123 22530 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:05.679625 22512 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:05.734254 20255 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:05.735160 20173 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:05.684142 22493 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:05.739360 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.008s
W20260709 12:18:05.739758 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.005s	sys 0.008s
W20260709 12:18:05.740070 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 530673us
I20260709 12:18:05.738214 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:05.629774 22581 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.742473 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:05.698172 22415 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:05.751061 22581 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.711123 22528 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.738015 22530 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:05.777280 22415 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:05.778378 22415 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.739500 22493 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:05.780023 22493 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.781002 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:05.783258 22522 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.744581 22512 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:05.789659 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:05.789979 22512 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:05.790179 20251 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:05.812338 20330 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:05.815578 20321 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260709 12:18:05.847328 22458 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:05.848738 22442 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:05.849431 20249 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:05.849337 22442 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:05.852288 22442 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:05.863090 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.824985 22588 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.476s	user 0.002s	sys 0.009s
W20260709 12:18:05.890216 20323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2481) took 1595 ms (client timeout 1995 ms). Trace:
W20260709 12:18:05.890848 20323 rpcz_store.cc:269] 0709 12:18:04.295147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.295293 (+   146us) service_pool.cc:224] Handling call
0709 12:18:05.889873 (+1594580us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54002d96d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:05.890122 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967014656}
I20260709 12:18:05.892561 22546 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:05.840548 22518 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.922844 22497 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:18:05.987413 22593 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:05.988092 22593 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.986303 22132 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.023175 22132 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.019821 22518 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:05.855458 21035 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:06.023818 22517 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:06.027154 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2484) took 1730 ms. Trace:
I20260709 12:18:06.027256 20327 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.028224 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2496) took 1303 ms. Trace:
I20260709 12:18:06.028506 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2497) took 1147 ms. Trace:
I20260709 12:18:06.035148 20321 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:06.037889 22525 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.040061 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2461) took 1331 ms. Trace:
I20260709 12:18:05.942919 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:06.051755 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.060925 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.073478 20076 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 203) took 8960 ms. Trace:
I20260709 12:18:06.074678 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1296) took 2027 ms. Trace:
W20260709 12:18:06.079196 22564 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.002s
I20260709 12:18:06.084707 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2487) took 1623 ms. Trace:
W20260709 12:18:06.089995 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.091032 20294 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.528s (SENT)
I20260709 12:18:06.146451 20330 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:06.169632 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 78638.1us
I20260709 12:18:06.109000 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.172240 20254 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:06.170867 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.170356 20294 leader_election.cc:336] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.657s (SENT)
I20260709 12:18:06.173609 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:06.176970 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.168385 20329 rpcz_store.cc:276] 0709 12:18:04.461725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.471311 (+  9586us) service_pool.cc:224] Handling call
0709 12:18:06.084510 (+1613199us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001a2554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:06.084631 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471091072}
I20260709 12:18:06.177762 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1865) took 2177 ms. Trace:
I20260709 12:18:06.153301 20324 rpcz_store.cc:276] 0709 12:18:04.881424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.881570 (+   146us) service_pool.cc:224] Handling call
0709 12:18:06.028266 (+1146696us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54003985d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:06.028427 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973918592}
I20260709 12:18:06.178406 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.153357 20176 rpcz_store.cc:276] 0709 12:18:04.708677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.708881 (+   204us) service_pool.cc:224] Handling call
0709 12:18:06.039737 (+1330856us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001d33d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:06.039973 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826189056}
I20260709 12:18:06.179071 20249 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:06.168357 20328 rpcz_store.cc:276] 0709 12:18:04.724436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.725300 (+   864us) service_pool.cc:224] Handling call
0709 12:18:04.725729 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.524784 (+799055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.027917 (+503133us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54000cf154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:06.028148 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659026816}
W20260709 12:18:06.180150 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.177872 20252 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:06.181389 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 238559us
I20260709 12:18:06.170104 20253 rpcz_store.cc:276] 0709 12:18:04.047336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.047692 (+   356us) service_pool.cc:224] Handling call
0709 12:18:04.071890 (+ 24198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.560462 (+1488572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.074295 (+513833us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400310454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:06.074564 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3389756672}
I20260709 12:18:06.182998 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:06.153221 20322 rpcz_store.cc:276] 0709 12:18:04.296348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.296481 (+   133us) service_pool.cc:224] Handling call
0709 12:18:04.374431 (+ 77950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.522897 (+1148466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.026834 (+503937us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540000ffd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:06.027065 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2634418432}
I20260709 12:18:06.199334 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.098017 22442 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.203776 20330 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:06.205935 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:06.206566 20326 raft_consensus.cc:2376] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2. Re-sending same reply.
I20260709 12:18:06.207943 20321 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:06.107359 22528 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:06.222702 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50181.4us
W20260709 12:18:06.193991 22524 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.008s
I20260709 12:18:06.105275 22581 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:06.185288 22557 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.185424 22384 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.200954 22497 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:06.205552 22541 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 12:18:06.185326 22132 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:06.228248 20074 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.222339 22512 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:06.244092 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:06.234483 22595 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.004s
I20260709 12:18:06.177313 22580 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:18:06.177145 22559 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:18:06.250654 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.274653 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:06.275704 20173 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:06.236284 22581 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.255920 22519 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:06.264541 22518 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:06.239614 22448 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:06.314299 22448 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:06.315344 22448 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:06.316468 22504 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.732s	user 0.000s	sys 0.010s
I20260709 12:18:06.316788 22448 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.316919 22504 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.238867 22593 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.168388 20076 rpcz_store.cc:276] 0709 12:17:57.112857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.113033 (+   176us) service_pool.cc:224] Handling call
0709 12:18:06.073328 (+8960295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:03.449594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:03.496219 (+ 46625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:03.496263 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:18:03.496283 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:03.569499 (+ 73216us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:03.575688 (+  6189us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:03.588880 (+ 13192us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:03.610095 (+ 21215us) tablet.cc:701] Row locks acquired
0709 12:18:03.612220 (+  2125us) write_op.cc:260] PREPARE: finished
0709 12:18:03.624601 (+ 12381us) write_op.cc:270] Start()
0709 12:18:03.646166 (+ 21565us) write_op.cc:276] Timestamp: P: 1783599483621445 usec, L: 0
0709 12:18:03.646830 (+   664us) op_driver.cc:348] REPLICATION: starting
0709 12:18:03.695333 (+ 48503us) log.cc:844] Serialized 536 byte log entry
0709 12:18:03.917359 (+222026us) op_driver.cc:464] REPLICATION: finished
0709 12:18:04.290848 (+373489us) write_op.cc:301] APPLY: starting
0709 12:18:04.290952 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:04.291074 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:04.291195 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:04.291526 (+   331us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:04.337219 (+ 45693us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:18:04.386033 (+ 48814us) write_op.cc:312] APPLY: finished
0709 12:18:04.469472 (+ 83439us) log.cc:844] Serialized 23 byte log entry
0709 12:18:04.486643 (+ 17171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.507072 (+ 20429us) write_op.cc:454] Released schema lock
0709 12:18:04.514181 (+  7109us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:04.662295 (+148114us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.678688 (+ 16393us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1144,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":368476,"apply.run_cpu_time_us":3067,"apply.run_wall_time_us":252191,"num_ops":1,"prepare.queue_time_us":150692,"prepare.run_cpu_time_us":7565,"prepare.run_wall_time_us":275219,"replication_time_us":206200,"thread_start_us":248598,"threads_started":2}]]}
I20260709 12:18:06.319780 20248 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:06.265627 22589 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.321425 22589 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.279856 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.324774 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.319370 22504 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.329543 22504 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:06.334779 20177 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:06.281958 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:06.179183 22530 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.195636 22517 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.195668 22564 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.247954 20074 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:06.345449 20074 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:06.268965 22132 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.304414 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:06.350024 20180 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.289928 22595 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:06.244588 22384 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.309266 22559 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:06.178534 20174 rpcz_store.cc:276] 0709 12:18:03.922784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.922930 (+   146us) service_pool.cc:224] Handling call
0709 12:18:04.002316 (+ 79386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.004720 (+  2404us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:04.189196 (+184476us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.772855 (+1583659us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b18003b2480. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa9823a 00007f5ddaf02a2a
0709 12:18:06.099483 (+326628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:06.099585 (+   102us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:06.099640 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.099729 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.099884 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96205,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":960,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":62068,"spinlock_wait_cycles":6537088,"thread_start_us":416130,"threads_started":2}
I20260709 12:18:06.312677 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2501) took 1031 ms. Trace:
I20260709 12:18:06.319779 22458 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.337865 20173 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.367352 21043 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:06.343226 22573 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.610s	user 0.002s	sys 0.012s
W20260709 12:18:06.294697 22516 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.897s	user 0.011s	sys 0.001s
I20260709 12:18:06.230746 22524 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.355820 20179 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:06.350724 22493 consensus_meta.cc:287] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.004s
W20260709 12:18:06.361611 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 207604us
I20260709 12:18:06.352615 20074 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.390640 21038 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:06.391575 20176 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:06.359421 20325 rpcz_store.cc:276] 0709 12:18:05.281636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.711353 (+429717us) service_pool.cc:224] Handling call
0709 12:18:05.711717 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:05.712404 (+   687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:05.712430 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:05.713008 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.820668 (+107660us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:05.820725 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.820830 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:06.312394 (+491564us) raft_consensus.cc:1685] finished
0709 12:18:06.312417 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.312610 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"thread_start_us":107137,"threads_started":1,"wal-append.queue_time_us":534567}
I20260709 12:18:06.337052 22519 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.347664 22593 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:18:06.359062 22559 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:06.434908 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.412721 22581 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.421808 22541 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:06.422272 22132 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.423905 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.447953 20177 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:06.449129 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.449347 22517 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:06.425776 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.452064 22384 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.452721 22519 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:06.454589 22559 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.456003 21038 raft_consensus.cc:2410] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:06.447985 22541 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.456933 22524 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:06.458086 22560 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.000s
I20260709 12:18:06.458529 22541 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.426110 22512 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:06.368738 22536 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:06.458581 22560 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.459626 22536 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.461697 22536 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:06.395437 22493 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.462769 20178 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:06.390484 22516 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.463810 22493 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.427073 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.428591 22564 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.429726 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.464859 21042 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:18:06.429798 22530 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.430335 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.431661 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.467598 22516 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:06.469313 20180 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:06.410693 22504 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:06.439814 20173 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:06.474723 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.476224 22559 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.476325 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.477633 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.478399 21039 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:06.433542 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.461544 22560 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.481485 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.486631 21042 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:18:06.487313 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.489871 21043 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:06.490074 21040 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:06.486819 21035 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:06.492321 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.494803 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2495) took 1797 ms. Trace:
I20260709 12:18:06.495239 20327 rpcz_store.cc:276] 0709 12:18:04.697734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.698008 (+   274us) service_pool.cc:224] Handling call
0709 12:18:06.027039 (+1329031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.185785 (+158746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.494615 (+308830us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540000ffd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:06.494744 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043654912}
I20260709 12:18:06.504197 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.503172 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.541920 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.547884 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.548789 21040 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:06.549525 22518 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:06.550108 22518 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:06.556531 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.561951 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 379051us
W20260709 12:18:06.565934 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 359794us
I20260709 12:18:06.582015 22536 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.582760 22536 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.583326 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:06.584815 22557 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:06.585518 22557 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.585947 22557 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:06.586346 22536 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:06.603456 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:06.598275 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:06.604681 22536 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:06.605885 20249 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:06.606666 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:06.607474 22536 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:06.607998 22536 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.608114 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.608386 22536 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.608934 20249 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:06.611857 22384 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:06.614500 22384 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:06.615643 22458 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:06.616153 22458 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:06.617195 22458 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.618602 22458 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.625171 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:06.626478 22442 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:06.626996 22442 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:06.627491 22442 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.627779 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:06.636206 20248 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:06.640890 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:06.643390 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.644906 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.645797 20253 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:06.648684 20248 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:06.659821 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.663735 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:06.659425 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:06.666296 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:06.640794 22518 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.668202 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:06.674978 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 322) took 1397 ms. Trace:
I20260709 12:18:06.665566 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:06.675621 21043 rpcz_store.cc:276] 0709 12:18:05.277721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.277864 (+   143us) service_pool.cc:224] Handling call
0709 12:18:06.674721 (+1396857us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540047b654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:06.674886 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409134464}
I20260709 12:18:06.681285 22384 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:06.682829 22384 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:06.683195 22384 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:06.638476 22608 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:18:06.684492 22384 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.642270 22536 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.684444 22557 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.687222 22384 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.687744 22536 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.691326 22519 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.667270 22541 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:06.691699 22557 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:06.642643 22607 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:06.675976 22524 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:06.677623 22511 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:06.688920 22504 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:06.693837 22522 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:06.693080 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:06.700749 20144 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.010s	sys 0.028s
W20260709 12:18:06.724858 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.698004 22524 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:06.756608 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.757108 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64191.5us
I20260709 12:18:06.705569 21036 raft_consensus.cc:2410] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:06.765311 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:06.757663 20144 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.011s	sys 0.028s
W20260709 12:18:06.760809 20323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.017s	sys 0.020s
W20260709 12:18:06.766547 20323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.018s	sys 0.020s
I20260709 12:18:06.702872 22541 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:06.771189 22573 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:06.773702 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:06.773979 22573 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.774336 22573 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.774410 20253 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:06.769928 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:06.704677 22497 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:06.777199 22497 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.771127 22504 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:06.780089 22504 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.782238 22504 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.783311 22504 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:18:06.787036 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 391931us
I20260709 12:18:06.787194 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:06.766391 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 1.0238e+06us
I20260709 12:18:06.789750 20327 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:06.762846 22524 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:06.789748 20325 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:06.791280 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.791406 22612 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:06.764143 22589 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:06.764361 22448 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:06.763233 22609 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:06.726011 22564 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:18:06.760607 22608 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:06.797914 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:06.705408 22581 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:18:06.809696 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:06.813830 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.800136 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.801749 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:06.826023 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.827023 20173 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:18:06.831322 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.819105 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:06.796116 22504 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:06.837438 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:06.833989 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:06.838937 21041 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:06.835532 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.799926 22546 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.840524 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.839224 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.871927 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.872934 20329 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:06.792763 22533 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:06.799077 22448 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:06.837698 22132 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:06.888475 22132 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:06.888127 22448 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.889750 22448 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.889551 22132 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:06.890964 22616 raft_consensus.cc:1064] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:18:06.891806 22618 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:06.892241 22618 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:06.893105 22618 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:06.894141 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.894994 21043 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.875105 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.875228 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.908083 20328 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:06.875325 22593 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:18:06.908509 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.908990 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.870586 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.872272 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:06.877597 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:06.910751 20175 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.911149 20326 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:06.877767 20253 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.878315 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.879208 20330 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:06.880903 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.802196 22609 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:06.863704 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:06.914628 20325 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 3: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:06.921226 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:06.800834 22607 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:06.923812 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:06.927944 20249 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.926973 20329 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:18:06.929625 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.930542 20329 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:06.932126 20328 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:06.932613 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69084.1us
I20260709 12:18:06.933234 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:06.933323 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:06.934039 21041 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.935148 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.936332 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.937155 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:06.984915 20252 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.921970 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:06.986418 20248 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:06.964588 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.931834 22581 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:06.837101 22528 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:06.839948 22580 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:06.833452 22415 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.970593 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.971335 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.808470 22560 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 12:18:06.932204 22595 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:06.834708 22559 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.972488 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.926061 22609 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:06.997853 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.983520 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:06.968286 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:07.044312 20326 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:07.045560 20178 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:06.817862 22493 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 12:18:07.043787 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:07.029399 22581 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.057053 21043 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:06.913311 22546 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.050446 20322 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:18:07.098326 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54783.6us
I20260709 12:18:06.970381 22593 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:07.097189 20220 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.016s	sys 0.027s
I20260709 12:18:06.870136 22541 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:07.105357 20220 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.016s	sys 0.027s
W20260709 12:18:07.105850 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 541918us
I20260709 12:18:07.050946 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:07.047780 22580 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.115865 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.113211 20252 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:06.970654 22564 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:07.117092 20179 raft_consensus.cc:2410] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:07.120666 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:07.121850 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 339177us
I20260709 12:18:07.118021 20175 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:06.968796 22533 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:06.997143 22613 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:07.028921 22511 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.124399 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.098526 21035 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.101135 22536 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.139895 20322 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:18:07.146838 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.147982 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.138556 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.155800 20328 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:07.050796 22559 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.158901 22559 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.137820 22533 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.160463 22511 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.161872 22533 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.162701 22511 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.163580 22536 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.165861 22536 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.138204 22560 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.167382 22560 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.167713 22546 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.169442 22560 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.118978 22580 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.170861 22498 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:07.171041 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:07.173040 22581 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.173903 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.177577 22613 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:07.178596 22613 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.171244 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:06.982589 22607 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.160041 22566 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:07.181524 20253 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:06.975309 22519 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 12:18:07.185218 20248 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:07.185623 21041 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:07.138486 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.188141 20327 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:07.189213 20178 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:07.060071 22528 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:07.171311 22498 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:06.998688 22518 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:18:06.998085 22557 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 12:18:07.201793 20249 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:07.228981 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:07.141907 22442 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.514s	user 0.016s	sys 0.000s
I20260709 12:18:07.218706 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.230044 20176 raft_consensus.cc:2368] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:18:07.097901 22595 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.179539 22589 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:07.135918 22621 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:07.113981 22415 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.241323 22415 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:07.231700 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.201010 22458 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.231927 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:07.228214 22522 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.001s
I20260709 12:18:07.233228 22442 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.234125 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.234831 22497 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:07.237119 22498 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.200179 22593 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:07.199718 22566 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:07.202970 22612 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:07.255051 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 328) took 1695 ms. Trace:
I20260709 12:18:07.125028 22564 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.257228 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.258302 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.259698 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.260504 20175 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:07.263207 20328 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.264402 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:07.243048 22621 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.242264 22589 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:07.254805 22522 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:07.282703 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.284338 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.278573 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:07.260296 20323 rpcz_store.cc:276] 0709 12:18:05.559721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.892080 (+332359us) service_pool.cc:224] Handling call
0709 12:18:05.892565 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.892849 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:06.769124 (+876275us) log.cc:844] Serialized 14 byte log entry
0709 12:18:07.254681 (+485557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.254741 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:07.254784 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.254867 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.254986 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64685,"prepare.queue_time_us":1010916,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":66927,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5910,"thread_start_us":1293899,"threads_started":2,"wal-append.queue_time_us":492886}
I20260709 12:18:07.292128 22593 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:07.291234 22566 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.298329 22607 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.299716 22595 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:07.300042 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.256953 22512 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:07.302987 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:07.265447 22608 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.266902 22546 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.300428 22528 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.325230 22580 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.326570 22566 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.310564 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:07.281275 22498 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.204140 22504 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.254257 22458 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.308522 22522 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:07.316298 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:07.316632 22589 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.310555 22607 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:07.310420 22557 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.319985 22616 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:07.322480 22524 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
W20260709 12:18:07.335187 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.344982 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:07.372900 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57492.4us
I20260709 12:18:07.374523 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.285909 22621 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.265350 22612 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:07.358724 22573 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 12:18:07.346593 22516 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:07.391494 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.331113 22442 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.327484 22580 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.385284 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.329609 22564 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.387316 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.404853 20253 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:07.402330 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 176698us
W20260709 12:18:07.407181 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.408667 20175 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:07.377228 22517 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:07.412799 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.413669 20175 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:07.389724 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.390407 20328 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:07.390455 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:07.414992 20247 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.330878 22519 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:07.393131 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.398422 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:07.400622 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:07.419070 20255 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:07.415051 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:07.419539 21038 raft_consensus.cc:2410] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:07.419896 21040 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.401849 22511 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.393004 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 291745us
I20260709 12:18:07.407071 22236 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.432010 20178 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:07.402609 20248 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:07.407193 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:07.388428 20323 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:07.410189 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.410549 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:07.435621 20326 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.435861 21039 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.377547 22518 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.410187 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:07.389008 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.437752 20252 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:07.437593 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:07.416118 21043 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:18:07.438208 21043 pending_rounds.cc:85] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 5
I20260709 12:18:07.438454 21043 pending_rounds.cc:107] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:07.438666 21043 raft_consensus.cc:2889] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:07.391702 22132 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.394521 22607 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:07.336241 22608 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.391777 22516 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:07.425073 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:07.449295 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.450723 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.451404 20173 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:07.455950 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.457132 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.457765 20174 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:07.395292 22573 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.418655 22519 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:07.426338 22415 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:07.371546 22557 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.402618 20171 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:07.485855 20247 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:07.429093 20175 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:07.409250 22442 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.418668 22448 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:18:07.383814 22524 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.445101 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:07.495826 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 89687.8us
I20260709 12:18:07.464983 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:07.473093 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:07.484488 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.393141 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.487706 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.502417 20178 raft_consensus.cc:2368] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4.
I20260709 12:18:07.447464 22618 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.492429 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.508716 21034 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:07.509336 20174 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:07.488795 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:07.463757 21040 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:07.495080 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:07.510890 22573 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.511335 20179 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3.
I20260709 12:18:07.500638 20326 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:07.501688 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:07.447306 20251 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:07.511780 22634 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:07.513489 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:07.502595 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 136933us
I20260709 12:18:07.514009 22580 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:07.514235 20173 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:07.514577 22580 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:07.514750 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.488257 22415 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.495617 22631 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:07.515964 22631 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.515616 22580 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.516350 22631 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.517367 22415 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:07.508045 22636 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 12:18:07.514036 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:07.521037 20251 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.523671 22516 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.524935 22516 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.444011 22511 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.508193 21039 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:07.508297 22522 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:07.531236 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 66378.5us
I20260709 12:18:07.534626 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:07.530822 20294 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:07.537151 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:07.540340 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:07.540874 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.445924 22236 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.457831 22132 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.529809 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:07.447281 22518 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:07.550256 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.458948 22607 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.547351 22613 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:07.547672 22530 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:07.547421 22634 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:07.484611 22635 consensus_queue.cc:1175] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260709 12:18:07.543201 22415 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:07.545329 22593 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.493664 22442 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:07.579742 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 158448us
I20260709 12:18:07.568192 22504 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:07.550063 22638 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:07.584103 21036 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:07.593937 22608 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.594493 22442 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.591013 22593 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:07.596966 22593 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:07.597725 22626 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.284s	user 0.001s	sys 0.001s
I20260709 12:18:07.568917 22634 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.571933 22613 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:07.583531 22415 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:07.625772 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.628144 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 113475us
I20260709 12:18:07.569111 22493 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:18:07.633249 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:07.573148 22560 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:18:07.637676 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:07.600860 22458 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.623492 22634 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.642604 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.623299 22608 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.646414 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81099.8us
I20260709 12:18:07.647630 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:07.647538 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.648873 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.634577 22415 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:07.640725 22650 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:18:07.654428 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:07.654940 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:07.657655 20249 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.570731 22519 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.626073 22612 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.640276 22566 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.641950 22504 raft_consensus.cc:2764] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:18:07.653448 22641 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:18:07.666684 22132 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.656629 22638 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:07.668721 22529 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:07.669358 22529 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.669929 22529 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.666769 22511 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.619694 22609 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.659911 22493 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:07.656388 22458 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:07.685103 20294 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.881s (SENT) [suppressed 47 similar messages]
I20260709 12:18:07.690284 22613 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.692631 22557 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.693445 21035 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:07.694255 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.696177 22546 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:07.697405 22493 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:07.696538 22518 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.700054 22648 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:07.665040 22566 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.684927 22504 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:07.700672 20251 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:07.703540 22533 raft_consensus.cc:2764] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:18:07.702989 20247 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:07.706955 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.710047 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:07.709117 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:07.710404 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.708755 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.720582 20323 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.707911 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:07.712937 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.717445 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:07.655422 22608 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.737550 20252 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:07.735884 20321 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:07.731753 22512 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:07.741379 22512 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.741971 22608 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:07.742578 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.743693 22546 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:07.704459 22493 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.705876 22524 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.745214 22493 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.705720 22648 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:07.746522 22648 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.708741 22609 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.744333 22546 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:07.707108 22607 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.711520 22619 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.753335 22619 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.754779 22519 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:07.756433 22619 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.757608 21042 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:07.756951 22546 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.759894 22384 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:07.760411 22384 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:07.738050 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:07.764021 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:07.765117 20247 raft_consensus.cc:2410] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:07.767052 20248 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:07.768246 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.714547 22625 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.386s	user 0.002s	sys 0.000s
I20260709 12:18:07.712782 22442 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:07.710860 22566 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.779021 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:07.784034 20325 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:07.712399 22631 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.831691 22541 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:07.743443 22512 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.888655 22529 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:07.892338 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.705753 22621 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.969071 22621 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.773813 22609 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.971200 22609 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:07.976085 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.785257 22564 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:07.979883 22564 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.980451 22564 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:07.980580 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.981077 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.982681 20322 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:07.982810 22657 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:07.983218 22657 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:07.984092 22657 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:07.985344 22657 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.829957 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:07.775929 22608 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:07.986001 22608 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.869880 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:07.761809 22516 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.847329 22384 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:07.907855 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 249799us
I20260709 12:18:07.991283 22516 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.991528 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:07.993005 22504 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:07.993654 22516 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.817677 20249 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
W20260709 12:18:07.851241 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 203700us
I20260709 12:18:07.994385 22504 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:07.915791 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:07.996852 22660 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:07.997684 22560 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:07.997730 22660 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:07.999161 22660 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:07.999500 22660 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:07.999666 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:07.999925 22530 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:08.000702 22530 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:08.000998 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.001336 22595 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:08.000882 22660 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.001765 22595 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:08.001919 22654 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.002449 20220 leader_election.cc:400] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5.
I20260709 12:18:08.002794 20220 leader_election.cc:403] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:07.888640 22634 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.003381 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.003647 22635 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5.
I20260709 12:18:08.004091 20326 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:08.004187 22654 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.001174 22384 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:08.005330 22634 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.999632 22560 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:08.006726 22560 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:07.991374 22589 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.007335 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:08.007544 22560 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:08.008744 22560 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.999745 22442 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:08.012342 22442 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:08.012668 22442 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:08.013007 22442 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.006698 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.016458 22654 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:08.017655 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:07.925086 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56967us
W20260709 12:18:07.938599 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.940474 21036 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:07.938927 22668 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.943120 22629 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.623s	user 0.003s	sys 0.000s
I20260709 12:18:07.946262 22631 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:07.951704 22533 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:07.959403 22236 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:07.962395 22415 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:07.964874 22529 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:07.986392 22608 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:08.002672 22595 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.024302 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.024909 22654 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:08.048413 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.049225 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.052210 22595 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.055856 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.056478 20250 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:08.058187 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.058347 22529 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:08.059069 22668 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.059070 20250 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:08.061717 22668 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:08.070385 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46198.3us
I20260709 12:18:08.070986 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.071269 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:08.072032 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.021214 21035 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:18:08.002672 22660 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.072978 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.036209 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:08.036818 20249 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:08.092188 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56086.3us
I20260709 12:18:08.040385 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.093225 20326 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.041718 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.043664 20323 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:08.042464 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.045279 22533 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.030195 22609 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.081946 20253 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:08.097683 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.098713 20253 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:08.083966 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:08.087493 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.099550 21038 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:08.088385 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:08.100374 21042 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:08.090236 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.101413 20254 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:08.104182 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.105332 20251 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:08.096787 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.106647 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.107295 20249 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:08.109036 20247 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:08.107447 20256 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:08.089107 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:08.093343 20252 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:08.075788 22631 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:08.042410 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.095786 20248 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:08.115170 20255 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.114979 22631 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.091310 22559 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:18:08.117691 22631 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:08.119869 22654 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.124207 20255 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:08.088176 22530 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:08.128145 22448 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:08.128811 22448 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:08.129974 22448 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:08.133317 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44338.6us
I20260709 12:18:08.070152 22516 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:08.138326 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.139037 20255 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:08.139290 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:08.140523 22668 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:08.141685 22668 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:08.142098 22668 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:08.141865 22564 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.143262 22668 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.144606 22668 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.140005 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:08.146904 22530 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:08.107792 22621 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:08.092165 22415 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.150007 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.152658 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:08.161466 20255 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.162493 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:08.163080 21038 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:08.149092 22559 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:08.158654 20172 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:08.165167 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.165367 20256 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:08.159359 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.166422 20252 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:08.160274 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.168051 20180 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:08.111644 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:08.160435 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:08.147527 22530 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:08.165804 20173 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:08.173007 20255 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:08.173919 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.113608 22634 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:08.175288 20179 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:08.175963 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.180555 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:08.181352 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:08.191752 20177 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:08.192307 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:08.185938 20176 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:08.188416 20174 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:08.196118 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.197441 20252 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:08.199317 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:08.200268 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.199074 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.201413 20252 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:08.211836 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 62497.1us
I20260709 12:18:08.215988 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:08.217660 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.165045 22609 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.220249 20172 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.177702 22384 raft_consensus.cc:2764] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:08.229367 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.240562 20247 raft_consensus.cc:1813] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Handling vote request from an unknown peer f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:08.241174 20247 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:18:08.241014 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.240571 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.241907 20174 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:08.242445 20171 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:08.239275 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:08.200716 22622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.035s	sys 0.033s
I20260709 12:18:08.242285 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:08.245615 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.246315 20254 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:08.233413 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.247529 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:08.251014 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.251363 20252 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:18:08.251834 20252 pending_rounds.cc:85] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 5
I20260709 12:18:08.243057 20255 raft_consensus.cc:2376] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3. Re-sending same reply.
I20260709 12:18:08.243801 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.197736 22415 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:08.174010 22529 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:18:08.251626 20254 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:08.203788 22504 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:08.259236 22609 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.255115 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:08.212118 22581 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.203653 22616 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:08.305565 22616 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:08.305605 22581 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.306800 22616 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.173671 22589 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:18:08.308668 22581 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:08.196532 21036 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:08.179620 22654 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:18:08.280444 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:08.236393 22560 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:08.266450 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:08.213711 22493 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:08.196201 22644 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:18:08.211952 22559 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:08.280992 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.317818 22609 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.220568 22621 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:08.281394 20294 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:08.221664 22627 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:08.239207 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.277848 22564 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:08.266249 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.336249 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.337388 20255 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:18:08.338792 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.339906 20250 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:08.296787 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.300246 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.253379 20252 pending_rounds.cc:107] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:08.311512 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.341974 20321 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:08.301399 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.270732 22557 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:08.271018 21035 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:08.317901 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 62894.6us
I20260709 12:18:08.319089 22529 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:08.309878 22634 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.264331 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 194972us
I20260709 12:18:08.242818 22511 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:18:08.328469 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47187.5us
I20260709 12:18:08.328397 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:08.257687 22622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.035s	sys 0.034s
I20260709 12:18:08.272200 22415 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:08.312119 21041 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.343506 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:08.341321 20252 raft_consensus.cc:2889] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.380765 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:08.345137 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:08.347834 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:08.382308 21039 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:08.325182 21034 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:08.361586 20254 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.389444 20327 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:08.392531 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.393162 20247 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:08.394320 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:08.395639 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.396386 20253 raft_consensus.cc:2376] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5. Re-sending same reply.
I20260709 12:18:08.361788 21043 raft_consensus.cc:1813] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Handling vote request from an unknown peer f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:08.324369 22560 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:08.365073 21040 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:08.368742 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:08.377025 20250 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:08.492319 20250 pending_rounds.cc:85] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 6
I20260709 12:18:08.492702 20250 pending_rounds.cc:107] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.7
I20260709 12:18:08.493053 20250 raft_consensus.cc:2917] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Aborting config change with OpId 5.7: Aborted: Op aborted by new leader
I20260709 12:18:08.493606 20250 raft_consensus.cc:2889] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.383669 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.494494 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.384210 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.495242 20322 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:08.384352 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.385553 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:08.385712 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.386258 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.401221 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.407639 21043 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:18:08.343021 22627 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:08.352104 22533 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:08.316071 22442 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:08.477054 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 87030.5us
I20260709 12:18:08.345474 22536 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:08.356155 22557 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.513181 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:08.478466 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:08.360065 20251 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:08.323546 22608 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.482038 20253 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:08.520658 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:08.499816 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 98704.5us
I20260709 12:18:08.500918 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.503648 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:08.521678 20324 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:08.523602 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:08.503947 20247 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:08.504528 20321 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:08.504990 20220 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.683s (SENT)
I20260709 12:18:08.326395 22559 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.508311 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.509262 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.529999 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.410820 22581 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:08.477737 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:08.504195 22631 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:08.504927 22493 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:08.477998 22609 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.547490 20330 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:08.374151 22634 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.527679 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.560336 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.529132 20324 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:18:08.535195 20256 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:08.536487 20249 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:08.501801 22529 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:08.537438 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:08.568702 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.568887 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.569571 20180 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:08.537495 20253 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:08.539139 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.541934 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:08.331399 22530 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.480896 22589 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:18:08.513616 22648 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.517426 22557 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.544471 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:08.588183 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50834.7us
I20260709 12:18:08.593255 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.594033 20180 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:08.525491 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:08.528148 22536 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:08.574950 20176 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:08.535920 22581 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.573201 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.572640 20328 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
W20260709 12:18:08.581502 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 181907us
I20260709 12:18:08.541589 22631 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:08.634711 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.633394 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.639817 20180 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:08.641194 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.642086 20180 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:08.644433 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.645131 20176 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:08.645834 20325 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:08.519366 22621 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:08.570358 22682 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:08.592671 22516 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:08.679838 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:08.650239 22664 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
I20260709 12:18:08.646133 22631 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:08.677264 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.689316 20174 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:08.691330 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.692812 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.693753 20174 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:08.694757 22681 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:18:08.696146 22674 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
W20260709 12:18:08.700152 22678 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:18:08.701218 22536 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.573446 22668 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:18:08.707158 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.645251 22564 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:08.599994 22648 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.684341 22516 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:08.686193 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.680666 20173 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:08.703814 22672 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
I20260709 12:18:08.707933 20174 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:08.725780 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.726508 20174 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:08.705549 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 201987us
I20260709 12:18:08.716087 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:08.728463 20173 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:08.735244 22648 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.719501 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.723758 22384 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.579742 22415 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:08.710098 22657 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:08.742055 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.632653 22627 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:08.749351 20174 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:08.753587 20174 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:18:08.753907 20174 pending_rounds.cc:85] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 2
I20260709 12:18:08.754240 20174 pending_rounds.cc:107] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:08.754503 20174 raft_consensus.cc:2889] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.755080 20173 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:08.742743 20177 raft_consensus.cc:2410] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:08.717322 22516 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.751296 20176 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
W20260709 12:18:08.743631 22595 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.691s	user 0.004s	sys 0.007s
I20260709 12:18:08.758776 20176 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.596699 22560 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:08.646824 22581 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:08.682551 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:08.709108 22593 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:18:08.762976 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 173139us
W20260709 12:18:08.814536 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.814005 20175 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:18:08.819794 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 294377us
I20260709 12:18:08.820425 20177 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:08.709654 22493 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:08.828111 20248 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.830416 20179 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:08.758433 22529 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:08.824390 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 156683us
I20260709 12:18:08.835099 20248 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:08.846524 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:08.745513 22686 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:18:08.765487 22589 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:08.860399 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 334887us
I20260709 12:18:08.750484 22384 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:08.867636 20220 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.781s (SENT)
I20260709 12:18:08.868048 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:08.869437 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:08.870820 20220 leader_election.cc:336] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.798s (SENT)
I20260709 12:18:08.871258 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:08.873950 20220 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.799s (SENT)
W20260709 12:18:08.876485 20220 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.829s (SENT)
I20260709 12:18:08.839875 22608 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:08.899062 22688 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:18:08.900226 22683 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:18:08.866351 21037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 737) took 1462 ms. Trace:
I20260709 12:18:08.903084 21037 rpcz_store.cc:276] 0709 12:18:07.400526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.413635 (+ 13109us) service_pool.cc:224] Handling call
0709 12:18:07.952897 (+539262us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:18:07.953112 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.159429 (+206317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:08.162124 (+  2695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:08.166548 (+  4424us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:08.180354 (+ 13806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.821757 (+641403us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400406fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:08.838382 (+ 16625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.862848 (+ 24466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448546560}
I20260709 12:18:08.908058 22619 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:08.870110 22644 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:08.912765 20220 leader_election.cc:336] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.843s (SENT)
I20260709 12:18:08.917716 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:08.918695 20143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.002s	sys 0.025s
I20260709 12:18:08.878549 22609 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:08.936168 21041 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:18:08.919143 20143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.002s	sys 0.025s
W20260709 12:18:08.919580 20220 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.969s (SENT)
W20260709 12:18:08.938558 20220 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.019s (SENT)
I20260709 12:18:08.892406 22442 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.938983 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:08.875056 22517 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:18:08.970348 22384 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.918957 22634 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:08.936501 22648 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:08.938585 21036 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:08.938491 22699 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.954577 22644 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.984790 22691 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:08.986652 22634 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:09.087693 21008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.018s	sys 0.024s
W20260709 12:18:09.092612 21008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.019s	sys 0.024s
W20260709 12:18:09.091768 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 362616us
W20260709 12:18:09.094131 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 570584us
I20260709 12:18:08.978060 22686 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 12:18:09.105306 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 235956us
I20260709 12:18:08.946497 22529 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.148590 21008 leader_election.cc:400] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4.
I20260709 12:18:09.085649 22648 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.087206 22698 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.987744 22699 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.157081 22644 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.198597 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:09.202988 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67130.5us
I20260709 12:18:09.204463 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.178436 22634 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.207724 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:09.207783 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.213829 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:09.158068 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 62998.4us
W20260709 12:18:09.156816 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 314675us
I20260709 12:18:09.214948 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.202805 22692 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:18:09.216238 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.216514 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.218325 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:09.215979 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 121601us
I20260709 12:18:09.221730 20248 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.191267 22698 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.226667 22698 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.227200 22708 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.227967 22708 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.230887 22708 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:09.233471 22703 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:09.203681 22589 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:09.190558 22700 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:18:09.255415 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.186245 22648 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:09.204697 22644 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.220010 22608 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:09.291977 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.260864 22593 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.264261 22691 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.215971 22634 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.227236 22698 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:18:09.302632 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 364080us
I20260709 12:18:09.291574 22708 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.292937 22608 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.320667 20220 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.046s (SENT)
W20260709 12:18:09.323819 20220 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.058s (SENT)
I20260709 12:18:09.324327 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.336822 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 123056us
I20260709 12:18:09.263363 22702 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 12:18:09.321158 20251 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.782s	user 0.015s	sys 0.004s
I20260709 12:18:09.305647 22697 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:09.354661 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.100s (SENT)
W20260709 12:18:09.359540 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 97816.2us
I20260709 12:18:09.360082 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.361503 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.226s (SENT)
I20260709 12:18:09.362013 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.318393 22691 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:09.306902 22593 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:09.320569 22710 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.368161 20248 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:09.366297 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:09.349928 22712 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:09.372138 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 155691us
I20260709 12:18:09.306608 22714 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:18:09.352478 22711 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.369199 22691 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:09.385319 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 130000us
I20260709 12:18:09.368052 22627 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.358004 20251 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:09.383955 21008 leader_election.cc:400] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3.
I20260709 12:18:09.396427 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.372615 22581 consensus_meta.cc:287] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 12:18:09.395244 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.370682 22384 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:09.372728 22593 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.364991 22715 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:09.372030 22716 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.354746 22608 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.385449 22700 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.480679 20250 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:09.383060 22712 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:09.423409 22702 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:09.426857 22709 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:09.433845 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1930) took 1045 ms. Trace:
I20260709 12:18:09.370621 22442 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:18:09.409613 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1335) took 1166 ms. Trace:
I20260709 12:18:09.386698 22589 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:09.443364 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48223.5us
W20260709 12:18:09.450820 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54496.9us
W20260709 12:18:09.440771 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 75661.3us
I20260709 12:18:09.477824 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:09.398926 22711 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.495164 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:09.495878 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.482424 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 116147us
I20260709 12:18:09.488440 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:09.474203 22660 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.386s	user 0.015s	sys 0.000s
I20260709 12:18:09.488618 20172 rpcz_store.cc:276] 0709 12:18:08.388334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.388501 (+   167us) service_pool.cc:224] Handling call
0709 12:18:08.388892 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:08.477043 (+ 88151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:08.477088 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.502795 (+ 25707us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.831740 (+328945us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:08.862849 (+ 31109us) log.cc:844] Serialized 14 byte log entry
0709 12:18:09.179267 (+316418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.179364 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.433614 (+254250us) raft_consensus.cc:1685] finished
0709 12:18:09.433638 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.433779 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5327,"prepare.queue_time_us":30830,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":370710,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":46378,"thread_start_us":634429,"threads_started":2,"wal-append.queue_time_us":478699}
I20260709 12:18:09.497340 20255 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:09.498184 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:09.488106 22699 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:09.484699 22609 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.521227 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.488618 22712 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.479516 22705 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:09.520490 20178 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:18:09.520628 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:09.484316 22730 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.490020 22686 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.456979 22581 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.523494 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.500083 22516 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.005s
I20260709 12:18:09.521466 22609 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.497664 22727 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:09.529433 22608 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.525801 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:09.550784 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.523782 22644 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:09.535382 22631 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.003s
I20260709 12:18:09.501220 22697 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:18:09.534648 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:09.577590 20326 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:09.533768 22716 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.551715 22609 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.534003 22634 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:09.544639 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:09.594084 22634 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.526383 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.594467 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49900.5us
I20260709 12:18:09.540942 22711 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.491330 20251 rpcz_store.cc:276] 0709 12:18:08.243266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.245317 (+  2051us) service_pool.cc:224] Handling call
0709 12:18:09.401429 (+1156112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.565438 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:09.600070 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:09.598956 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:09.600430 20330 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:09.600701 20326 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.565806 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:09.601341 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:09.533833 20178 pending_rounds.cc:85] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 4
I20260709 12:18:09.536023 22713 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:09.563719 22715 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:09.560500 22735 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.602855 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:09.603129 22735 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:09.603482 22715 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:09.604254 22735 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.604557 22715 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:09.583240 22564 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.001s
I20260709 12:18:09.553006 22736 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:09.543257 22730 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:09.560451 22557 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.912s	user 0.006s	sys 0.008s
I20260709 12:18:09.586598 22581 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.551429 22516 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.588425 22631 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.549940 22686 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.592144 22727 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.594103 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 43478.4us
I20260709 12:18:09.622813 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:09.623705 22687 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.927s	user 0.001s	sys 0.006s
I20260709 12:18:09.624167 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:09.523437 22698 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:09.595278 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68942.3us
I20260709 12:18:09.595408 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.596717 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:09.599721 22608 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:09.563669 22705 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:09.599870 22716 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.602123 20178 pending_rounds.cc:107] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:18:09.610592 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:09.608739 22693 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.698s	user 0.001s	sys 0.000s
I20260709 12:18:09.594640 22634 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.626237 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.633724 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:09.635802 22644 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.636301 22644 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:09.636777 22644 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.619534 20326 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:09.620563 22498 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:09.641358 22727 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.617578 22560 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:18:09.620782 22707 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.629597 20178 raft_consensus.cc:2889] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:09.630944 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.641479 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:09.642441 22498 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:09.618898 22564 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.627734 22733 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.643004 22442 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.627296 22504 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:09.545351 22448 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.641902 22621 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.635202 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.620760 22724 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.620024 22730 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.647874 22581 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.653625 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1375) took 1261 ms. Trace:
I20260709 12:18:09.625900 22686 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.693059 20327 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:09.654359 22711 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:09.701030 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:09.654564 22727 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.704885 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:09.625795 22557 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.626521 22713 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:09.658062 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:09.728628 20326 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:09.658985 22660 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.681298 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46178.9us
I20260709 12:18:09.696053 22581 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.665144 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:09.646519 22698 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:09.643975 22516 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:09.683893 22716 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.686017 22726 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.686292 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:09.687155 22648 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.687660 22696 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:09.687793 21039 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:09.640084 22608 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:09.729980 22734 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.643782 22705 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.650170 22631 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:09.655289 22668 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.707175 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:09.645932 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:09.746757 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 100931us
I20260709 12:18:09.659811 22707 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.701802 20172 raft_consensus.cc:2376] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4. Re-sending same reply.
I20260709 12:18:09.710094 22529 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:09.709647 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:09.708025 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:09.754693 20171 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.754850 20176 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.632565 22593 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.720676 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:09.710541 22682 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.661410 22504 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:09.678850 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:09.734117 22660 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.730998 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.731081 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:09.639861 22634 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.734154 21042 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:09.724763 22498 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.633175 22736 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:09.696493 22621 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:09.684391 22714 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:18:09.736340 20322 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:09.725098 22564 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:09.734524 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:09.692203 20325 rpcz_store.cc:276] 0709 12:18:08.392254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.527442 (+135188us) service_pool.cc:224] Handling call
0709 12:18:08.548071 (+ 20629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.646425 (+ 98354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.653359 (+1006934us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b54000870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:09.653560 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199587584}
I20260709 12:18:09.735644 22581 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:09.749761 20144 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.530s (SENT)
W20260709 12:18:09.820938 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 71224.1us
I20260709 12:18:09.732398 22727 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:09.747763 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:09.735374 22699 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:09.828719 20325 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:09.759532 20175 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:09.829532 20330 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:09.659286 22697 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.745051 22608 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:09.830129 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82482.8us
I20260709 12:18:09.831264 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:09.796375 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:09.800329 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69346.9us
I20260709 12:18:09.801771 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:09.766268 22716 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.806953 22648 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:09.807394 22631 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.754026 22734 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.751585 22733 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.854185 22742 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:09.817889 20176 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:09.754544 22707 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.764115 22682 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:09.826119 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 91684.6us
I20260709 12:18:09.827648 22613 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.757627 21034 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:09.805707 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74792.2us
I20260709 12:18:09.795979 22516 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.836194 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.212260 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:09.842249 21042 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:09.843741 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:09.846577 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:10.214545 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:10.215054 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 368536us
I20260709 12:18:09.848966 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.215961 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:09.848593 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:10.215116 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 371459us
I20260709 12:18:09.853330 22384 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:10.218204 22516 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.856855 21039 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:09.858007 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.219722 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.220381 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:09.743172 22691 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.756165 22668 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.869256 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.230028 20256 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:09.871580 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:09.759564 22529 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:10.165216 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.018s	sys 0.089s
I20260709 12:18:09.837162 22727 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:10.239840 22442 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.003s
I20260709 12:18:10.240480 22442 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.241343 22442 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:10.241956 22442 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:09.849243 22589 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.892935 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:10.149346 20296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.009s	sys 0.024s
I20260709 12:18:10.242833 22589 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:10.243227 20296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.011s	sys 0.025s
W20260709 12:18:10.239861 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.019s	sys 0.090s
I20260709 12:18:10.245764 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:10.245503 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 373300us
I20260709 12:18:09.843765 22699 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.868192 22504 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:09.764541 22696 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.080605 22648 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:09.874109 22734 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:09.826773 22564 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.851747 22713 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
W20260709 12:18:09.939050 22692 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:18:10.243338 22589 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.225073 22705 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:09.899513 22621 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.835249 22700 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.852514 22716 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:09.903116 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.200022 20177 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:10.150101 22711 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:10.205197 22707 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.199146 20171 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:10.219851 20253 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:09.824409 22627 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.215186 21042 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:10.234414 22691 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.234510 22516 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.223855 22686 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:10.223593 22384 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:10.236771 20330 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:10.243047 21035 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:09.856413 22236 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:10.168690 22704 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.005s	sys 0.031s
I20260709 12:18:10.271063 22557 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.246542 20325 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:10.218959 22736 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.239010 22581 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.352813 22705 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:10.352711 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:10.373039 22704 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.005s	sys 0.033s
I20260709 12:18:10.264038 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:10.259292 22660 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.392958 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.354246 22504 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.336352 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.276021 22742 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.361210 22384 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:10.216764 22613 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.394270 20253 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:10.401255 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:10.243034 22442 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:10.394392 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 130451us
I20260709 12:18:10.327140 22648 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.326521 22740 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:18:10.355413 22627 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.387305 22700 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:10.372820 22686 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.390822 22529 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.375038 22236 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.403842 22593 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.332556 22710 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:18:10.421845 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.432870 20254 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:10.376044 22746 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:18:10.423790 20325 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:10.424199 22699 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.426093 22686 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.417141 22736 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.438746 22736 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.423491 22564 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.399314 22682 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.428006 21035 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:10.432888 20253 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:10.428061 22384 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:10.445744 22755 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:10.445887 22627 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.446519 22627 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:10.455921 22750 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 12:18:10.460032 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 244139us
I20260709 12:18:10.406025 22742 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.468816 22742 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.469551 22742 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:10.476619 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.477569 20253 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:10.445922 22236 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:10.463449 22609 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.006s
W20260709 12:18:10.463927 22730 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.737s	user 0.015s	sys 0.000s
W20260709 12:18:10.463109 22644 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.826s	user 0.014s	sys 0.004s
W20260709 12:18:10.463590 22634 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.002s
W20260709 12:18:10.465495 22712 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.928s	user 0.011s	sys 0.006s
I20260709 12:18:10.410313 22711 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.447166 22627 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:18:10.503607 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.480183 22682 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.507685 22613 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:10.511998 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 301546us
I20260709 12:18:10.512902 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:10.421006 22700 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.531456 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:10.465044 22705 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.550177 22686 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.527210 22564 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.497169 22730 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.496184 22609 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.550724 22686 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.503917 22644 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.506323 22634 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.505587 22712 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.566740 22699 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.632405 22699 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.627769 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.604637 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:10.628801 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:10.639297 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:10.643342 22608 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.778s	user 0.006s	sys 0.005s
I20260709 12:18:10.643972 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:10.644426 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:10.644753 21039 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.645615 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:10.646824 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:10.647953 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.650254 20250 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:10.643832 22608 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:10.609776 22751 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:18:10.534307 22746 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:18:10.609408 22673 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 2.264s	user 0.011s	sys 0.014s
I20260709 12:18:10.655992 21042 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:10.661193 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.543108 22710 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.548220 22581 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:10.666194 21038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 335) took 2439 ms (client timeout 1530 ms). Trace:
I20260709 12:18:10.566633 22714 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.564751 22758 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.589556 22759 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.650169 22700 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.668197 20253 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:10.668385 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:10.650633 22648 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.598095 22616 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.655632 22712 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.607671 22716 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.565052 22707 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.672787 21043 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:10.668205 21038 rpcz_store.cc:269] 0709 12:18:08.215439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.215622 (+   183us) service_pool.cc:224] Handling call
0709 12:18:10.655112 (+2439490us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540053b1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:10.655262 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2926160256}
I20260709 12:18:10.610302 22627 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.589735 22564 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.672442 22758 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.653126 22696 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.666023 22746 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:10.692744 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:10.674521 22770 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.701673 22634 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.696965 22758 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.697641 21038 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.708395 22564 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.679265 22736 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.706566 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.695990 21039 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:10.710757 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.717531 20250 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:10.732146 22752 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:18:10.734069 22686 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:10.734097 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 334) took 1029 ms. Trace:
I20260709 12:18:10.681143 22759 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.736312 20179 rpcz_store.cc:276] 0709 12:18:09.705078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.705201 (+   123us) service_pool.cc:224] Handling call
0709 12:18:09.705517 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.705885 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.705939 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.725593 (+ 19654us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.118968 (+393375us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:10.485260 (+366292us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.487549 (+  2289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.488394 (+   845us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.733876 (+245482us) raft_consensus.cc:1685] finished
0709 12:18:10.733899 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.734036 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":284646,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":6994,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":30648,"thread_start_us":662107,"threads_started":2,"wal-append.queue_time_us":637124}
I20260709 12:18:10.739542 22718 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:10.739964 22718 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:10.740610 22759 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.738713 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:10.740869 22718 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.741914 20250 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:10.742077 22718 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.748657 21038 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:10.750149 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:10.695601 22627 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:10.753579 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 344478us
I20260709 12:18:10.674228 22714 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:10.763372 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:10.772781 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:10.773162 22736 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.773707 22736 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.773739 22716 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.774160 22736 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.774214 22716 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.774633 22716 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:10.760514 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.775734 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.777961 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:10.792181 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.736631 22609 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:10.837116 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.847676 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.848333 21038 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:10.797603 22700 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.845861 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.829021 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2518) took 2316 ms. Trace:
I20260709 12:18:10.707127 22770 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.848870 22700 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.703711 22746 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:10.853446 20329 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:10.797891 22680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.111s	user 0.012s	sys 0.025s
I20260709 12:18:10.859098 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:10.849773 20173 rpcz_store.cc:276] 0709 12:18:08.512130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.755706 (+243576us) service_pool.cc:224] Handling call
0709 12:18:09.596800 (+841094us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:18:09.596994 (+   194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.598849 (+  1855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.598879 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.599398 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.813232 (+213834us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:10.148403 (+335171us) log.cc:844] Serialized 14 byte log entry
0709 12:18:10.197618 (+ 49215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.197730 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.794768 (+597038us) raft_consensus.cc:1685] finished
0709 12:18:10.828772 (+ 34004us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.828952 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1494,"prepare.queue_time_us":555355,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":4768,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5280,"spinlock_wait_cycles":3910400,"thread_start_us":506525,"threads_started":2,"wal-append.queue_time_us":615713}
I20260709 12:18:10.856196 22700 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.859930 20329 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.861508 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.862135 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:10.857072 22770 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.847417 22648 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:10.858953 22680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.174s	user 0.013s	sys 0.025s
I20260709 12:18:10.850422 22699 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.892817 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 336) took 2658 ms. Trace:
I20260709 12:18:10.893337 21040 rpcz_store.cc:276] 0709 12:18:08.218504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.223685 (+  5181us) service_pool.cc:224] Handling call
0709 12:18:08.364780 (+141095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:08.493104 (+128324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.876932 (+2383828us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54005b3950. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:10.877115 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323512064}
I20260709 12:18:10.871868 22608 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.900445 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:10.874156 22644 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:10.876902 22730 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:10.906054 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:10.915805 22504 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.506s	user 0.015s	sys 0.001s
I20260709 12:18:10.874799 22648 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:10.958149 22776 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
W20260709 12:18:10.949481 22589 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.003s
W20260709 12:18:11.018437 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 484380us
I20260709 12:18:11.021916 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:10.938743 22758 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:11.025131 20256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.048s
I20260709 12:18:11.061105 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:11.180964 20256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.022s	sys 0.053s
I20260709 12:18:11.162495 20329 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:18:11.099658 20252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.010s	sys 0.031s
W20260709 12:18:11.200446 20144 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.003s	sys 0.026s
W20260709 12:18:11.203505 20144 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.003s	sys 0.026s
W20260709 12:18:11.203874 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 651736us
W20260709 12:18:11.207281 20252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.010s	sys 0.034s
W20260709 12:18:11.209969 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 148972us
I20260709 12:18:11.211198 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:11.213702 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:11.214488 20179 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:11.216677 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:11.217684 20176 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:11.220364 20179 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:11.224031 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:11.227069 20330 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.228818 20324 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:11.219551 22714 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:11.237143 20173 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:11.203517 22536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.042s
I20260709 12:18:11.091722 22680 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:11.161639 22608 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.183868 22697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.023s	sys 0.028s
W20260709 12:18:11.160980 22747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.016s	sys 0.035s
I20260709 12:18:11.245620 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:11.211354 20221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.011s	sys 0.071s
I20260709 12:18:11.180388 22771 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:11.296089 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:11.297377 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 486) took 1397 ms. Trace:
I20260709 12:18:11.298754 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:11.245313 22536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.015s	sys 0.042s
W20260709 12:18:11.307113 20249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1337) took 3034 ms (client timeout 1906 ms). Trace:
I20260709 12:18:11.220214 22609 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:11.241778 22700 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:11.236894 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 751) took 1364 ms. Trace:
I20260709 12:18:11.025403 22712 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.271s
I20260709 12:18:11.024631 22589 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:11.092049 22765 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.254s
I20260709 12:18:11.307158 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:11.310799 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 464571us
W20260709 12:18:11.324487 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.330288 20330 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:11.250593 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 349) took 1651 ms. Trace:
I20260709 12:18:11.184661 22504 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:11.261161 22654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.893s	user 0.010s	sys 0.009s
I20260709 12:18:11.254686 22680 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:11.308692 22705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.014s
I20260709 12:18:11.245577 22716 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:11.025278 22730 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.236s
I20260709 12:18:11.243371 22764 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.300201 20329 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:12.300307 22654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.946s	user 0.010s	sys 0.010s
W20260709 12:18:11.325847 22559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.019s
I20260709 12:18:12.318931 22498 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.319324 22530 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:18:12.301385 22736 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.527s	user 0.011s	sys 0.005s
I20260709 12:18:12.308744 22783 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.417836 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 763) took 1754 ms. Trace:
W20260709 12:18:11.781301 20325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.004s	sys 0.027s
I20260709 12:18:12.299594 22770 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.344830 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:12.305667 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45849.1us
I20260709 12:18:12.281054 22560 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:12.319504 22559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.614s	user 0.011s	sys 0.019s
W20260709 12:18:12.322425 22705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.640s	user 0.009s	sys 0.014s
I20260709 12:18:12.325237 21043 rpcz_store.cc:276] 0709 12:18:09.663657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.663829 (+   172us) service_pool.cc:224] Handling call
0709 12:18:09.697983 (+ 34154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.689398 (+991415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.417518 (+728120us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54006734d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:11.417751 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241324928}
W20260709 12:18:12.326318 20325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.454s	user 0.017s	sys 0.038s
I20260709 12:18:12.326907 22716 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.341133 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1389) took 1115 ms. Trace:
I20260709 12:18:12.328123 22770 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.341638 20330 rpcz_store.cc:276] 0709 12:18:11.226204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.226555 (+   351us) service_pool.cc:224] Handling call
0709 12:18:11.226909 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.340376 (+1113467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.340852 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.342157 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:12.343698 20176 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
W20260709 12:18:11.645390 22735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.007s	sys 0.010s
W20260709 12:18:12.345753 22735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.452s	user 0.013s	sys 0.018s
I20260709 12:18:12.346042 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:12.329301 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1672) took 1097 ms. Trace:
I20260709 12:18:12.348850 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1386) took 1126 ms. Trace:
I20260709 12:18:12.347646 20252 rpcz_store.cc:276] 0709 12:18:09.900074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.191856 (+291782us) service_pool.cc:224] Handling call
0709 12:18:10.192244 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.192482 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:10.488822 (+296340us) log.cc:844] Serialized 14 byte log entry
0709 12:18:11.296861 (+808039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:11.296942 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:11.297009 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.297102 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.297287 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":358878,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":121586,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4792,"thread_start_us":1055233,"threads_started":2,"wal-append.queue_time_us":889303}
I20260709 12:18:12.349279 20329 rpcz_store.cc:276] 0709 12:18:11.222796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.295666 (+ 72870us) service_pool.cc:224] Handling call
0709 12:18:12.348740 (+1053074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.350061 22504 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:12.352576 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 1.05374e+06us
I20260709 12:18:12.353945 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:12.356160 22536 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:12.356666 22536 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.357059 22536 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:12.344990 20254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 485) took 2440 ms (client timeout 1929 ms). Trace:
I20260709 12:18:12.323307 22680 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.322705 22736 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.331889 22771 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.347288 20255 rpcz_store.cc:276] 0709 12:18:11.232221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.344465 (+112244us) service_pool.cc:224] Handling call
0709 12:18:12.329061 (+984596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.351286 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:11.853955 21039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.006s	sys 0.035s
W20260709 12:18:11.759195 20321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.158s	user 0.012s	sys 0.074s
W20260709 12:18:11.738243 20250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.002s	sys 0.010s
W20260709 12:18:11.715035 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.363906 20254 rpcz_store.cc:269] 0709 12:18:09.871087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.871245 (+   158us) service_pool.cc:224] Handling call
0709 12:18:12.310994 (+2439749us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000d9654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.311417 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462093184}
W20260709 12:18:12.401281 20321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.801s	user 0.016s	sys 0.086s
I20260709 12:18:11.381940 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 351) took 1559 ms. Trace:
W20260709 12:18:12.402959 20250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.659s	user 0.019s	sys 0.022s
W20260709 12:18:12.400964 21039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.010s	sys 0.055s
I20260709 12:18:12.367951 22770 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:11.434512 22769 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:18:12.371400 22730 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:11.832245 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:11.711320 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:11.481220 22773 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:18:12.332285 22700 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:11.447160 22442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.006s	sys 0.012s
I20260709 12:18:11.415179 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 749) took 3035 ms. Trace:
I20260709 12:18:12.416831 22609 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.418362 22771 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:12.419106 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 65457.2us
I20260709 12:18:12.418844 22608 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:12.414745 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.261133 22777 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:11.941256 22528 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:12.331557 20249 rpcz_store.cc:269] 0709 12:18:08.261509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.294781 (+ 33272us) service_pool.cc:224] Handling call
0709 12:18:11.254363 (+2959582us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002fd854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:11.296149 (+ 41786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448625408}
I20260709 12:18:12.421697 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1390) took 1183 ms. Trace:
I20260709 12:18:12.409312 21042 rpcz_store.cc:276] 0709 12:18:09.822471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.340137 (+517666us) service_pool.cc:224] Handling call
0709 12:18:10.655790 (+315653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.658729 (+  2939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.381664 (+722935us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540053b1d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:11.381837 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724939648}
I20260709 12:18:12.428076 20329 rpcz_store.cc:276] 0709 12:18:11.230095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.350635 (+1120540us) service_pool.cc:224] Handling call
0709 12:18:12.413517 (+ 62882us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:11.623670 22718 consensus_meta.cc:287] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.881s	user 0.016s	sys 0.000s
W20260709 12:18:11.327632 22621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.002s	sys 0.027s
W20260709 12:18:12.426669 22442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.722s	user 0.009s	sys 0.042s
I20260709 12:18:12.433611 21041 rpcz_store.cc:276] 0709 12:18:08.379520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.379658 (+   138us) service_pool.cc:224] Handling call
0709 12:18:08.519737 (+140079us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:18:08.519989 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:08.936696 (+416707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.414826 (+2478130us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400209c54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:11.415100 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980554240}
I20260709 12:18:12.325031 22783 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.333593 22560 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:11.330993 22768 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.435714 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:12.425598 22700 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:12.443172 22697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.824s	user 0.042s	sys 0.052s
I20260709 12:18:12.443944 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.444271 21040 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:12.448887 22608 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:12.443158 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 774) took 1645 ms. Trace:
I20260709 12:18:12.426880 22504 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:12.450529 20327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 363) took 2862 ms (client timeout 2022 ms). Trace:
I20260709 12:18:11.569902 22627 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.451848 20173 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.452440 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:12.453832 22715 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.454998 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:12.456393 22736 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.459395 21041 rpcz_store.cc:276] 0709 12:18:10.797562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.435194 (+1637632us) service_pool.cc:224] Handling call
0709 12:18:12.443035 (+  7841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:11.406764 22648 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.451107 22609 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.442395 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:12.464447 20175 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:12.466733 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 335) took 2761 ms. Trace:
W20260709 12:18:12.461040 20327 rpcz_store.cc:269] 0709 12:18:09.564463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.565527 (+  1064us) service_pool.cc:224] Handling call
0709 12:18:12.380072 (+2814545us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54003ad9d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.427125 (+ 47053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209785088}
I20260709 12:18:11.471376 22758 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.478649 22589 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.479251 22560 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.479462 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:12.497536 20175 raft_consensus.cc:2410] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:12.498703 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.471226 20177 rpcz_store.cc:276] 0709 12:18:09.705350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.706354 (+  1004us) service_pool.cc:224] Handling call
0709 12:18:09.731901 (+ 25547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.334034 (+602133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.466046 (+2132012us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400111a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.466447 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329126272}
I20260709 12:18:12.479818 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:12.480309 22609 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:12.499961 20175 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:12.483244 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 489) took 2255 ms. Trace:
I20260709 12:18:12.483366 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:12.486347 22442 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.487888 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.488942 20172 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:12.504891 20176 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:12.490660 22768 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.492063 21043 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:12.471706 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:12.501940 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 342) took 1287 ms. Trace:
I20260709 12:18:12.506737 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 754) took 2629 ms. Trace:
I20260709 12:18:12.507117 21042 rpcz_store.cc:276] 0709 12:18:09.873701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.482545 (+2608844us) service_pool.cc:224] Handling call
0709 12:18:12.483135 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.494287 (+ 11152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.494322 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.502480 (+  8158us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:12.502519 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.502595 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.502703 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.483242 22765 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:12.508208 20180 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 12:18:12.504693 20221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.041s	user 0.020s	sys 0.084s
I20260709 12:18:12.508680 20180 pending_rounds.cc:85] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:12.509981 20255 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.510159 20180 pending_rounds.cc:107] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:12.510677 20180 raft_consensus.cc:2889] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.505837 20171 rpcz_store.cc:276] 0709 12:18:11.213953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.214117 (+   164us) service_pool.cc:224] Handling call
0709 12:18:11.214524 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:11.214991 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.215019 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:11.241052 (+ 26033us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.706431 (+465379us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:11.706586 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.706780 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.500355 (+793575us) raft_consensus.cc:1685] finished
0709 12:18:12.500373 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.501585 (+  1212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5573,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":5967,"thread_start_us":12331,"threads_started":1,"wal-append.queue_time_us":1195632}
I20260709 12:18:12.511785 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 771) took 1731 ms. Trace:
I20260709 12:18:12.512180 21043 rpcz_store.cc:276] 0709 12:18:10.777282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.374601 (+1597319us) service_pool.cc:224] Handling call
0709 12:18:12.508873 (+134272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.512550 20171 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:12.512915 20171 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:12.514324 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 770) took 1988 ms. Trace:
I20260709 12:18:12.514063 20171 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.514709 21043 rpcz_store.cc:276] 0709 12:18:10.526141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.512993 (+1986852us) service_pool.cc:224] Handling call
0709 12:18:12.513516 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.513935 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.513962 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.514020 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.514088 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.514145 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.514242 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.515885 20252 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.503597 20249 rpcz_store.cc:276] 0709 12:18:10.227727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.468742 (+2241015us) service_pool.cc:224] Handling call
0709 12:18:12.481597 (+ 12855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.482757 (+  1160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.482794 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.482852 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:12.482937 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.483020 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.483144 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":223}
I20260709 12:18:12.520041 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1674) took 1287 ms. Trace:
I20260709 12:18:12.526698 20254 rpcz_store.cc:276] 0709 12:18:11.232861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.430789 (+1197928us) service_pool.cc:224] Handling call
0709 12:18:12.519945 (+ 89156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.529247 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.530236 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.515642 22528 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.528390 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.538880 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2525) took 4153 ms. Trace:
I20260709 12:18:12.469105 21035 rpcz_store.cc:276] 0709 12:18:09.872770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.445146 (+572376us) service_pool.cc:224] Handling call
0709 12:18:10.445890 (+   744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.446415 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.446454 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.456434 (+  9980us) log.cc:844] Serialized 564 byte log entry
0709 12:18:10.680454 (+224020us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:10.682738 (+  2284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.688985 (+  6247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:11.182769 (+493784us) raft_consensus.cc:1685] finished
0709 12:18:11.183172 (+   403us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.220184 (+ 37012us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":213212,"threads_started":1,"wal-append.queue_time_us":409095,"wal-append.run_cpu_time_us":4109,"wal-append.run_wall_time_us":1442272}
I20260709 12:18:12.543936 22668 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.542021 20176 raft_consensus.cc:2410] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:12.524999 22765 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:12.551115 22442 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.552148 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 350) took 2814 ms. Trace:
I20260709 12:18:12.541251 20322 rpcz_store.cc:276] 0709 12:18:08.385373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.528264 (+142891us) service_pool.cc:224] Handling call
0709 12:18:08.546280 (+ 18016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.812189 (+1265909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.534857 (+2722668us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001a2554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.538626 (+  3769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736389888}
W20260709 12:18:12.555338 21040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 775) took 1709 ms (client timeout 2088 ms). Trace:
I20260709 12:18:12.556093 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1347) took 2703 ms. Trace:
W20260709 12:18:12.555859 21040 rpcz_store.cc:269] 0709 12:18:10.845699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.905736 (+ 60037us) service_pool.cc:224] Handling call
0709 12:18:12.555079 (+1649343us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400738a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.555253 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3492167552}
I20260709 12:18:12.556608 20251 rpcz_store.cc:276] 0709 12:18:09.852878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.864914 (+ 12036us) service_pool.cc:224] Handling call
0709 12:18:09.984150 (+119236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.443188 (+459038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.448069 (+  4881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:10.461553 (+ 13484us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:10.463470 (+  1917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.555540 (+2092070us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000d9154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.555688 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.555903 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540134784}
I20260709 12:18:12.557687 21040 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:12.558379 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 772) took 1780 ms. Trace:
I20260709 12:18:12.558708 21040 rpcz_store.cc:276] 0709 12:18:10.777582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.556861 (+1779279us) service_pool.cc:224] Handling call
0709 12:18:12.557353 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.558103 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.558325 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.559128 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1659) took 1989 ms. Trace:
I20260709 12:18:12.564278 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1391) took 1262 ms. Trace:
I20260709 12:18:12.544869 22759 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:12.554102 22621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.778s	user 0.020s	sys 0.054s
I20260709 12:18:12.564963 20324 rpcz_store.cc:276] 0709 12:18:11.230430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.245199 (+ 14769us) service_pool.cc:224] Handling call
0709 12:18:12.473704 (+1228505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.569832 20255 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:12.570815 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1675) took 1337 ms. Trace:
I20260709 12:18:12.571163 20255 rpcz_store.cc:276] 0709 12:18:11.233140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.454480 (+1221340us) service_pool.cc:224] Handling call
0709 12:18:12.570753 (+116273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.571079 21041 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.545908 22609 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:12.582154 22442 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.566179 22759 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.533974 22777 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.594965 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.597187 20175 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:12.592595 22759 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.552748 22715 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.613214 20326 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:12.601224 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1344) took 3135 ms. Trace:
I20260709 12:18:12.593250 22783 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.622167 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 756) took 2409 ms. Trace:
I20260709 12:18:12.625326 21042 rpcz_store.cc:276] 0709 12:18:10.210126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.528737 (+2318611us) service_pool.cc:224] Handling call
0709 12:18:12.567912 (+ 39175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.597564 (+ 29652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.597609 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.601466 (+  3857us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:12.619448 (+ 17982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.619522 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.619667 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.630852 20171 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.621712 20247 rpcz_store.cc:276] 0709 12:18:09.457143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.457628 (+   485us) service_pool.cc:224] Handling call
0709 12:18:09.458084 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.493434 (+ 35350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.493466 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.493520 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:09.493552 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.573344 (+3079792us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54001c8754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.573435 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.592024 (+ 18589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80797952}
I20260709 12:18:12.637506 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.638684 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2534) took 2377 ms. Trace:
I20260709 12:18:12.638284 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2533) took 2377 ms. Trace:
I20260709 12:18:12.640844 20249 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:12.642200 20326 rpcz_store.cc:276] 0709 12:18:10.261282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.263273 (+  1991us) service_pool.cc:224] Handling call
0709 12:18:10.267573 (+  4300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.595835 (+2328262us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b54002817a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefa1c0 00007f5ddaefb231 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c
0709 12:18:12.627070 (+ 31235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.638224 (+ 11154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8395648}
I20260709 12:18:12.656097 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 494) took 2295 ms. Trace:
I20260709 12:18:12.660466 20249 rpcz_store.cc:276] 0709 12:18:10.352212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.532514 (+2180302us) service_pool.cc:224] Handling call
0709 12:18:12.570453 (+ 37939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.645036 (+ 74583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.647539 (+  2503us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:12.634945 22747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.192s	user 0.033s	sys 0.059s
I20260709 12:18:12.685864 22777 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.689399 22712 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:12.690117 22712 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.690591 22680 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.691689 22718 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.692446 22718 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.695557 20177 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:12.698518 22712 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.700047 22668 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.700711 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 487) took 2503 ms. Trace:
I20260709 12:18:12.700928 22668 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.701175 20256 rpcz_store.cc:276] 0709 12:18:10.196995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.230890 (+ 33895us) service_pool.cc:224] Handling call
0709 12:18:10.231339 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.516125 (+284786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.516165 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.516794 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.199179 (+682385us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:11.199221 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.330848 (+131627us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002df354. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:11.330898 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.635548 (+1304650us) raft_consensus.cc:1685] finished
0709 12:18:12.640157 (+  4609us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.700504 (+ 60347us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24147,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13387,"spinlock_wait_cycles":316242688,"thread_start_us":828582,"threads_started":2,"wal-append.queue_time_us":864080}
W20260709 12:18:12.703641 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 281615us
I20260709 12:18:12.706197 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1932) took 4207 ms. Trace:
I20260709 12:18:12.706656 20178 rpcz_store.cc:276] 0709 12:18:08.498412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.498681 (+   269us) service_pool.cc:224] Handling call
0709 12:18:08.514020 (+ 15339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.652163 (+1138143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.705553 (+3053390us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54000a6754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.705933 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269457152}
I20260709 12:18:12.708065 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:12.708730 20178 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.709582 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:12.663249 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1661) took 2093 ms. Trace:
I20260709 12:18:12.712224 20255 rpcz_store.cc:276] 0709 12:18:10.569980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.576608 (+2006628us) service_pool.cc:224] Handling call
0709 12:18:12.600768 (+ 24160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.647676 (+ 46908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.647724 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.662908 (+ 15184us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:12.662960 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.663030 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.663177 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.710006 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:12.718254 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:12.662585 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:12.720682 22528 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:12.701188 21038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 762) took 2075 ms (client timeout 1747 ms). Trace:
I20260709 12:18:12.663945 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.665877 22657 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.666724 22765 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.559535 20251 rpcz_store.cc:276] 0709 12:18:10.569413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.557884 (+1988471us) service_pool.cc:224] Handling call
0709 12:18:12.558341 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.558708 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.558744 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.558814 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:12.558866 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.558924 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.559048 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.737181 22715 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.737146 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:12.738169 20251 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.672386 20175 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:12.739720 22528 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:12.740486 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.740286 22528 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.741132 22718 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.672869 22609 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:12.423563 21036 rpcz_store.cc:276] 0709 12:18:09.595999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.598382 (+  2383us) service_pool.cc:224] Handling call
0709 12:18:09.633063 (+ 34681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.825596 (+192533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.835558 (+  9962us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.259984 (+424426us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.689143 (+429159us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:10.691225 (+  2082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.852610 (+161385us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54006815d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:10.852685 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.928590 (+ 75905us) raft_consensus.cc:1685] finished
0709 12:18:10.934419 (+  5829us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:11.247281 (+312862us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8034,"raft.queue_time_us":14754,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":14786,"spinlock_wait_cycles":266146176,"thread_start_us":282617,"threads_started":1,"wal-append.queue_time_us":524270,"wal-append.run_cpu_time_us":13924,"wal-append.run_wall_time_us":1428932}
I20260709 12:18:12.673528 22759 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:12.676057 22791 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:18:12.676869 20171 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 12:18:12.723796 21038 rpcz_store.cc:269] 0709 12:18:10.625492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.749533 (+124041us) service_pool.cc:224] Handling call
0709 12:18:12.700761 (+1951228us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b54004ad154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.701003 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159955712}
I20260709 12:18:12.641005 20321 rpcz_store.cc:276] 0709 12:18:10.261663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.262551 (+   888us) service_pool.cc:224] Handling call
0709 12:18:10.262917 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.543405 (+280488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.543437 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.551908 (+  8471us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.545191 (+1993283us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b180040daa0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1
0709 12:18:12.578504 (+ 33313us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.578573 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.592829 (+ 14256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.592879 (+    50us) raft_consensus.cc:1685] finished
0709 12:18:12.592890 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.638617 (+ 45727us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7961,"raft.queue_time_us":120181,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":17586,"spinlock_wait_cycles":35883776,"thread_start_us":2072944,"threads_started":2,"wal-append.queue_time_us":1812335}
I20260709 12:18:12.554840 21034 rpcz_store.cc:276] 0709 12:18:09.737267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.233138 (+495871us) service_pool.cc:224] Handling call
0709 12:18:10.349961 (+116823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.386702 (+ 36741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.389016 (+  2314us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.428488 (+ 39472us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.692976 (+264488us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:10.694848 (+  1872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.705194 (+ 10346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.423855 (+1718661us) raft_consensus.cc:1685] finished
0709 12:18:12.428506 (+  4651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.551628 (+123122us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540047b650. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.551906 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5336,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":22724,"spinlock_wait_cycles":248209152,"thread_start_us":253116,"threads_started":1,"wal-append.queue_time_us":754832}
W20260709 12:18:12.682260 22616 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.998s	user 0.015s	sys 0.007s
I20260709 12:18:12.684633 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2541) took 1839 ms. Trace:
I20260709 12:18:12.729748 22657 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.733703 22746 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.734491 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 488) took 2523 ms. Trace:
I20260709 12:18:12.749286 20173 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:12.754647 21041 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:12.752300 20171 pending_rounds.cc:85] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 3
I20260709 12:18:12.763811 20171 pending_rounds.cc:107] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:18:12.759155 20325 rpcz_store.cc:276] 0709 12:18:10.844830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.844962 (+   132us) service_pool.cc:224] Handling call
0709 12:18:10.845360 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.845740 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.845771 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.849149 (+  3378us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.354840 (+1505691us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:12.354941 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.355085 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.650317 (+295232us) raft_consensus.cc:1685] finished
0709 12:18:12.650338 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.684564 (+ 34226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1639,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":16494,"thread_start_us":1466814,"threads_started":1,"wal-append.queue_time_us":1696163}
I20260709 12:18:12.763320 20250 rpcz_store.cc:276] 0709 12:18:10.211258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.742709 (+531451us) service_pool.cc:224] Handling call
0709 12:18:10.743121 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.743515 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.743543 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.744105 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.477493 (+1733388us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:12.506215 (+ 28722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.522813 (+ 16598us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.704361 (+181548us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b2400142358. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9 00007f5dd7e4aa55 00007f5dd7e49fb0 00007f5ddaac0488 00007f5ddaac0be8 00007f5ddaa98398 00007f5ddaa9376a 00007f5ddaa92bb6
0709 12:18:12.710166 (+  5805us) raft_consensus.cc:1685] finished
0709 12:18:12.710186 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.734369 (+ 24183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1861,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":111,"spinlock_wait_cycles":33402240,"thread_start_us":1663446,"threads_started":1,"wal-append.queue_time_us":1711522}
I20260709 12:18:12.766212 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:12.766866 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:12.767032 20247 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:12.767946 22727 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.768847 20247 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:12.769483 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1663) took 2199 ms. Trace:
I20260709 12:18:12.764122 20171 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:12.781499 20253 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 493) took 2442 ms (client timeout 2693 ms). Trace:
W20260709 12:18:12.781910 20253 rpcz_store.cc:269] 0709 12:18:10.339190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.482531 (+143341us) service_pool.cc:224] Handling call
0709 12:18:12.781098 (+2298567us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002bff54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.781309 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323467648}
I20260709 12:18:12.782083 20247 rpcz_store.cc:276] 0709 12:18:10.570533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.768161 (+2197628us) service_pool.cc:224] Handling call
0709 12:18:12.768539 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.769231 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.769429 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.785696 22657 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:12.786491 21037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 348) took 3199 ms (client timeout 1575 ms). Trace:
W20260709 12:18:12.786886 21037 rpcz_store.cc:269] 0709 12:18:09.586791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.598135 (+ 11344us) service_pool.cc:224] Handling call
0709 12:18:12.786091 (+3187956us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540011c954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:12.786289 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269536640}
I20260709 12:18:12.787969 22668 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.789981 20178 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:12.791985 22731 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:12.792757 22528 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:12.792822 22731 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.798128 22634 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:12.799132 22634 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.802057 22634 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:12.803041 22132 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:18:12.770048 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1340) took 3358 ms. Trace:
I20260709 12:18:12.803505 22682 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:12.804121 22682 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:12.773270 22792 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.300s	user 0.002s	sys 0.000s
I20260709 12:18:12.775962 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 341) took 1562 ms. Trace:
I20260709 12:18:12.760607 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:12.754556 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:12.780367 22797 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:12.780735 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 346) took 1535 ms. Trace:
I20260709 12:18:12.810681 20173 rpcz_store.cc:276] 0709 12:18:11.244893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.245650 (+   757us) service_pool.cc:224] Handling call
0709 12:18:12.780621 (+1534971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.809017 20180 rpcz_store.cc:276] 0709 12:18:11.213598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.213722 (+   124us) service_pool.cc:224] Handling call
0709 12:18:11.214032 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.511304 (+1297272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.775698 (+264394us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540031a6d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.775900 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2964422400}
I20260709 12:18:12.803956 20248 rpcz_store.cc:276] 0709 12:18:09.411508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.411964 (+   456us) service_pool.cc:224] Handling call
0709 12:18:09.412301 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.414537 (+  2236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.414568 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.414614 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:09.414648 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.769570 (+3354922us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b54002de1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:12.769645 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.769864 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4580736}
I20260709 12:18:12.811831 20250 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:12.813022 20326 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:12.822707 20256 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:12.812299 21041 pending_rounds.cc:85] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 6
I20260709 12:18:12.829952 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:12.830920 20176 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:12.832504 20252 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:12.836560 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 753) took 2960 ms. Trace:
W20260709 12:18:12.838280 20252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1673) took 1601 ms (client timeout 1719 ms). Trace:
W20260709 12:18:12.840590 20252 rpcz_store.cc:269] 0709 12:18:11.232559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.374151 (+1141592us) service_pool.cc:224] Handling call
0709 12:18:12.833529 (+459378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.840723 20248 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.846483 22715 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:12.847184 22715 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.849260 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:12.849786 22800 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:12.850278 20324 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.850472 22800 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.852783 22800 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:12.849392 22715 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.855886 22715 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.856514 22715 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.859659 20324 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:12.859627 22715 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:12.862320 22799 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.862903 22799 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.849249 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:12.868955 22731 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:12.825376 21041 pending_rounds.cc:107] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.7
I20260709 12:18:12.869910 21041 raft_consensus.cc:2917] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Aborting config change with OpId 5.7: Aborted: Op aborted by new leader
I20260709 12:18:12.870034 22799 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.822578 22768 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:12.870536 21041 raft_consensus.cc:2889] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.876088 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:12.878748 20250 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:12.873569 22730 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:12.925180 22730 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.928130 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:12.929529 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 100969us
I20260709 12:18:12.930564 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:12.838976 21039 rpcz_store.cc:276] 0709 12:18:09.873424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.763894 (+890470us) service_pool.cc:224] Handling call
0709 12:18:10.764845 (+   951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.830498 (+ 65653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.830545 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:10.831193 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.418234 (+1587041us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.418322 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.418433 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.772395 (+353962us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:12.808531 (+ 36136us) raft_consensus.cc:1685] finished
0709 12:18:12.808562 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.833661 (+ 25099us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74714,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6246,"spinlock_wait_cycles":17089280,"thread_start_us":1539659,"threads_started":1,"wal-append.queue_time_us":1617822}
I20260709 12:18:12.931759 22528 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:12.932204 22528 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.876732 22800 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.932576 22528 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.933058 22800 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:12.935854 22668 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:12.936318 22668 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.936666 22668 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.896162 20325 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:12.940688 20324 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:12.940099 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:12.941072 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:12.963006 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 71652.7us
I20260709 12:18:12.963399 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:12.881446 22799 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.944571 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:12.932595 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 755) took 3019 ms. Trace:
I20260709 12:18:12.976218 20326 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:12.975884 21041 rpcz_store.cc:276] 0709 12:18:09.913628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.470219 (+2556591us) service_pool.cc:224] Handling call
0709 12:18:12.524862 (+ 54643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.932253 (+407391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.932505 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:12.939929 22680 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:12.949935 22764 consensus_meta.cc:287] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.004s
I20260709 12:18:12.982251 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:12.895603 22727 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:12.995800 20255 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
W20260709 12:18:12.990592 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60195.1us
I20260709 12:18:12.896518 22700 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:12.994813 20329 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:12.992920 20322 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:12.996488 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:12.978161 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 760) took 2370 ms. Trace:
I20260709 12:18:13.002889 22764 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:13.003846 22801 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:18:13.004369 20251 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
W20260709 12:18:13.005368 20294 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.658s (SENT) [suppressed 19 similar messages]
I20260709 12:18:13.013239 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 758) took 2446 ms. Trace:
I20260709 12:18:13.013679 21043 rpcz_store.cc:276] 0709 12:18:10.566849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.523707 (+1956858us) service_pool.cc:224] Handling call
0709 12:18:12.570382 (+ 46675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.717081 (+146699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.717129 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.717201 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.717250 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.012946 (+295696us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b5400406fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:13.013012 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.013175 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176594688}
I20260709 12:18:13.025540 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.026602 20321 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:13.026536 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1658) took 2451 ms. Trace:
I20260709 12:18:13.031154 22800 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:13.020171 22799 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.025914 22761 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.035807 22799 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.036279 22761 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.003331 21035 rpcz_store.cc:276] 0709 12:18:10.608204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.542936 (+1934732us) service_pool.cc:224] Handling call
0709 12:18:12.543415 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.544303 (+   888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.544342 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.544989 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.755871 (+210882us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:12.755944 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.756036 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.943061 (+187025us) raft_consensus.cc:1685] finished
0709 12:18:12.943111 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.976775 (+ 33664us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":137179,"threads_started":1,"wal-append.queue_time_us":369916}
I20260709 12:18:13.038559 22761 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:13.038769 22536 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.006s
I20260709 12:18:13.020025 22609 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.041417 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.044459 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.012430 22727 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:13.045143 20219 connection.cc:256] RPC call timeout handler was delayed by -1.01233423199983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:18:13.045492 22700 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:13.046293 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1671) took 2465 ms. Trace:
I20260709 12:18:13.046865 22742 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.047308 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.047480 22742 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.048069 20327 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:18:13.048918 21007 connection.cc:256] RPC call timeout handler was delayed by -1.7635077709999223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 12:18:13.048002 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.040915 22609 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.048043 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.046680 20253 rpcz_store.cc:276] 0709 12:18:10.581132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.833234 (+2252102us) service_pool.cc:224] Handling call
0709 12:18:12.856195 (+ 22961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.856709 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.856736 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.858064 (+  1328us) log.cc:844] Serialized 564 byte log entry
0709 12:18:12.977438 (+119374us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:12.977474 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.977543 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.046082 (+ 68539us) raft_consensus.cc:1685] finished
0709 12:18:13.046102 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.046236 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":118959,"threads_started":1,"wal-append.queue_time_us":179969}
I20260709 12:18:13.027204 20254 rpcz_store.cc:276] 0709 12:18:10.569125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.535814 (+1966689us) service_pool.cc:224] Handling call
0709 12:18:12.570102 (+ 34288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.680073 (+109971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.680110 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.680929 (+   819us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.812798 (+131869us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:13.011504 (+198706us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.016015 (+  4511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.016188 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.016248 (+    60us) raft_consensus.cc:1685] finished
0709 12:18:13.016264 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.019939 (+  3675us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3517,"prepare.queue_time_us":198827,"raft.queue_time_us":24419,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":5231,"thread_start_us":263657,"threads_started":2,"wal-append.queue_time_us":202604}
I20260709 12:18:13.045136 21041 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:13.049882 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.058652 22708 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:13.059166 21037 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:13.065632 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.059834 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.074440 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.020702 22668 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.046890 22727 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.061919 20251 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:13.078254 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.078478 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.059301 22708 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.059211 22415 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.039363 22536 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.091635 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.066254 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.052470 22777 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.088424 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.102401 20254 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:13.065900 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.089178 20250 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.079301 20327 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:13.061295 22768 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:13.061932 22680 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:18:13.090641 22493 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:13.097584 22415 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.057037 22442 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.098161 22708 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.096251 22498 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:13.101504 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.105738 21034 raft_consensus.cc:2368] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:18:13.106251 20177 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.106655 20179 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:13.107347 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 359) took 3886 ms. Trace:
I20260709 12:18:13.109428 22384 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.111022 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.111099 22668 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.089502 22783 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:13.086817 22742 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.130052 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:13.118638 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69121.7us
I20260709 12:18:13.119977 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.120827 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.116593 20252 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:13.118197 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1662) took 2548 ms. Trace:
I20260709 12:18:13.095888 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.122736 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.126426 20330 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:13.089730 22528 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:13.133845 20176 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:18:13.135251 21007 connection.cc:256] RPC call timeout handler was delayed by -1.5844506450000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 12:18:13.135684 21039 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:13.131073 20325 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:13.130975 20323 rpcz_store.cc:276] 0709 12:18:09.220432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.220563 (+   131us) service_pool.cc:224] Handling call
0709 12:18:09.220855 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.802963 (+3582108us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:12.803026 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.803073 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:12.803111 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.106940 (+303829us) spinlock_profiling.cc:243] Waited 3.57 s on lock 0x7b54003980d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:13.106987 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.107153 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13620,"raft.queue_time_us":14424,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":130,"spinlock_wait_cycles":8205528448}
I20260709 12:18:13.136626 20253 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
W20260709 12:18:13.145489 21007 connection.cc:256] RPC call timeout handler was delayed by -1.4723070449999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:18:13.145983 21007 connection.cc:256] RPC call timeout handler was delayed by -1.4723070449999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:18:13.146232 21007 connection.cc:256] RPC call timeout handler was delayed by -1.4391718070000934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260709 12:18:13.147470 20255 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:13.147363 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.147799 22682 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.148352 21036 raft_consensus.cc:2410] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:13.139385 21035 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.149641 22415 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.148234 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2517) took 4584 ms. Trace:
I20260709 12:18:13.151846 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.134845 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.151858 20180 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:13.156374 20171 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:13.152215 20174 rpcz_store.cc:276] 0709 12:18:08.511837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.755403 (+243566us) service_pool.cc:224] Handling call
0709 12:18:08.756753 (+  1350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:08.945015 (+188262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:08.945064 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.946541 (+  1477us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.438592 (+492051us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180025be20. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:18:09.744041 (+305449us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:12.784700 (+3040659us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b180025be20. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf 00007f5ddaf12038
0709 12:18:12.939693 (+154993us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.069854 (+130161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.076834 (+  6980us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.087377 (+ 10543us) raft_consensus.cc:1685] finished
0709 12:18:13.087399 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.096446 (+  9047us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":528291,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":6363,"raft.queue_time_us":196324,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":10284,"spinlock_wait_cycles":13128704,"thread_start_us":676753,"threads_started":4,"wal-append.queue_time_us":952912,"wal-append.run_cpu_time_us":11335,"wal-append.run_wall_time_us":1064574}
I20260709 12:18:13.124996 22777 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.153384 22609 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.156479 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.167640 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.168169 22528 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.168503 20253 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.135699 20249 rpcz_store.cc:276] 0709 12:18:10.570277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.712034 (+2141757us) service_pool.cc:224] Handling call
0709 12:18:12.819368 (+107334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.943700 (+124332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.943735 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.944350 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.976494 (+ 32144us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:13.117390 (+140896us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.117958 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.118027 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.118055 (+    28us) raft_consensus.cc:1685] finished
0709 12:18:13.118062 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.118151 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81489,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":46,"raft.queue_time_us":12517,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":19771,"thread_start_us":147512,"threads_started":2,"wal-append.queue_time_us":145595}
I20260709 12:18:13.153419 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53418
I20260709 12:18:13.170805 20252 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 12:18:13.170480 22783 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.171167 20252 raft_consensus.cc:614] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:13.172782 22783 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.174414 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.176725 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.177316 21038 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:13.178756 21039 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:13.139757 22384 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.133884 22768 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.182615 22768 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.143187 22493 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.183831 20253 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:13.183923 22536 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.184383 20175 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.143508 22442 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.186448 22493 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.187047 22442 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.191241 20251 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:13.198568 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.143925 22498 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.200237 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.207638 20174 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:13.208375 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:13.209975 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50466.2us
I20260709 12:18:13.213887 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.214354 22777 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.215044 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.215144 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.215909 20178 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.217335 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.217993 20172 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.219823 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.220160 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1669) took 2639 ms. Trace:
I20260709 12:18:13.220516 20247 rpcz_store.cc:276] 0709 12:18:10.580564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.782938 (+2202374us) service_pool.cc:224] Handling call
0709 12:18:12.823545 (+ 40607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.827856 (+  4311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.827905 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.827972 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.828024 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.828111 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.219986 (+391875us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54003caad0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:13.220102 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92369280}
I20260709 12:18:13.216022 22498 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:13.221648 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56490.5us
I20260709 12:18:13.221807 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:13.223186 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.224792 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.226889 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.227452 20247 raft_consensus.cc:2376] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6. Re-sending same reply.
I20260709 12:18:13.226924 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.228318 20251 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:13.228623 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.229307 20247 raft_consensus.cc:2376] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6. Re-sending same reply.
I20260709 12:18:13.231927 20249 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:13.240442 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.241669 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.241792 20250 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:13.243016 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.243302 20250 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:13.244307 22613 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.244639 20250 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:13.244829 22613 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.245322 22759 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.245817 20250 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:13.247783 22564 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.248219 22564 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.248576 22564 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.249537 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.250180 20255 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:13.252357 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.253813 20327 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:13.252817 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.254853 20172 raft_consensus.cc:2410] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:13.255270 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.256803 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.258131 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.247394 22613 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.259603 20175 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:13.260993 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.261292 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1392) took 2030 ms. Trace:
I20260709 12:18:13.261919 22727 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:13.262334 22799 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.261701 20330 rpcz_store.cc:276] 0709 12:18:11.230755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.409268 (+1178513us) service_pool.cc:224] Handling call
0709 12:18:12.409900 (+   632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.137249 (+727349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.261023 (+123774us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54000870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:13.261215 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647269120}
I20260709 12:18:13.262768 22758 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:13.265358 20322 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:13.268288 22758 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.269143 22727 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.270960 22758 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:13.271359 22758 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:13.271951 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.273051 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.272787 20251 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:13.273639 20177 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:13.272773 22758 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.274098 22384 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.275032 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.275465 22758 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.277411 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.278035 20252 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.283857 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.286303 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.297647 22564 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.301225 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:13.303885 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.307272 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 70305.6us
I20260709 12:18:13.309921 20252 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:18:13.302057 20074 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 316) took 11322 ms (client timeout 15000 ms). Trace:
I20260709 12:18:13.313023 20178 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:18:13.317334 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.301258 20073 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:13.323833 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.324399 20178 raft_consensus.cc:2376] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5. Re-sending same reply.
W20260709 12:18:13.327641 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.328281 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.315872 21035 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:13.332113 22536 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:13.363345 22536 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:13.364580 22536 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.332525 22498 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.367350 22498 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.369375 22498 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.335279 21034 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:13.332760 20073 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 6, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:13.333969 20220 leader_election.cc:336] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.703s (SENT)
I20260709 12:18:13.332840 22564 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.332959 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.333225 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:13.337260 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.333855 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.334685 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.340356 20252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:18:13.342146 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:13.331517 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1380071489998045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:18:13.379776 20252 raft_consensus.cc:606] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.380103 20252 raft_consensus.cc:614] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:13.343716 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.347677 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.349882 22613 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:13.383791 21036 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
W20260709 12:18:13.384672 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54979.9us
I20260709 12:18:13.385131 22758 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:13.385540 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.758s (SENT)
I20260709 12:18:13.385921 22758 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:13.386041 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.351132 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.350765 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.352905 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.354417 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:13.378710 20073 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:13.389935 20174 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:13.356118 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.357910 22384 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.362614 20219 leader_election.cc:400] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4.
I20260709 12:18:13.377934 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:13.393296 20321 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.381561 20172 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
W20260709 12:18:13.379962 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1673241099999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 12:18:13.394407 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1198317519999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 12:18:13.394891 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0572204279999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:18:13.395300 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0572204279999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 12:18:13.382865 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:13.384703 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 51585.8us
I20260709 12:18:13.389252 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:13.360116 22442 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:13.391499 22817 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:13.402374 20073 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 3, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:13.403838 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53204.4us
I20260709 12:18:13.408100 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:13.409607 20220 leader_election.cc:336] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.072s (SENT)
I20260709 12:18:13.410065 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.410753 22613 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:13.411110 22442 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:13.411679 22442 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:13.412760 22759 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:13.413381 22759 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:13.414592 22759 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.416744 20248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:49610
I20260709 12:18:13.417340 22817 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:13.417744 22759 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.417449 20248 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.418910 20248 raft_consensus.cc:614] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:13.418285 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:13.416133 20073 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:13.409066 22758 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.422219 22613 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:13.422241 22498 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:13.424537 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:13.424567 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.425300 22764 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.407393 22493 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:13.426136 22613 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.426244 22680 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:13.426608 22613 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:13.426712 22680 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:13.427098 22613 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.427804 22680 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.429703 22680 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.426148 22384 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.431746 22384 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:13.432219 22384 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.432308 22442 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.433967 22442 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.439026 22771 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:13.440335 22730 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:13.440783 22730 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:13.441718 22730 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:13.444288 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81881.9us
I20260709 12:18:13.445894 22730 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.446933 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.437961 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.438087 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.438686 22800 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.436033 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:13.457664 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:13.459071 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:13.443861 20073 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:13.470086 20321 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:13.475759 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.474331 20073 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:13.456382 22800 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.471397 22771 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:13.486111 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.486316 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.484639 21039 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:13.472813 22758 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:13.437556 22682 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:13.488268 22800 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.489755 21038 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:13.491245 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.492982 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55182.2us
I20260709 12:18:13.494232 22817 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:13.500339 22727 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:13.491811 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.502485 22777 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:13.504415 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 86272.1us
I20260709 12:18:13.505273 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:13.507253 22528 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.507726 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:13.507964 22528 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.508427 22528 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.508600 22817 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.509085 22817 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.509462 22817 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.511063 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.511762 20256 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:13.507763 22783 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:18:13.513032 20248 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:13.513413 20248 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:13.514225 20248 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.515133 20248 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:13.455611 22536 consensus_queue.cc:1175] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e929b30888874ed59248f1229cecd3c6" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:13.518304 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:13.507266 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:13.310982 20074 rpcz_store.cc:269] 0709 12:18:01.979306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.979613 (+   307us) service_pool.cc:224] Handling call
0709 12:18:13.301773 (+11322160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:07.168255 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:07.168890 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:07.168928 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:18:07.168947 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:07.169599 (+   652us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:07.169684 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:07.169712 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:18:07.170140 (+   428us) tablet.cc:701] Row locks acquired
0709 12:18:07.170160 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:07.170314 (+   154us) write_op.cc:270] Start()
0709 12:18:07.170443 (+   129us) write_op.cc:276] Timestamp: P: 1783599487170269 usec, L: 0
0709 12:18:07.170468 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:18:07.261458 (+ 90990us) log.cc:844] Serialized 1759 byte log entry
0709 12:18:07.951993 (+690535us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b
0709 12:18:09.256621 (+1304628us) op_driver.cc:464] REPLICATION: finished
0709 12:18:09.570656 (+314035us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5dde92eef0
0709 12:18:09.580427 (+  9771us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef3e28 00007f5dde92e581 00007f5dde92dd58 00007f5dde9329f1 00007f5dde9329a9 00007f5dde932939 00007f5dde932901 00007f5dde931b2d 0000000000388634 0000000000388479
0709 12:18:10.354581 (+774154us) write_op.cc:301] APPLY: starting
0709 12:18:10.363686 (+  9105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:10.384573 (+ 20887us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:10.388335 (+  3762us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:10.398982 (+ 10647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:10.399237 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:18:10.399292 (+    55us) write_op.cc:312] APPLY: finished
0709 12:18:10.405288 (+  5996us) log.cc:844] Serialized 41 byte log entry
0709 12:18:12.685370 (+2280082us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:12.685605 (+   235us) write_op.cc:454] Released schema lock
0709 12:18:12.685706 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:12.686528 (+   822us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:12.686565 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8737,"reported_tablets":10,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":1006036,"apply.run_cpu_time_us":97300,"apply.run_wall_time_us":2350920,"num_ops":4,"prepare.queue_time_us":666581,"prepare.run_cpu_time_us":82358,"prepare.run_wall_time_us":2455391,"raft.queue_time_us":498887,"raft.run_cpu_time_us":39674,"raft.run_wall_time_us":1195890,"replication_time_us":2043612,"spinlock_wait_cycles":113718144,"thread_start_us":4978975,"threads_started":5,"wal-append.queue_time_us":1914539,"wal-append.run_cpu_time_us":40287,"wal-append.run_wall_time_us":2951338}]]}
I20260709 12:18:13.490300 22731 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.489130 22700 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:13.542240 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:13.530694 22493 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:13.538146 22783 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:13.539835 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.548539 20252 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:13.521781 22764 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:18:13.493583 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.558277 21034 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:13.560846 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.526858 22564 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:13.565140 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:13.543920 22493 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:13.541605 22384 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.544118 22731 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:13.571509 22727 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:18:13.563340 22771 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:13.585346 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:13.586158 22771 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.586987 22758 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:13.565424 22609 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:13.588513 22758 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:13.588907 22758 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:13.589250 22758 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.592857 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:13.593683 22799 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.569716 22493 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:13.609191 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:13.614554 22727 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:13.615032 22727 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:13.612350 22817 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:13.618664 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44403.4us
I20260709 12:18:13.623237 20252 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:13.622426 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:13.622324 20126 auto_rebalancer.cc:893] Removing replace marker failed: Replica e929b30888874ed59248f1229cecd3c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:18:13.624446 20126 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:18:13.624634 20248 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:18:13.570130 22700 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:13.616331 22731 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:13.628587 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.625043 20248 pending_rounds.cc:85] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 5
W20260709 12:18:13.624861 20126 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:18:13.638857 20248 pending_rounds.cc:107] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:13.640075 20248 raft_consensus.cc:2889] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:13.618865 22132 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:13.669961 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45711.8us
W20260709 12:18:13.671717 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62647.7us
I20260709 12:18:13.616040 22727 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.647925 22742 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:13.679311 22644 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.679420 22132 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:13.680044 22644 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.680605 22384 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.678103 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.630666 22783 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:18:13.692140 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:13.698851 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 213873us
I20260709 12:18:13.705143 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:13.661755 22528 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.717587 22528 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.719231 22761 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:13.720075 22761 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:13.721386 22761 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:13.723299 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.726164 22564 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.726889 22564 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.711158 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.698127 22384 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:13.737851 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.738580 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.680543 22132 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.738885 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.741074 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.740859 20322 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:13.748585 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:13.793601 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 122692us
I20260709 12:18:13.728744 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.703675 22498 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:18:13.846777 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.847599 20249 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:13.847501 22777 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:13.749598 22700 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:13.856822 22846 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.857473 22846 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.863773 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:13.864557 20247 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:13.868541 20248 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:18:13.873098 22839 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.873924 22839 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.878002 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.879279 22841 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:13.879913 22841 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.881711 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.883253 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.889895 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:13.868911 20248 pending_rounds.cc:85] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 4
I20260709 12:18:13.890720 20254 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
W20260709 12:18:13.890060 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 189605us
I20260709 12:18:13.905402 20248 pending_rounds.cc:107] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:18:13.905714 20248 raft_consensus.cc:2889] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:13.907184 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:13.906281 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 198313us
I20260709 12:18:13.909772 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.910356 20330 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:13.891242 22384 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.914347 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.893508 22817 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:13.920814 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.927086 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:13.928014 20330 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:13.919703 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:13.926326 22831 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:13.930428 22831 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:13.930816 22831 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.863603 22613 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:13.935374 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 224263us
I20260709 12:18:13.936623 22845 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:13.938020 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:13.938475 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:13.939082 22850 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:13.939247 22845 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.939450 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:13.939790 22845 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.940310 22845 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.942538 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:13.943586 21040 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:13.915544 22384 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:13.913398 22799 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:13.967072 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:13.908308 22498 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:13.963110 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:13.934872 22564 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:13.975050 22384 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:13.992049 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52680.4us
I20260709 12:18:13.933169 22493 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.004580 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:14.005862 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:14.006400 21035 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.009234 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.987317 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:13.945653 22731 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:13.941860 22783 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:18:13.998003 22832 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.022259 22564 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:14.036500 21043 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:14.045766 21042 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:14.047894 22838 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.200s	user 0.000s	sys 0.002s
I20260709 12:18:14.055100 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:14.061964 20256 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:13.982949 22799 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.056774 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:14.019724 22829 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:18:14.073284 20321 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:14.019951 22848 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:14.083827 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 164267us
I20260709 12:18:14.089749 20247 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:14.021246 22842 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:18:14.071388 22564 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.084739 21034 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.107733 22846 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.107882 22644 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.111881 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:14.112835 22843 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:14.113210 22843 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.113540 22843 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:14.115499 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:14.116197 22835 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.265s	user 0.004s	sys 0.000s
I20260709 12:18:14.116479 22855 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:14.117070 22855 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:14.117463 22830 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:18:14.085006 22848 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:14.156046 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.101328 22833 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:18:14.090762 22850 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.102475 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 157140us
I20260709 12:18:14.162364 21038 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:14.163631 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 196692us
I20260709 12:18:14.091774 22852 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:14.088619 22132 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 12:18:14.180517 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 62113.7us
I20260709 12:18:14.170356 22644 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:14.240566 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:14.246786 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74711us
W20260709 12:18:14.248096 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54165.5us
I20260709 12:18:14.155524 22848 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:14.258937 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:14.260103 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 62383.3us
I20260709 12:18:14.245914 22644 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.262122 22844 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:14.242928 22800 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.001s
I20260709 12:18:14.273916 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:14.241850 22613 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.312328 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:14.325183 20252 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:14.324296 22800 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.239473 22727 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:18:14.338656 22841 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:14.343050 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.344830 20249 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:14.346038 21039 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4.
I20260709 12:18:14.192549 22850 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:14.371694 22849 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:18:14.371802 22644 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:14.372387 22853 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:18:14.374891 22860 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
W20260709 12:18:14.338639 22758 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.000s
W20260709 12:18:14.380148 22851 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:18:14.380632 22758 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:14.407263 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 406571us
I20260709 12:18:14.111065 22834 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:14.415649 22850 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:14.371822 22863 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:18:14.416373 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:14.349157 22852 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:14.348779 22841 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:14.118145 22855 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.383975 22742 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:14.441524 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:14.274442 22866 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 12:18:14.418306 22731 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:14.451525 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 202496us
I20260709 12:18:14.486043 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:14.492403 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50993.2us
I20260709 12:18:14.492573 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:14.493220 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:14.446107 22859 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:14.445272 22528 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:14.450273 22783 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:14.504254 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 243437us
I20260709 12:18:14.488092 22564 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.444473 22384 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:14.514115 22384 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:14.514525 22832 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.516935 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:14.495724 22799 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.484519 22742 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.515544 22866 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:14.453425 22844 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:18:14.500412 22528 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:14.524641 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:14.519765 22831 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 12:18:14.507261 22727 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.503883 22730 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:18:14.496946 22841 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.520169 22839 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.523217 22860 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:14.577767 20247 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:14.574457 20249 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:14.543552 22850 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:14.581818 22873 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:14.584658 21035 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 12:18:14.585078 21035 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:14.517916 22783 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.548972 22727 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.503363 22852 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.594053 21040 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:14.594964 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72853.2us
I20260709 12:18:14.589246 22727 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.589250 22783 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.549633 22831 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.595969 22842 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.580018 22872 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:14.600708 22846 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:14.648101 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52287.5us
I20260709 12:18:14.602355 22758 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:14.647282 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 262848us
I20260709 12:18:14.649421 20322 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:18:14.652264 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:14.648121 22864 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:18:14.672830 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 92625.2us
I20260709 12:18:14.672322 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:14.675022 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 182536us
W20260709 12:18:14.678383 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 176133us
I20260709 12:18:14.680284 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:14.680972 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.669529 22860 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:14.699242 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:14.702889 22869 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:14.703333 22869 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:14.704066 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.704249 22869 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.704913 20179 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:14.704950 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.705457 22869 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:14.706072 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.706269 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:14.706691 20179 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:14.706868 20171 raft_consensus.cc:2376] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5. Re-sending same reply.
I20260709 12:18:14.707882 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.707978 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.709435 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.710426 22493 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.710803 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.712965 22721 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.713356 22721 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.713471 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:14.713779 22721 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.716234 22799 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.716672 22799 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.716506 22870 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:14.717052 22799 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.718303 22783 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:14.718670 20172 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:14.718729 22783 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:14.719743 22866 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:14.719799 22783 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.720281 22866 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:14.721320 22783 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.721474 22866 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.722919 22866 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.647814 22528 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.724382 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.725625 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.730655 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.736476 20173 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
W20260709 12:18:14.737332 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58238.1us
W20260709 12:18:14.723497 22871 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:18:14.761128 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:14.763067 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.768523 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.701066 22860 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.776307 22860 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:14.700639 22384 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:14.779927 22384 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.781380 22727 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.782557 22384 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:14.786550 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 87424.4us
I20260709 12:18:14.785501 22727 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:14.803155 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.803781 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50613.7us
I20260709 12:18:14.724014 22742 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.736975 22800 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.763882 22842 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:14.806891 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45889us
W20260709 12:18:14.814182 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59077.3us
W20260709 12:18:14.818320 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 103118us
I20260709 12:18:14.820648 20321 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:14.823597 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:14.824519 20255 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:14.825979 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:14.828104 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.831480 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:14.803846 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:14.834239 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:14.834797 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:14.809235 22832 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:14.764487 22834 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:18:14.809100 22877 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:14.841632 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:14.844775 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:14.850479 20179 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:14.850917 20179 pending_rounds.cc:85] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 3
I20260709 12:18:14.851202 20179 pending_rounds.cc:107] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:18:14.851434 20179 raft_consensus.cc:2889] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:14.853539 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:14.853865 20179 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:14.855168 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:14.850600 22800 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:14.816696 22842 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:14.856755 20249 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:14.855408 21034 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.700s	user 0.006s	sys 0.002s
I20260709 12:18:14.862147 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:14.860215 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:14.864825 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46152.2us
I20260709 12:18:14.822094 22742 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:14.833170 22841 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:14.865768 20325 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.866218 20330 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:14.871809 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:14.872879 20323 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:14.872988 22865 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 12:18:14.838398 22852 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.865131 22842 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.884406 20327 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:14.873891 22831 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.888360 22761 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:14.902372 20179 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:14.887979 22886 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:14.891937 20294 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.747s (SENT)
I20260709 12:18:14.891795 20327 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:14.907029 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:14.904994 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 766) took 1198 ms. Trace:
I20260709 12:18:14.902804 20179 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:14.875648 22845 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.930s	user 0.013s	sys 0.000s
I20260709 12:18:14.908404 21039 rpcz_store.cc:276] 0709 12:18:13.706793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.707743 (+   950us) service_pool.cc:224] Handling call
0709 12:18:13.881571 (+173828us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:18:14.898391 (+1016820us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54004ad154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:14.904910 (+  6519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096052864}
I20260709 12:18:14.833319 22875 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:18:14.865424 22885 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:14.913007 22885 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:14.913535 22885 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.913646 20179 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.911978 22845 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.906136 22761 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:14.918087 22845 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:14.917912 22761 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.906538 22730 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.919180 20255 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:14.920178 22730 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:14.922289 22857 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:14.922910 22730 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:14.924180 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:14.926416 21039 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:14.928342 22882 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:18:14.929493 21034 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:18:14.931851 22848 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.005s
I20260709 12:18:14.932297 22848 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.934655 21042 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:14.936650 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 764) took 1246 ms. Trace:
I20260709 12:18:14.937044 21038 rpcz_store.cc:276] 0709 12:18:13.689967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.695283 (+  5316us) service_pool.cc:224] Handling call
0709 12:18:14.003769 (+308486us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:18:14.003965 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.172874 (+168909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.936401 (+763527us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54005da054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:14.936585 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406844672}
I20260709 12:18:14.939487 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:14.915421 20179 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.907706 20327 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.955397 20327 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.886695 22721 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.889120 22742 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:14.968328 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 390) took 1047 ms. Trace:
W20260709 12:18:14.969007 22888 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:18:14.971513 20322 rpcz_store.cc:276] 0709 12:18:13.920548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.920803 (+   255us) service_pool.cc:224] Handling call
0709 12:18:13.934112 (+ 13309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:14.663825 (+729713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.967957 (+304132us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54003980d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:14.968235 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644386048}
I20260709 12:18:14.973403 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:14.923465 22730 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:14.957772 22844 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.983151 22845 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.990605 22800 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.040023 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.041131 20322 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:15.023111 22860 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.024578 22895 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:15.013584 22613 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:15.027766 22878 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:15.029549 22843 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.916s	user 0.007s	sys 0.007s
I20260709 12:18:15.013177 22844 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:18:15.031929 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.031771 22845 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.032732 22799 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.033855 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:14.941741 22885 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:15.021070 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 156448us
W20260709 12:18:15.071941 20219 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.610s (SENT)
I20260709 12:18:15.117440 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.117337 20321 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:18:15.123934 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:15.126281 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:15.126020 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.127530 20330 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:15.128804 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:15.128446 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56552.1us
W20260709 12:18:15.130630 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 169550us
I20260709 12:18:15.130888 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 514) took 1293 ms. Trace:
I20260709 12:18:15.131668 22761 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.072892 22848 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:15.115748 22731 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.133085 22799 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:15.070086 22800 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.133792 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:15.141007 20219 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.695s (SENT)
I20260709 12:18:15.128952 22613 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.135066 20250 rpcz_store.cc:276] 0709 12:18:13.837681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.838063 (+   382us) service_pool.cc:224] Handling call
0709 12:18:13.863267 (+ 25204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.892944 (+ 29677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.892980 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.909413 (+ 16433us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.170783 (+261370us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:14.170847 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.170965 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.872380 (+701415us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:14.974272 (+101892us) raft_consensus.cc:1685] finished
0709 12:18:14.974296 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.130815 (+156519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19788,"raft.queue_time_us":16606,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4790,"spinlock_wait_cycles":4930304,"thread_start_us":195698,"threads_started":1,"wal-append.queue_time_us":484380}
I20260709 12:18:15.157177 22613 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:15.134732 22731 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.159904 22731 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:15.164045 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.165861 20177 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:15.166201 20177 pending_rounds.cc:85] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 3
I20260709 12:18:15.166424 20177 pending_rounds.cc:107] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:18:15.166641 20177 raft_consensus.cc:2889] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:15.171310 22860 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.172503 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:15.173359 20324 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:15.188164 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.188553 20327 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:18:15.190474 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.195935 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.084138 21036 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:15.188964 20329 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:15.188980 20327 pending_rounds.cc:85] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 5
I20260709 12:18:15.208889 20327 pending_rounds.cc:107] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:15.209237 20327 raft_consensus.cc:2889] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:15.209995 21008 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.937s (SENT)
I20260709 12:18:15.202543 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:15.213140 20177 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:15.129202 22682 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.208511 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:15.216220 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.217568 20330 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:15.154333 22848 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.135829 22536 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.219583 20177 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:15.083990 22895 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.227938 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:15.230006 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:15.233153 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:15.233664 20322 raft_consensus.cc:2376] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3. Re-sending same reply.
I20260709 12:18:15.235172 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.144361 22843 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.236048 20327 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:15.232177 20177 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.238487 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.244292 21039 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:15.254119 20177 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.235812 22872 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.258373 20322 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:15.263635 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 776) took 1548 ms. Trace:
I20260709 12:18:15.264060 21041 rpcz_store.cc:276] 0709 12:18:13.714796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.032954 (+318158us) service_pool.cc:224] Handling call
0709 12:18:14.033383 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.177607 (+144224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.177642 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:14.177686 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:14.177718 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.263370 (+1085652us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540056e354. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:15.263414 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.263546 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331155840}
I20260709 12:18:15.265815 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 772) took 1552 ms. Trace:
I20260709 12:18:15.266204 21034 rpcz_store.cc:276] 0709 12:18:13.713393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.924572 (+211179us) service_pool.cc:224] Handling call
0709 12:18:15.265624 (+1341052us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b540047b654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:15.265755 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153551744}
I20260709 12:18:15.269696 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 775) took 1555 ms. Trace:
I20260709 12:18:15.270078 21040 rpcz_store.cc:276] 0709 12:18:13.714416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.010915 (+296499us) service_pool.cc:224] Handling call
0709 12:18:14.589863 (+578948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.597986 (+  8123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.269492 (+671506us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54007e36d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:15.269638 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324189952}
I20260709 12:18:15.274178 22885 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:15.276192 22844 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:15.283455 20325 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
W20260709 12:18:15.280180 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.302990 20179 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:15.302608 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:15.306598 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:15.278998 22783 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.002s
I20260709 12:18:15.300150 22846 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:15.300364 21034 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:15.290030 22442 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.324561 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:15.322990 20176 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:15.329070 20325 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.278106 22799 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:18:15.257565 22872 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:15.312608 22831 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:15.300897 22848 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:18:15.344157 20219 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.888s (SENT)
W20260709 12:18:15.346613 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.315511 22897 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.327275 22742 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.329775 22758 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:15.334918 22872 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:15.360623 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.363060 20325 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:15.321081 22731 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:18:15.327104 22842 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.373916 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.374874 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:15.395627 20177 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:18:15.361948 22848 consensus_queue.cc:1243] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:15.382995 20252 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:15.410574 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.335741 22442 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:15.410920 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54286.1us
I20260709 12:18:15.417832 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:15.419020 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.419629 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.150s (SENT)
I20260709 12:18:15.419760 22783 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.420373 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.419309 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:15.421975 22493 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.409756 20177 pending_rounds.cc:85] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 3
I20260709 12:18:15.423243 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.426431 20177 pending_rounds.cc:107] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 12:18:15.424520 20219 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.979s (SENT)
I20260709 12:18:15.424863 20328 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:15.407743 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.427711 20325 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:15.428313 20177 raft_consensus.cc:2889] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:15.431547 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:15.386191 22845 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.437759 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.438426 20252 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:15.437780 20250 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.437872 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.443548 21038 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.442505 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:15.434366 22899 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:18:15.425597 22848 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:15.459012 22848 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:15.459477 22442 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.460338 22442 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:15.460038 22848 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.443190 22800 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:15.461506 22848 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.460889 22442 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.457517 22895 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.429137 22493 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:15.464231 22493 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.464345 22442 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.467941 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:15.471647 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.473389 22907 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:18:15.475678 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:15.476929 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.477749 20325 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:15.435207 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.438726 22885 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.487061 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.495834 20249 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:18:15.487661 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:15.496486 20327 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.444056 22908 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.453744 22878 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:15.484779 22498 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:18:15.499637 22493 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.527974 22493 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:15.530229 22861 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 1.111s	user 0.001s	sys 0.003s
W20260709 12:18:15.502713 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.222s (SENT)
I20260709 12:18:15.531435 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.533916 22842 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:15.507951 20327 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
W20260709 12:18:15.512540 22911 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:15.513260 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.496877 22913 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:15.436460 22783 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:18:15.598448 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:15.599928 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.522321 21034 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:15.487491 22843 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:15.525750 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:15.568907 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.548175 22908 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.597275 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:15.667838 20325 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:15.632954 20327 raft_consensus.cc:2376] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5. Re-sending same reply.
I20260709 12:18:15.669763 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.641396 20329 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.633260 20249 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
W20260709 12:18:15.648444 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 145744us
I20260709 12:18:15.672804 21040 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:18:15.675909 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.660437 22913 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:15.681332 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:15.667469 22799 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:15.654316 20219 leader_election.cc:336] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 2.088s (SENT)
I20260709 12:18:15.687147 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:15.657236 20220 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.594s (SENT)
I20260709 12:18:15.659771 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.666195 21043 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:15.653416 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.688386 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.693567 21036 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:15.698191 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.698815 22916 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.699015 21038 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.703728 20325 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.708755 20330 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.712725 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.713523 20253 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 1.
I20260709 12:18:15.671255 22758 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:15.711476 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:15.717262 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60013.4us
W20260709 12:18:15.722625 20220 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.610s (SENT)
I20260709 12:18:15.723284 20220 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:15.718842 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64576.4us
I20260709 12:18:15.724860 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:15.729400 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.729136 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.725611 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:15.729452 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.731761 20253 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.726806 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:15.736331 20249 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:15.735975 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:15.741050 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.741541 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:15.744004 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.695s (SENT)
I20260709 12:18:15.744449 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.745846 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:15.748162 20174 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:15.748665 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.698071 22872 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.752543 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.729800 22908 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.725641 22845 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:15.730479 22885 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.756623 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.766882 20173 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:15.753387 20172 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.764766 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:15.691596 22799 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.734653 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:15.771310 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.743386 22783 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.751281 22916 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.784425 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.784767 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.742647 22922 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.779326 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.820888 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.822337 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.823041 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.782724 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.824015 20180 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:15.825078 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.826349 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.787940 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.828645 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.801553 20171 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.793309 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.833818 21038 raft_consensus.cc:1813] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Handling vote request from an unknown peer f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.834475 21038 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:15.802038 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.835790 21034 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.837170 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.838116 20178 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:15.839058 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.773291 22918 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.784086 22913 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.725268 22917 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:18:15.844653 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.805958 22758 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.850807 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:15.807839 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:15.810457 21042 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:15.783810 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:15.845818 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:15.854465 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 110476us
I20260709 12:18:15.847023 22799 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:15.776490 22885 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.849149 20178 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:15.784797 22916 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.851680 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.806936 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.846688 22922 raft_consensus.cc:2764] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:15.860783 20174 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:15.860950 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77256.7us
W20260709 12:18:15.861423 20220 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.888s (SENT)
I20260709 12:18:15.806430 22528 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:15.867070 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.878147 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.879421 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.879000 20253 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:15.863488 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.864514 22917 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.799746 22783 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:15.801487 22866 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:18:15.881614 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:15.881644 20220 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.954s (SENT)
I20260709 12:18:15.884212 20178 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:15.882073 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.890779 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.891131 20180 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.865031 22845 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.893556 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.865319 22916 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.897047 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.861763 20171 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:15.863077 21036 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:15.892297 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:15.909732 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.910321 20253 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:15.911154 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.899701 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.902298 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.903759 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.905658 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.913358 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.888103 22799 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.923120 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.909996 20177 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:15.923401 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.887682 22917 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:15.925657 20179 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:15.928018 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.929425 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.929736 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.930101 20178 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:15.926090 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:15.933831 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 170007us
I20260709 12:18:15.935670 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:15.937479 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.938074 20249 raft_consensus.cc:1813] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Handling vote request from an unknown peer f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:15.937959 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.938637 20249 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:15.937381 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.939285 20178 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:15.936784 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:15.940712 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 399) took 1097 ms. Trace:
I20260709 12:18:15.941069 20328 rpcz_store.cc:276] 0709 12:18:14.843250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.843392 (+   142us) service_pool.cc:224] Handling call
0709 12:18:14.845132 (+  1740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:15.429507 (+584375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.940443 (+510936us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540003c854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:15.940637 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316297984}
I20260709 12:18:15.948118 21041 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:15.952811 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:15.951751 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70158.9us
W20260709 12:18:15.954541 20220 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.979s (SENT)
I20260709 12:18:15.927172 22917 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.960419 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:15.962424 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.924943 22924 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.932952 22845 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:15.944937 22922 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.969549 22922 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.970108 22922 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.914769 22878 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:18:15.976315 22878 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:15.976867 22878 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:15.948951 22856 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:15.983553 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:15.990598 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:15.991405 20249 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.978405 22878 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:15.928725 22498 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:18:15.988451 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:15.968597 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:16.000566 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53490.7us
I20260709 12:18:15.982023 22925 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:16.002722 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 94486.9us
W20260709 12:18:15.995709 22921 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:18:16.004807 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:16.006717 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52234.5us
I20260709 12:18:15.988163 22856 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:16.020334 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.020440 20220 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.111s (SENT)
I20260709 12:18:16.025282 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.006894 22925 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:16.004918 22872 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.029151 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:16.032049 22920 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:18:16.032541 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:16.033304 20171 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:16.020025 22876 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:16.059814 22876 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:16.060272 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 395) took 1227 ms. Trace:
I20260709 12:18:16.060926 22876 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.062086 22876 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.063897 22935 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.064466 22935 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.066792 22935 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:16.068336 22926 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:16.035641 22885 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.023272 22931 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.071156 22885 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:18:16.074997 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:16.040355 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:16.080320 20171 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.081226 20179 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:16.041275 22384 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:16.045764 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:16.082034 22384 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:16.082366 20247 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:16.082396 20179 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.046417 22764 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:16.083671 22783 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.029094 22878 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.093566 22700 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.094347 22700 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.027010 22498 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:16.096153 22498 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:16.097190 22498 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.096585 22922 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.098717 22498 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.104151 22700 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.035285 22925 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.077010 20173 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:16.104002 22856 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.104874 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 366) took 1398 ms. Trace:
W20260709 12:18:16.038805 22923 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:18:16.060706 20321 rpcz_store.cc:276] 0709 12:18:14.833197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.840105 (+  6908us) service_pool.cc:224] Handling call
0709 12:18:14.840529 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:15.124858 (+284329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.059981 (+935123us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540022e7d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:16.060208 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635676416}
I20260709 12:18:16.048631 20256 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:16.113902 20176 rpcz_store.cc:276] 0709 12:18:14.706750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.906266 (+199516us) service_pool.cc:224] Handling call
0709 12:18:16.104700 (+1198434us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400236ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:16.104810 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880378240}
I20260709 12:18:16.122139 20171 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:16.123334 20179 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:16.126348 21038 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
W20260709 12:18:16.131628 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.135824 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 527) took 1306 ms. Trace:
I20260709 12:18:16.136360 20255 rpcz_store.cc:276] 0709 12:18:14.828910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.831179 (+  2269us) service_pool.cc:224] Handling call
0709 12:18:16.135552 (+1304373us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b54003d86d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:16.135723 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199600512}
I20260709 12:18:16.140767 22916 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:16.144086 20247 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:18:16.146648 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.147840 20253 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:16.148016 20172 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:16.154218 20180 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:18:16.164237 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:16.164503 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:16.165871 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:16.166882 21037 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 4 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:18:16.167842 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.117408 22924 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.168869 22536 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:16.169358 22536 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:16.147415 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.171386 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.116024 22442 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:16.181145 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 160751us
I20260709 12:18:16.181247 20249 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:16.188380 20329 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:16.188655 20321 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.182296 22442 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.194077 20329 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:16.194416 22442 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.195544 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.180152 22384 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.209283 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:16.210222 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 201619us
I20260709 12:18:16.210731 20321 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:16.212505 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.212564 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:16.214248 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 169974us
I20260709 12:18:16.217563 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.218257 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.218503 20250 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 4 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:18:16.216881 20253 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:16.225033 20321 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:16.207826 22929 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:18:16.229247 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.235394 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.236181 20321 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:16.236507 20251 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:16.238114 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:16.185187 22917 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.240430 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.210803 22700 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.210253 22442 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:16.215405 22384 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:16.248345 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.218433 22878 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.248423 20323 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:16.234916 22493 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:16.241164 22901 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.254019 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.254456 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.255228 20329 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:16.255532 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.248255 21034 raft_consensus.cc:2410] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:16.259642 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.260874 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.225672 22855 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:18:16.262559 22845 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.277086 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:16.262591 22493 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:16.264174 22906 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.835s	user 0.004s	sys 0.001s
I20260709 12:18:16.256387 22938 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:16.232110 22936 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:18:16.282138 22936 consensus_queue.cc:1243] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:16.282701 22936 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:16.283038 22936 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:16.283855 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.284389 22721 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.284055 22936 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.268690 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.285425 20251 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:16.287946 20324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2559) took 1289 ms (client timeout 1609 ms). Trace:
I20260709 12:18:16.271015 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.289739 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.290622 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.291707 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.292343 20247 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:16.292698 22876 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:16.293109 22876 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.293447 22876 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.294297 20326 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:16.294924 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2561) took 1295 ms. Trace:
I20260709 12:18:16.295224 20326 rpcz_store.cc:276] 0709 12:18:14.999320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.999828 (+   508us) service_pool.cc:224] Handling call
0709 12:18:15.024275 (+ 24447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.294130 (+1269855us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b540028b2a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefa1c0 00007f5ddaefb231 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c
0709 12:18:16.294680 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.294870 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42658048}
I20260709 12:18:16.295996 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.296412 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.296739 20330 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:16.296792 22843 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:16.297338 22843 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:16.297788 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.298172 22843 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.298877 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.299331 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.254060 22384 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.299779 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.300279 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.300956 22908 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:16.301606 22384 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.302115 20325 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:18:16.292207 22901 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.256207 21035 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:16.251511 22878 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:16.284494 20252 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:18:16.288357 20324 rpcz_store.cc:269] 0709 12:18:14.998603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.998724 (+   121us) service_pool.cc:224] Handling call
0709 12:18:16.287772 (+1289048us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b5400328554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:16.287886 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103875840}
I20260709 12:18:16.305151 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.277760 20255 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.279857 22845 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.327881 22845 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.328838 22878 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.329253 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1974) took 1537 ms. Trace:
I20260709 12:18:16.280372 22870 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.329653 20175 rpcz_store.cc:276] 0709 12:18:14.791613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.791802 (+   189us) service_pool.cc:224] Handling call
0709 12:18:14.813664 (+ 21862us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:14.841287 (+ 27623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.841328 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:14.852943 (+ 11615us) log.cc:844] Serialized 52 byte log entry
0709 12:18:15.269591 (+416648us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b4800080058. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:18:15.697692 (+428101us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18003b1640. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:18:15.887217 (+189525us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:15.899393 (+ 12176us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.094956 (+195563us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18003b1640. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:16.139980 (+ 45024us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b18003b1640. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf 00007f5ddaf12038
0709 12:18:16.140262 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.140538 (+   276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.140643 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.329036 (+188393us) raft_consensus.cc:1685] finished
0709 12:18:16.329060 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.329195 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220398,"prepare.queue_time_us":256778,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2881,"raft.queue_time_us":38565,"raft.run_cpu_time_us":3978,"raft.run_wall_time_us":420943,"spinlock_wait_cycles":71537280,"thread_start_us":189307,"threads_started":1,"wal-append.queue_time_us":1074461}
I20260709 12:18:16.331893 22935 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:16.332306 22935 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.278074 22758 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.332680 22935 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.309366 22843 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.336089 22493 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.338335 22908 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:16.257562 22730 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:18:16.339501 22886 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:16.339921 22886 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:16.339663 22925 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.341048 22917 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:16.340879 22886 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.342382 22925 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.343113 22917 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:16.344169 22918 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:16.344553 22918 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:16.345357 22918 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.343142 20248 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.250974 22700 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.349409 22700 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:16.349841 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.349911 22700 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.350730 22918 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.350509 22700 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:16.351300 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 91476.3us
I20260709 12:18:16.353348 22886 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.353551 22831 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:16.265597 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:16.355077 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 89549us
I20260709 12:18:16.355032 22831 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:16.252429 22442 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.357407 22442 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.357935 22442 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.277491 21036 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:16.361195 21040 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.361280 22916 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.362639 22922 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.365116 22936 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.352118 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.368970 22935 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.369462 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.370760 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.371809 22922 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.372463 22922 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.372846 22856 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.378376 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.378973 20324 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:16.379920 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.307765 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.218915 22536 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.318401 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.378854 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.381260 20325 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:16.310847 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.351238 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44038.5us
I20260709 12:18:16.311383 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.352806 20329 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:16.320107 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:16.382627 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.382663 20251 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.384135 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:16.385169 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77495.9us
I20260709 12:18:16.381474 20330 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:16.386674 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:16.388388 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.384002 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.396652 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:16.397454 21040 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.394934 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:16.400233 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.406615 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:16.408187 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.392719 20323 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.144850 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.417945 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:16.417842 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:16.419229 21035 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:16.429339 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:16.390223 22934 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.391224 22885 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:16.393510 22846 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.437002 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:16.434955 22872 raft_consensus.cc:2764] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:16.446014 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:16.446530 22528 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.427588 22916 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.452105 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:16.432250 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.479907 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:16.480562 20248 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.433487 22939 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.433244 22859 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.427923 22783 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.461367 22878 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.478389 20255 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:16.394618 22742 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:18:16.505784 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 151595us
I20260709 12:18:16.516345 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:16.442322 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:16.505466 20251 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:16.405118 22831 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:18:16.471439 22885 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:16.518527 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76304.4us
I20260709 12:18:16.403157 22730 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 12:18:16.520301 20073 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 305) took 14693 ms (client timeout 15000 ms). Trace:
I20260709 12:18:16.427518 22922 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:18:16.542539 20248 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:16.518014 22859 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:16.524957 20073 rpcz_store.cc:269] 0709 12:18:01.822509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.822875 (+   366us) service_pool.cc:224] Handling call
0709 12:18:02.129791 (+306916us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5de0cb6e9c 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:18:16.515477 (+14385686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:13.917735 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:14.100124 (+182389us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:14.119005 (+ 18881us) write_op.cc:435] Acquired schema lock
0709 12:18:14.154720 (+ 35715us) tablet.cc:662] Decoding operations
0709 12:18:14.522283 (+367563us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:14.548159 (+ 25876us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:14.569963 (+ 21804us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:18:14.723911 (+153948us) tablet.cc:701] Row locks acquired
0709 12:18:14.723963 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:18:14.724147 (+   184us) write_op.cc:270] Start()
0709 12:18:14.724310 (+   163us) write_op.cc:276] Timestamp: P: 1783599494724083 usec, L: 0
0709 12:18:14.724352 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:18:14.725127 (+   775us) log.cc:844] Serialized 2865 byte log entry
0709 12:18:15.475649 (+750522us) op_driver.cc:464] REPLICATION: finished
0709 12:18:15.874828 (+399179us) write_op.cc:301] APPLY: starting
0709 12:18:15.874959 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:15.909692 (+ 34733us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:15.934106 (+ 24414us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:15.935385 (+  1279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:15.935721 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:18:15.935790 (+    69us) write_op.cc:312] APPLY: finished
0709 12:18:15.936181 (+   391us) log.cc:844] Serialized 59 byte log entry
0709 12:18:15.936391 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:15.936526 (+   135us) write_op.cc:454] Released schema lock
0709 12:18:15.936583 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:15.968520 (+ 31937us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:15.984165 (+ 15645us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10270,"reported_tablets":18,"spinlock_wait_cycles":322064640,"child_traces":[["op",{"apply.queue_time_us":388791,"apply.run_cpu_time_us":3958,"apply.run_wall_time_us":76429,"num_ops":7,"prepare.queue_time_us":235973,"prepare.run_cpu_time_us":14214,"prepare.run_wall_time_us":892881,"raft.queue_time_us":442081,"raft.run_cpu_time_us":22130,"raft.run_wall_time_us":258729,"replication_time_us":751122,"thread_start_us":680676,"threads_started":4,"wal-append.queue_time_us":109338}]]}
I20260709 12:18:16.553718 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.585850 20329 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.551443 22442 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:18:16.521850 22846 raft_consensus.cc:2764] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:16.559408 22536 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.567260 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.599319 21040 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:16.568795 20075 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 5, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.570804 22876 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.572147 22700 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.519673 22528 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:16.524843 22885 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.524785 22872 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.532094 21035 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:16.584220 22935 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.575618 22742 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:16.576637 22870 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:16.577381 20219 leader_election.cc:336] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.610s (SENT)
W20260709 12:18:16.587008 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 154841us
I20260709 12:18:16.569502 22878 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:16.601172 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.602420 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86181.8us
I20260709 12:18:16.585772 22859 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.583379 22783 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.657491 22783 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:16.573740 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.627821 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.606848 20330 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:16.600775 20075 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.640103 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:16.656181 22916 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:16.605450 22954 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.666914 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 89581.6us
I20260709 12:18:16.667773 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:16.602960 22730 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.603040 22918 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:16.672379 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.663245 20075 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 3 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.674083 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.689038 20329 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:16.635613 22742 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:16.647634 22935 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.660604 22859 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.693392 20075 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, term changed from 1 to 3, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to <none>, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.669463 22916 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:16.688349 22938 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.639969 22528 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.712829 20075 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 3 to 4, term changed from 2 to 4, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to <none>, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.747720 20075 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.750015 20075 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.605748 22940 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.690332 22954 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:16.723443 22955 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:16.725526 22498 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.008s
W20260709 12:18:16.726996 22945 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:18:16.735939 22956 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:16.696317 22759 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:16.715867 22935 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.785159 20326 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:18:16.792919 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.793191 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.758968 20075 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:16.763823 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.672564 22730 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.744938 21035 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.740605 22783 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.710724 22870 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:18:16.795742 20075 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 6, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.756201 22918 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:16.790825 22948 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:18:16.793943 20251 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
W20260709 12:18:16.781677 22947 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.005s
W20260709 12:18:16.810698 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 373863us
W20260709 12:18:16.790140 22949 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:18:16.853858 20219 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.609s (SENT)
I20260709 12:18:16.864672 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.852025 20075 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 4, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.779645 22934 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.806291 22759 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:16.868635 20075 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.722113 22742 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.848342 22498 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.778637 22940 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:16.810317 22956 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:16.872581 20075 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.867785 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.880174 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.782284 22845 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:16.894248 20219 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.641s (SENT)
I20260709 12:18:16.894897 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:16.825167 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:16.896095 20329 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:16.899204 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:16.789439 22935 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.807199 22730 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:16.907928 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 238992us
I20260709 12:18:16.881244 22940 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.908862 20075 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 4, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.894786 22936 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:16.919556 20075 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.900957 22721 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.900365 22783 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:16.874940 22934 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.921633 20075 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.905046 22384 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.875955 22953 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:16.908950 22742 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.901679 22886 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:18:16.884245 22878 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:18:16.895162 22939 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:18:16.930725 22843 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 12:18:16.935240 20075 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.881595 22498 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:16.932816 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:16.917925 22876 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:16.923025 22938 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:16.946471 20251 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:16.933818 22493 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:16.934170 22783 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.948437 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49341.7us
I20260709 12:18:16.932231 22936 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:16.935743 22528 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:16.927049 22721 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.948848 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56265.1us
I20260709 12:18:16.949765 20329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:16.949156 20321 raft_consensus.cc:2410] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:16.950971 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:16.960974 20075 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 1 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:16.956637 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:16.962061 20329 raft_consensus.cc:606] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:16.962450 20329 raft_consensus.cc:614] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:16.958439 20179 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:16.928608 22943 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:18:16.961776 20177 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:16.953166 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50641.3us
I20260709 12:18:16.969496 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:16.975499 20178 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:16.975989 20178 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:16.977240 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:16.978179 20171 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:16.949941 22783 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.924321 22958 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:16.980733 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:16.981923 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:16.953164 22954 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:16.983827 20176 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.984504 20171 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:16.931425 22918 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:16.986755 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:16.964116 22721 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.935217 22759 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:17.028085 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 360391us
I20260709 12:18:16.951627 22938 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:16.999074 20178 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.027731 20323 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.989432 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:17.032375 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.963397 22964 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:18:17.038486 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.043334 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.040135 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.044602 20174 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:17.035300 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.041172 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:17.046594 20171 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:17.041471 20251 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:17.050220 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.051179 20171 raft_consensus.cc:2410] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:18:17.051735 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.035148 22843 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.055709 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.056907 20173 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:18:17.054517 20178 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:17.045622 20179 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:17.059309 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.067723 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.068354 20251 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:17.068579 20323 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:17.042224 22958 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:17.070426 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:17.073800 22876 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:17.074277 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:16.976783 22956 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.086032 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.069417 21036 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:17.074353 22876 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:17.090317 20178 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:18:17.092669 20178 pending_rounds.cc:85] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 4
I20260709 12:18:17.092525 22876 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.093118 20178 pending_rounds.cc:107] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:18:17.093623 20178 raft_consensus.cc:2889] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:17.073315 22958 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:17.032866 22916 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.065475 22843 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.109853 20295 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.087131 22870 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:17.115324 22946 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:18:17.115799 22954 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.060636 22936 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.079422 22536 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:18:17.125476 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.126636 20329 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
W20260709 12:18:17.109990 22951 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:18:17.104905 22764 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:17.135706 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.139523 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.141264 20172 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:18:17.141675 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:17.146855 22958 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.148787 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:17.149422 20173 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.151994 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:17.153194 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:17.154029 20171 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:17.154758 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:17.155489 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.096575 22831 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:18:17.119385 22870 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.156312 20329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
W20260709 12:18:17.156617 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46861.7us
I20260709 12:18:17.172413 20176 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:17.172683 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:17.169867 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.174877 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:17.178046 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.180873 20178 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:17.162619 20173 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:17.168052 21042 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:18:17.129251 22758 raft_consensus.cc:670] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:17.169338 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:17.185223 20172 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.124387 22916 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:17.186187 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.121604 22934 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.190294 22939 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.190917 22939 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:17.193315 22939 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.195501 22939 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.195986 22939 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.198041 22939 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.198524 22939 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.199862 22953 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.200454 22953 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.200807 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.201396 22845 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:17.202114 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.202713 22953 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.203075 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.204492 22878 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:17.206444 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.198984 22939 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.202746 20254 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:17.208824 22939 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:17.127804 22564 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.211720 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:17.218557 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.171712 20329 raft_consensus.cc:606] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:18:17.223902 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61064.1us
I20260709 12:18:17.229616 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.230965 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:17.177927 22870 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.215001 22442 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.211129 22764 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:17.248693 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:17.224025 22953 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.187145 22922 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:18:17.234129 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:17.240362 22939 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.257510 20172 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:17.185417 22959 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:18:17.307126 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 76243.1us
W20260709 12:18:17.266146 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52320.6us
W20260709 12:18:17.311167 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.311424 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:17.305763 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 152688us
I20260709 12:18:17.225585 22564 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.330101 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.260382 22442 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.244807 22878 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:18:17.337677 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.268412 22682 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.298090 22975 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.359030 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.315691 22953 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.368455 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:17.334052 22972 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:18:17.335842 22442 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:17.372117 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 160495us
I20260709 12:18:17.384660 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.357076 22938 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.402943 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:17.318140 22974 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.364395 22758 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.374133 22901 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:17.420203 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.416182 22764 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:17.420804 22973 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:18:17.358047 22939 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:18:17.413811 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:17.418893 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60343.3us
I20260709 12:18:17.415311 22843 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:17.425323 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56950.8us
I20260709 12:18:17.368525 22682 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.427331 22934 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.370829 22994 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:17.444914 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.421909 22878 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:17.416630 22953 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.386381 22442 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.449966 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.452039 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:17.400368 22985 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.431784 22938 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:17.370995 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 141401us
I20260709 12:18:17.432307 22993 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.471917 22938 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.472343 22938 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.370662 22975 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.477388 22975 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:17.477684 22872 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.001s
I20260709 12:18:17.478111 22872 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:17.453090 22995 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.478770 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.478914 20177 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:17.436851 22758 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.467190 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.415688 22992 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:18:17.468277 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.468823 22682 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:17.468966 23003 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:17.454363 22967 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:17.462301 22878 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:17.469617 22994 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.438558 22974 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.479832 22843 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.479341 22995 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:17.448220 22493 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:17.481027 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:17.462977 22978 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 12:18:17.510241 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.507639 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:17.571615 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 64121.8us
I20260709 12:18:17.453876 22845 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.459882 22925 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:17.566907 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 85960.3us
I20260709 12:18:17.576562 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:17.487552 22872 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.584479 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:17.569979 22984 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:18:17.457331 22901 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:18:17.559453 22967 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:17.605113 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.607290 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.605468 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:17.605789 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:17.629325 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 434779us
I20260709 12:18:17.630090 20323 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:17.606252 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.606643 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.572618 22682 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.650396 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.652370 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.574853 22845 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:17.594226 22939 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:17.635097 22859 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.910s	user 0.016s	sys 0.007s
I20260709 12:18:17.668015 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:17.600852 22843 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:17.634593 22980 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:18:17.644435 22536 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.487241 22985 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.592785 22975 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:18:17.660454 22498 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.668371 22528 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:17.645871 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:17.562216 23003 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.730401 22564 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:17.783845 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 192159us
I20260709 12:18:17.760412 22528 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:17.816423 22996 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:18:17.816650 23001 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:18:17.817665 22950 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:17.817238 22528 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.818048 22950 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:17.818548 22528 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:17.819113 23000 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:18:17.820897 22981 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:18:17.822901 23009 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.778792 22498 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.823891 22498 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.825923 22498 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.751829 22493 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:17.829111 22742 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.885s	user 0.012s	sys 0.000s
I20260709 12:18:17.829926 22742 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:17.830498 22885 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.195s	user 0.013s	sys 0.001s
I20260709 12:18:17.830895 22885 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:17.832407 22998 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:18:17.833253 22885 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.833940 22885 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.834625 22730 consensus_meta.cc:287] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.004s
I20260709 12:18:17.834996 22995 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.731038 22859 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.837815 22859 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:17.747426 22536 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.839833 22845 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.840600 22536 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:17.841452 22845 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:17.829210 22783 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.001s
I20260709 12:18:17.834528 22885 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.851310 20329 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:17.850852 20172 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:17.856912 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.859150 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:17.860255 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.835148 22730 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:17.899626 20253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.028s	sys 0.012s
I20260709 12:18:17.743639 22878 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.913033 22982 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:17.914147 22982 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.914482 22982 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:17.915663 23007 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:17.916229 23007 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.917459 22885 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:17.918406 23007 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:17.921906 22730 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:17.905645 20253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.031s	sys 0.012s
I20260709 12:18:17.843823 22997 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:17.910466 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46876.1us
I20260709 12:18:17.852011 22994 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.924074 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:17.931644 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.861104 22759 raft_consensus.cc:2764] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:18:17.954698 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 324460us
W20260709 12:18:17.956295 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 371784us
I20260709 12:18:17.909418 22831 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:17.842967 22938 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.859543 22783 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.960986 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:17.948416 22758 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.954300 22969 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.961474 22721 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.935s	user 0.014s	sys 0.000s
I20260709 12:18:17.915315 22982 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.951532 22994 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.959988 22831 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.940500 22442 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:17.966719 22995 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.976715 22999 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.976248 22988 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.967383 22916 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.005s
I20260709 12:18:17.992973 22831 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.998723 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:18.000401 22986 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:18.000759 21037 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.000876 22856 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:18.001019 22986 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.001569 22856 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.004448 22856 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:17.997700 22999 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:17.990598 22969 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.003491 22986 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.000334 20248 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:17.999292 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.994107 22758 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:18.018165 20251 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:18.005417 22442 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.027895 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:18.033118 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.034467 20255 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:18.035260 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:17.992313 22721 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.035904 20252 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:18.037668 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.038122 20254 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:18.016494 22982 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.953119 22967 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:18:18.039822 23005 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:18:18.038873 23004 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:18:18.064754 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.006553 22988 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:18.065537 22940 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.138s	user 0.012s	sys 0.002s
I20260709 12:18:18.065979 22940 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.069051 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:18.069767 20254 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:18.045094 23003 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.023270 22758 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:18.048560 22970 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.967s	user 0.003s	sys 0.000s
I20260709 12:18:18.077042 22758 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:18.040202 22870 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.001s
I20260709 12:18:18.083021 22870 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:18.084640 22993 consensus_meta.cc:287] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.002s
I20260709 12:18:18.085521 22993 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:18.085587 22870 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.053738 22536 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:18.053862 22967 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.053738 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.087749 20330 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:18.054942 22682 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.096824 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.097862 22721 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.098052 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.098734 20330 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:18.098445 22831 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.101375 22943 raft_consensus.cc:1064] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:18:18.086804 22536 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.104830 22940 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:18.106104 22536 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:18.108985 22682 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.110260 22831 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:18.055390 23014 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:18:18.037104 23017 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.055440 23021 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.056000 22764 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:18.055943 23008 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:18.056975 23006 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:18:18.057283 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.119854 20323 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:18.045629 22974 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:18.058167 22954 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.942s	user 0.009s	sys 0.004s
I20260709 12:18:18.058035 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.058795 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.059521 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:18.124734 20326 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:18.060004 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.126449 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.060860 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.061610 22999 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.139238 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.139921 20172 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:18.140002 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.140569 20176 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:18.062716 23007 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.062774 22859 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.063505 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:18.064232 22783 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:18.152345 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 192163us
I20260709 12:18:18.053231 22994 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.052349 22938 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.082412 22988 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.088112 21035 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:18.092667 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:18.117713 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.111255 22682 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:18.166074 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
W20260709 12:18:18.166561 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74050.7us
I20260709 12:18:18.167011 20326 raft_consensus.cc:606] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:18.120922 22845 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:18.128654 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.132359 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:18.147267 20179 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:18.173452 20178 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:18.150113 22876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.008s	sys 0.015s
W20260709 12:18:18.152827 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.159814 20171 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:18.162343 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:18.162665 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:18.153484 20328 raft_consensus.cc:2376] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5. Re-sending same reply.
I20260709 12:18:18.122249 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:18.170825 20219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.590s (SENT) [suppressed 52 similar messages]
W20260709 12:18:18.149835 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.179024 20173 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.179600 20323 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.180757 21040 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:18.181661 22988 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.182159 22988 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.182607 22958 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.184320 22988 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:18.185490 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.185613 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.186846 22959 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:18.190423 20323 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
W20260709 12:18:18.192252 20219 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.830s (SENT)
I20260709 12:18:18.192791 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:18.194576 22993 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:18.196406 20219 leader_election.cc:336] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.983s (SENT)
I20260709 12:18:18.196887 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:18.197826 20173 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:18.198987 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:18.199889 20173 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:18.202593 22993 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.169744 23027 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.208217 22993 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:18.208370 23027 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.123093 23008 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.215094 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.144680 22954 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.240602 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:18.242429 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:18.229959 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.243916 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:18.178231 22876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.008s	sys 0.015s
I20260709 12:18:18.247751 20175 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:18.171656 22964 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.122720 22764 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.279982 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:18.273887 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.280618 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.250248 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:18.283355 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.300251 20253 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:18.224946 22700 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.119095 23017 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.249468 22988 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.169093 22859 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.175829 22999 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:18:18.250224 22994 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.120847 23021 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:18.333388 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.340044 20252 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:18.167904 23007 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.213781 22845 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.340873 20250 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:18.344278 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.303056 22974 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:18.348912 20330 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:18.345124 20250 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:18.350445 20247 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:18.141225 22943 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.352521 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:18.353220 21036 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:18.353276 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:18.353948 20326 raft_consensus.cc:606] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:18.354298 20326 raft_consensus.cc:614] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:18.354391 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:18.355746 22950 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.356896 22950 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.357539 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:18.358137 20326 raft_consensus.cc:606] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:18.358469 20326 raft_consensus.cc:614] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:18.359737 20324 raft_consensus.cc:2376] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4. Re-sending same reply.
I20260709 12:18:18.360442 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:18.360958 23021 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:18.362716 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.364252 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.364877 22876 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.365406 22876 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.367609 22876 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.306154 22700 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:18.384640 20251 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.384713 22700 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.387827 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.388537 23007 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:18.383430 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 197979us
I20260709 12:18:18.392918 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:18.393187 20251 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:18.393580 21042 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
I20260709 12:18:18.396426 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:18.397004 21042 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:18.397969 20321 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:18.403548 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.406517 22957 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:18.406911 22957 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:18.407779 22957 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.408860 22957 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.413367 22700 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.417541 20249 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:18.404202 20250 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:18.247525 22938 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:18.244766 22940 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.424969 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:18.425701 21038 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:18.427728 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:18.428578 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 182845us
I20260709 12:18:18.432163 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:18.349745 22974 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.297288 22993 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:18.436527 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:18.436709 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:18.382896 22988 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.449134 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:18.451622 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:18.438372 22384 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:18.445359 22974 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:18.451143 22876 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.471414 22876 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.472172 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.462608 22783 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:18.473559 22876 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.474843 21041 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:18.429940 23027 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.434499 22940 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.492830 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:18.517930 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:18.532626 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:18.533134 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:18.536760 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87903.2us
I20260709 12:18:18.609575 20325 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:18.612727 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.613193 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.609953 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:18.617038 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 124330us
W20260709 12:18:18.618700 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 100848us
I20260709 12:18:18.619679 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:18.446476 22999 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:18:18.437773 22938 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.473663 22783 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.614120 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:18.533974 20323 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:18.465186 22384 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.627942 20328 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:18.462358 23043 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:18.447077 22993 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.476984 22859 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.632617 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:18.620823 22759 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.536268 22954 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.655184 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:18.620532 22700 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:18.533921 21037 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:18.667433 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:18.669551 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:18.640614 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.667158 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:18.659873 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.671104 20178 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 1.
I20260709 12:18:18.624475 22528 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:18.720132 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.721201 20178 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:18.722826 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.723790 20178 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
W20260709 12:18:18.724098 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54625.9us
I20260709 12:18:18.725165 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.725227 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:18.727129 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:18.635016 23027 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.643054 23007 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:18.648008 22384 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.676453 20254 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:18.648487 23043 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.676004 22999 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:18.795159 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1427) took 1190 ms. Trace:
I20260709 12:18:18.811637 20329 rpcz_store.cc:276] 0709 12:18:17.604629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.604793 (+   164us) service_pool.cc:224] Handling call
0709 12:18:18.794901 (+1190108us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540040f454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:18.795090 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510372736}
W20260709 12:18:18.812534 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.752317 22859 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:18.674181 23023 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:18.678438 22700 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.718879 22876 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:18.719403 22493 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.719193 22994 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.725888 22528 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:18.753036 22967 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.779896 22759 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:18.789809 23007 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:18.796415 22764 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.867075 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.805280 23031 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:18.811141 23008 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.881901 20256 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:18.811532 22999 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:18.810838 23043 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.817174 22859 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.890182 20250 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:18.844174 22846 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.821722 23023 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.821234 22700 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.918732 23031 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.840494 22528 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.921769 20178 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:18.970337 22967 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.873924 23002 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.882020 22759 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.880965 23007 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.846170 22876 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:18.925644 23041 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:18:18.798278 23027 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:18.990463 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1997) took 1812 ms. Trace:
I20260709 12:18:18.968545 23031 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.970907 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:18.990926 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:18.999070 20322 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:18.999210 20250 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:18.969055 22985 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.947829 22845 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:18.964529 22950 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.002s
W20260709 12:18:19.008145 23029 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.954s	user 0.008s	sys 0.000s
I20260709 12:18:18.953727 22859 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.011816 20327 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:18.965888 22878 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.013409 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:19.013994 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 797) took 2047 ms. Trace:
I20260709 12:18:19.014369 21035 rpcz_store.cc:276] 0709 12:18:16.968745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.969115 (+   370us) service_pool.cc:224] Handling call
0709 12:18:19.013799 (+2044684us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54006022d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.013934 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569839872}
I20260709 12:18:18.996512 20177 rpcz_store.cc:276] 0709 12:18:17.177655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.177810 (+   155us) service_pool.cc:224] Handling call
0709 12:18:18.990270 (+1812460us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400103454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:18.990385 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690156800}
I20260709 12:18:19.016019 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:19.016145 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 381) took 1864 ms. Trace:
I20260709 12:18:19.016654 20177 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:19.016716 21034 rpcz_store.cc:276] 0709 12:18:17.151892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.153471 (+  1579us) service_pool.cc:224] Handling call
0709 12:18:17.153857 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:17.627358 (+473501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.627450 (+    92us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:17.750011 (+122561us) log.cc:844] Serialized 52 byte log entry
0709 12:18:17.968211 (+218200us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:18.275074 (+306863us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.275488 (+   414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.275622 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.007523 (+731901us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:19.015660 (+  8137us) raft_consensus.cc:1685] finished
0709 12:18:19.015840 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.016055 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":353338,"prepare.run_cpu_time_us":668,"prepare.run_wall_time_us":8798,"raft.queue_time_us":70701,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":10287,"spinlock_wait_cycles":63570304,"thread_start_us":792681,"threads_started":3,"wal-append.queue_time_us":239280}
I20260709 12:18:19.019155 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.019841 20255 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.952508 22783 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.022578 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.023229 20254 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:18.998274 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:19.024088 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.024610 20254 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.960311 22940 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.963646 22964 raft_consensus.cc:993] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:18.953341 22938 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:18.955467 22993 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.937053 22988 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.001243 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.068645 20250 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:19.003512 22759 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:18.962381 22846 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.005174 22876 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:18.962473 23023 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.970918 22967 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:18.965590 22999 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.030143 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:19.065267 23017 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.067642 22940 raft_consensus.cc:1081] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:19.069136 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.071916 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:19.031302 23037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.067s	sys 0.119s
I20260709 12:18:19.078796 20255 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
W20260709 12:18:19.066524 22957 consensus_meta.cc:287] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
W20260709 12:18:19.081207 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 428745us
I20260709 12:18:19.066188 22845 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:19.103915 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 73886.2us
W20260709 12:18:19.110136 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.110334 20180 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:19.110741 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.110824 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:19.080014 22988 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:19.105132 20248 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:19.069936 23031 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:19.133327 23031 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.113983 22759 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:19.136510 22759 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:19.136896 22759 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:19.137764 22759 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.138953 22759 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.141213 22967 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.115127 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:19.120815 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:19.141934 22988 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.132130 22845 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:19.106420 23037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.068s	sys 0.119s
I20260709 12:18:19.141948 22938 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.143990 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.121470 22846 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.144697 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:19.145051 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:19.150951 20323 raft_consensus.cc:2410] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:19.151907 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.153178 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:19.154048 20323 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:19.145373 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.155709 20328 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:19.146107 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.146636 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.156564 20326 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:19.156433 20325 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:19.158361 20328 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:19.107498 23017 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.165060 22700 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.167520 20329 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:19.170320 22528 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.174309 22859 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.145078 22999 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.177232 22384 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.179975 22384 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.167315 22700 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.065105 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.181331 20256 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.184388 22859 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.158601 22940 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:19.191257 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1748) took 1164 ms. Trace:
I20260709 12:18:19.191797 20251 rpcz_store.cc:276] 0709 12:18:18.026408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.027629 (+  1221us) service_pool.cc:224] Handling call
0709 12:18:19.191025 (+1163396us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54003e9254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.191172 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805900160}
I20260709 12:18:19.147490 22993 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:19.196218 22993 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:19.197363 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.202603 23031 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.143512 22845 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.203573 23021 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:19.203966 23021 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:19.144191 22988 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:19.214792 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0214497229999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 12:18:19.157399 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:19.195312 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.146024 22958 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.005s
I20260709 12:18:19.219647 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:19.224188 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.225821 20256 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:19.228179 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.230346 20325 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:19.231982 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.227012 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.235019 20328 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:19.240411 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.240901 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:19.204789 23021 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.272787 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.274467 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.273656 22940 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:19.276036 22940 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.278535 22940 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.238911 22759 raft_consensus.cc:2764] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:19.282151 23017 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:19.283088 23049 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 12:18:19.269944 22536 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:19.283910 23021 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.284386 22536 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:19.285482 22536 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.289618 23007 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.306789 20321 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.307821 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2594) took 1232 ms. Trace:
I20260709 12:18:19.308279 20324 rpcz_store.cc:276] 0709 12:18:18.075009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.125171 (+ 50162us) service_pool.cc:224] Handling call
0709 12:18:19.306441 (+1181270us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001419d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.307755 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415957248}
I20260709 12:18:19.306854 20254 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
W20260709 12:18:19.312055 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.020s
W20260709 12:18:19.312400 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.000s	sys 0.020s
W20260709 12:18:19.313071 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 587922us
I20260709 12:18:19.324348 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:19.326833 20251 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:19.339143 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.345326 20252 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:19.268455 22956 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.269711 22878 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.348317 20175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.013s
I20260709 12:18:19.349282 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:19.355295 20175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.013s
I20260709 12:18:19.357052 20174 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:19.358393 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2590) took 1294 ms. Trace:
I20260709 12:18:19.359874 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:19.360954 20176 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:19.358850 20327 rpcz_store.cc:276] 0709 12:18:18.064219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.064478 (+   259us) service_pool.cc:224] Handling call
0709 12:18:19.358175 (+1293697us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003985d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.358312 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176388992}
I20260709 12:18:19.369514 20176 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:19.346166 22958 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.347080 22993 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.359189 23017 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:19.357390 23007 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.358822 22975 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.378298 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.380954 20327 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:19.378242 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.358454 22956 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.394151 23043 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.358762 22878 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.404042 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:19.404844 20327 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.407094 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.419520 20322 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:19.387313 22938 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.389854 23017 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:19.389189 23027 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.434051 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:19.441326 21007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.020s	sys 0.002s
W20260709 12:18:19.441394 20296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.034s	sys 0.035s
I20260709 12:18:19.383816 22975 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:19.442065 20296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.034s	sys 0.036s
W20260709 12:18:19.441882 21007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.020s	sys 0.002s
W20260709 12:18:19.442166 20179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.011s	sys 0.023s
W20260709 12:18:19.443107 20179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.011s	sys 0.024s
W20260709 12:18:19.443370 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.441823 20328 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:19.442199 20176 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:19.455106 20251 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:19.442541 22936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.023s	sys 0.014s
W20260709 12:18:19.464283 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 113778us
I20260709 12:18:19.479348 20176 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:19.432001 22528 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.496958 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.497974 20254 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:19.487457 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.476644 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.500074 20328 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:19.502566 20176 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.447644 22988 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.447546 22993 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.513648 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.524888 23043 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:19.526005 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.448683 22999 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:19.476749 22936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.832s	user 0.024s	sys 0.014s
I20260709 12:18:19.478209 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:19.473971 22935 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.545001 22935 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.544199 22990 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:19.547921 22990 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.550113 22990 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.544481 22528 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:19.551453 22528 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.551880 22528 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.552214 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.553546 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.554453 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.554708 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.555698 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.556023 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.556336 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:19.556188 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.556702 20328 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:19.557395 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.557817 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.558063 20326 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:19.538978 21035 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:18:19.561687 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.486459 22956 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.563962 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:19.569160 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 817) took 1358 ms. Trace:
I20260709 12:18:19.571681 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.575898 21040 rpcz_store.cc:276] 0709 12:18:18.211016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.211182 (+   166us) service_pool.cc:224] Handling call
0709 12:18:18.211557 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.212052 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:18.620561 (+408509us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.459341 (+838780us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.488805 (+ 29464us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.489048 (+   243us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:19.489105 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.489209 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.568184 (+ 78975us) raft_consensus.cc:1685] finished
0709 12:18:19.568303 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.568994 (+   691us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":228101,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":28698,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":3267,"thread_start_us":1148359,"threads_started":3,"wal-append.queue_time_us":648832}
I20260709 12:18:19.541262 22988 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.581465 20254 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:19.582809 20325 raft_consensus.cc:2410] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:19.582938 22988 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.574327 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:19.585765 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:19.586920 20172 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:19.585989 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:19.589733 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1998) took 2410 ms. Trace:
I20260709 12:18:19.590220 20171 rpcz_store.cc:276] 0709 12:18:17.179243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.179399 (+   156us) service_pool.cc:224] Handling call
0709 12:18:17.179784 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.178442 (+998658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.589463 (+1411021us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54003e6f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:19.589666 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253340544}
W20260709 12:18:19.542891 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64753.6us
I20260709 12:18:19.592188 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:19.592810 20171 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.590587 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:19.595618 21035 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:19.597254 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:19.597572 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:19.603860 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:19.594440 23058 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:19.600333 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:19.577066 22969 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:19.594669 23031 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:19.613593 23058 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.613531 22700 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:19.598608 22940 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.625550 20254 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:19.626010 22964 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:19.602957 23056 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.627983 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.630348 21039 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:19.631793 20171 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:19.655429 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.655445 21038 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:19.617667 22983 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:19.600827 22759 raft_consensus.cc:2764] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:18:19.635677 20174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2591) took 2476 ms (client timeout 2025 ms). Trace:
W20260709 12:18:19.662905 20174 rpcz_store.cc:269] 0709 12:18:17.147792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.154526 (+  6734us) service_pool.cc:224] Handling call
0709 12:18:19.624133 (+2469607us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54003e6554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.624276 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4780534144}
I20260709 12:18:19.660215 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.594141 22935 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.625299 22943 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:19.637606 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.669255 21041 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:19.600443 22859 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:18:19.470273 20327 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:19.650146 20254 pending_rounds.cc:85] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 3
I20260709 12:18:19.673884 20254 pending_rounds.cc:107] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:19.674238 20254 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:19.567036 22999 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.637580 22700 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.650817 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.685240 21043 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:19.560186 22993 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.656273 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:19.634778 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:19.688781 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65498.9us
I20260709 12:18:19.689189 20325 raft_consensus.cc:2410] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:18:19.657625 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.661003 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:19.667214 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.690924 20255 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:19.637353 23058 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.667673 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.692047 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.692373 20250 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:19.661044 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2024) took 1036 ms. Trace:
I20260709 12:18:19.595206 21036 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:19.670552 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.658697 23068 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.670754 20322 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:18:19.620040 23060 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:19.614262 22956 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:19.628691 23031 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:19.726248 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.727175 20254 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.557499 23017 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:19.657581 20253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:18:19.730997 20253 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:19.731688 20253 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.693948 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:19.696425 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.659054 22940 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.773123 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.758836 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:19.774935 21040 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:19.693133 22700 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.699523 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:19.662657 22983 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.700403 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:19.702647 21041 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:18:19.703039 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:19.780978 21041 pending_rounds.cc:85] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 5
I20260709 12:18:19.706130 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:19.707247 23023 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.007s
I20260709 12:18:19.736069 20250 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:19.778672 20255 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:19.781239 21041 pending_rounds.cc:107] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:19.810065 21041 raft_consensus.cc:2889] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:19.785181 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.810611 21041 pending_rounds.cc:107] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:19.810885 21041 raft_consensus.cc:2889] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:19.700311 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.704548 22878 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:19.815989 23070 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:18:19.730526 22958 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.817130 23003 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.818168 20249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1398) took 1588 ms (client timeout 1546 ms). Trace:
I20260709 12:18:19.781478 21043 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:18:19.778064 22974 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.243s	user 0.015s	sys 0.000s
I20260709 12:18:19.865952 21039 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:19.731621 23031 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.848835 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.888167 20255 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.723922 22936 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:19.745232 23007 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:19.741701 23060 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:19.851529 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:19.783443 22983 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:19.852867 20249 rpcz_store.cc:269] 0709 12:18:18.230185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.231616 (+  1431us) service_pool.cc:224] Handling call
0709 12:18:19.817911 (+1586295us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001ca554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.818078 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274124672}
I20260709 12:18:19.866598 22938 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:19.814548 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:19.914693 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100269us
I20260709 12:18:19.875939 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.867584 22974 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:19.899111 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2591) took 1825 ms (client timeout 1590 ms). Trace:
W20260709 12:18:19.921758 20330 rpcz_store.cc:269] 0709 12:18:18.073901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.099375 (+ 25474us) service_pool.cc:224] Handling call
0709 12:18:19.898888 (+1799513us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400087fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:19.899024 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422485376}
I20260709 12:18:19.866034 23003 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.740321 22956 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:19.877321 20254 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:19.917790 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:19.930778 20249 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.881973 20253 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.856763 22958 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.692852 20178 rpcz_store.cc:276] 0709 12:18:18.624884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.308186 (+683302us) service_pool.cc:224] Handling call
0709 12:18:19.308513 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.308727 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:19.350480 (+ 41753us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.660596 (+310116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.660671 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.660736 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.660825 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.660970 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53672,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":1475,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5141,"thread_start_us":307695,"threads_started":1}
I20260709 12:18:19.729206 23068 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.918861 23056 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.921281 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:18:19.923936 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.913141 22384 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.854121 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 155368us
I20260709 12:18:19.844259 23023 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:19.930819 20220 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:19.950603 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.935395 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.951702 20325 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:19.951598 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:19.952914 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:19.941116 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 401325us
I20260709 12:18:19.904742 22936 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.910609 23007 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:19.954268 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:19.949285 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:19.961036 20253 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:19.962141 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.963055 20249 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:19.951768 23021 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.006s
W20260709 12:18:19.954994 23064 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:18:19.941219 22999 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:19.967597 20177 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:19.970124 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:19.952673 22759 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.953040 22974 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:19.983552 22975 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.989398 23031 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:19.970371 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.994670 23071 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:18:19.998865 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2019) took 1861 ms. Trace:
I20260709 12:18:19.960496 22845 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:20.000638 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51467.5us
I20260709 12:18:19.999308 20172 rpcz_store.cc:276] 0709 12:18:18.137683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.146262 (+  8579us) service_pool.cc:224] Handling call
0709 12:18:18.154749 (+  8487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.587291 (+1432542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.998634 (+411343us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400240ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:19.998805 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3293131648}
I20260709 12:18:19.952833 22384 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.012364 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.015745 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:20.000556 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 43919.6us
I20260709 12:18:19.964003 22964 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:18:19.972028 22993 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:19.964071 23056 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:18:20.025107 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.029837 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 391) took 1566 ms. Trace:
I20260709 12:18:20.033423 20175 rpcz_store.cc:276] 0709 12:18:18.464683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.477504 (+ 12821us) service_pool.cc:224] Handling call
0709 12:18:18.620868 (+143364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.637850 (+ 16982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.637898 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.648040 (+ 10142us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.355670 (+707630us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:19.355713 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.363316 (+  7603us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.029554 (+666238us) raft_consensus.cc:1685] finished
0709 12:18:20.029585 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.029755 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16538,"raft.queue_time_us":21094,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":16864,"thread_start_us":545156,"threads_started":1,"wal-append.queue_time_us":808652}
W20260709 12:18:20.036288 23073 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:20.008239 22935 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:20.019251 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.038546 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.015148 22940 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:20.027423 22886 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.033144 22969 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.019348 22988 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:20.041234 22935 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.050338 22886 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.052644 23066 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:20.031267 22956 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.051061 22969 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:20.060345 22934 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.057789 22935 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.061595 22975 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.066553 22886 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.066457 23066 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.072891 22969 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.094967 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.123930 20175 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:18:20.124572 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.122478 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.125308 20178 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:20.096767 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.070140 22974 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.073326 22934 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.071652 22958 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.131340 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.138943 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.139235 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.139470 20178 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:20.132875 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.135382 20321 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:20.137079 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.137306 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.137318 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:20.139846 20176 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
W20260709 12:18:20.140969 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 187193us
I20260709 12:18:20.152710 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.128636 23066 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.160470 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2026) took 1502 ms. Trace:
I20260709 12:18:20.162019 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:20.164902 20173 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.162364 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.166080 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 552) took 1301 ms. Trace:
I20260709 12:18:20.132126 22964 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.144887 22934 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.169833 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.166772 23082 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:20.163441 22845 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.144462 22974 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.148545 23007 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.144060 23023 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.082659 22975 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.163431 20180 rpcz_store.cc:276] 0709 12:18:18.658516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.339648 (+681132us) service_pool.cc:224] Handling call
0709 12:18:19.340064 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.340342 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:19.854987 (+514645us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.160107 (+305120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.160169 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:20.160225 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.160296 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.160410 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36962,"prepare.queue_time_us":44958,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":24579,"thread_start_us":773429,"threads_started":2}
I20260709 12:18:20.167732 20247 rpcz_store.cc:276] 0709 12:18:18.864622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.865979 (+  1357us) service_pool.cc:224] Handling call
0709 12:18:18.915753 (+ 49774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.997625 (+ 81872us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:19.448078 (+450453us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.854478 (+406400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.854555 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:19.854627 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.165835 (+311208us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b54003e9c54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:20.165886 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.166019 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":702819,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":9804,"raft.queue_time_us":95,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4078,"spinlock_wait_cycles":187492096,"thread_start_us":846042,"threads_started":2,"wal-append.queue_time_us":562381}
W20260709 12:18:20.171340 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 132514us
W20260709 12:18:20.217837 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 198788us
I20260709 12:18:20.160138 23021 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:20.180688 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:20.216396 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 421) took 1016 ms. Trace:
I20260709 12:18:20.163069 22936 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.169697 22958 raft_consensus.cc:2764] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:20.233592 20329 rpcz_store.cc:276] 0709 12:18:19.199512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.269338 (+ 69826us) service_pool.cc:224] Handling call
0709 12:18:19.269692 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.269920 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:19.345667 (+ 75747us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.033588 (+687921us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18003d06c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa9823a 00007f5ddaf02a2a
0709 12:18:20.215902 (+182314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.215961 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:20.216004 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.216075 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.216226 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70956,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":101,"spinlock_wait_cycles":4607360,"thread_start_us":182005,"threads_started":1}
I20260709 12:18:20.244732 20173 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:20.179502 23082 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.280562 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.280766 23082 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.281719 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.281863 23082 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.282433 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.283007 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:20.282006 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.283593 21041 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.180688 22938 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:20.285053 22938 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.239547 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:20.234071 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53470.6us
W20260709 12:18:20.289059 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.289510 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:20.291786 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52385.1us
I20260709 12:18:20.292672 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.293751 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.294216 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.294625 20174 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:20.294970 20175 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:20.301725 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:20.302373 20324 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:20.303831 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:19.967748 23060 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.307386 21035 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:20.287611 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.188625 22384 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.309860 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:20.310031 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:20.311435 21041 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:20.311204 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:20.313458 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.315266 20325 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:20.314858 20321 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.315824 20321 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:20.187640 23068 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:20.317718 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:20.318117 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 401) took 1800 ms. Trace:
I20260709 12:18:20.337757 20177 rpcz_store.cc:276] 0709 12:18:18.517338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.017375 (+500037us) service_pool.cc:224] Handling call
0709 12:18:19.115031 (+ 97656us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b5c0017ae0c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dde862161 00007f5ddea03a79 00007f5ddfebd9b6 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:20.317908 (+1202877us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b54001d33d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:20.318052 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907773952}
I20260709 12:18:20.319831 22846 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:20.322316 20255 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:20.248723 23021 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.322934 20321 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.324770 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:20.325023 23077 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:18:20.325803 22958 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.183156 22974 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.329187 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.353426 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.278263 23023 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.187173 23058 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.332683 22759 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.334566 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.344645 20321 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.342038 22940 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:20.177256 22964 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:20.354847 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.289641 23017 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:20.180078 23081 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 12:18:20.346160 20330 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
W20260709 12:18:20.353695 23084 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:18:20.351747 23068 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:20.354619 22846 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:20.381793 20327 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:20.356602 22384 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:20.384595 23085 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:20.387885 22384 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.388367 22384 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:20.388929 23061 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.548s	user 0.002s	sys 0.000s
I20260709 12:18:20.391654 23062 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.391849 22964 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:20.392155 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 393) took 1913 ms. Trace:
I20260709 12:18:20.373881 22759 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.360664 22988 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:20.393239 22988 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.392588 20179 rpcz_store.cc:276] 0709 12:18:18.492102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.500595 (+  8493us) service_pool.cc:224] Handling call
0709 12:18:18.501064 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.618524 (+117460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.618581 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.619239 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.443531 (+824292us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.443603 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.443679 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.376652 (+932973us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:20.391768 (+ 15116us) raft_consensus.cc:1685] finished
0709 12:18:20.391809 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.392089 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115279,"raft.queue_time_us":117115,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":20219,"spinlock_wait_cycles":10110848,"thread_start_us":724380,"threads_started":1,"wal-append.queue_time_us":1032161}
I20260709 12:18:20.374481 22845 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:20.377708 22528 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.005s
I20260709 12:18:20.383612 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.411945 20254 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:20.418011 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125438us
I20260709 12:18:20.418707 20321 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:20.400046 22759 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.411715 22958 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.409721 23068 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:20.413154 22845 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:20.430944 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 141538us
I20260709 12:18:20.409098 22528 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.432865 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:20.424834 22700 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
W20260709 12:18:20.436896 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.472026 22975 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:20.439391 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.436908 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 278424us
I20260709 12:18:20.451766 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:20.478722 23060 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:20.443486 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 90137.2us
I20260709 12:18:20.480312 23060 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:20.481326 23060 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.476128 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.467312 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1759) took 1060 ms. Trace:
I20260709 12:18:20.482995 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:20.482748 20252 rpcz_store.cc:276] 0709 12:18:19.406631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.406779 (+   148us) service_pool.cc:224] Handling call
0709 12:18:20.467088 (+1060309us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54002de1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:20.467242 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558955776}
I20260709 12:18:20.486240 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.486897 20250 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:20.489234 21038 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:20.490644 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.488852 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.492347 20255 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:20.489957 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.457335 23098 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:20.497480 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.498243 22901 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:20.498667 22901 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.499008 22901 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.501686 22759 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:20.466216 22990 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:18:20.496104 20177 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:20.488452 22878 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.505069 22878 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:20.505508 22878 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.507781 23031 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.508927 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.512735 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.509613 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:20.513296 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.503334 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.514550 20254 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:20.513375 20176 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
W20260709 12:18:20.513939 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.470539 22940 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:20.493712 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:20.485934 22988 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:20.517416 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.520033 20175 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:20.488505 22993 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.491631 22975 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:20.521822 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.523289 21038 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:20.537899 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44276.8us
I20260709 12:18:20.537767 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.539167 20175 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:20.541069 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.484380 22700 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:20.543524 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:20.542160 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 137233us
I20260709 12:18:20.544764 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:20.457582 22846 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.549871 23093 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.550765 22990 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.551651 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.552585 21034 raft_consensus.cc:2410] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:20.434085 22958 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:20.559865 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:20.560935 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.563920 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.575902 20250 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:20.575989 20256 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:20.566273 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.572572 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:20.577590 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.578258 20256 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:20.579401 20254 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:20.577016 21038 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:20.593154 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.593842 20256 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:18:20.597227 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.541765 22975 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:20.602763 22975 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.602838 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.604019 20248 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:20.605188 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.606314 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:20.606889 20247 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:20.589092 23092 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 12:18:20.616621 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 270229us
I20260709 12:18:20.522485 22886 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.617849 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.594658 22988 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:20.572717 23105 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:20.521080 22901 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:20.631316 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54936.6us
I20260709 12:18:20.636845 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.606500 23021 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.519963 22845 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.611759 23058 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.642917 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:20.615187 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.655622 21034 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:18:20.655933 23096 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:18:20.645669 23100 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.657205 23100 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.650054 23093 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.515152 23098 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.652019 23060 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.623332 23066 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.645121 23105 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.653236 23103 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.574086 22993 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.616179 22964 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:20.630246 23090 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:18:20.662231 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.524549 23068 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.665370 23081 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:20.666169 23088 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 12:18:20.673245 22886 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.673816 21042 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:20.680060 22528 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.680948 22940 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.683840 22963 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.684466 23101 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.689513 23060 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.689618 22901 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:20.690878 22934 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 12:18:20.767925 22934 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.770828 22934 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:20.652987 22700 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:20.659377 23100 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:20.717840 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 95311us
I20260709 12:18:20.772430 23100 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:20.772748 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.772929 23100 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:20.773864 23100 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.735225 23066 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.736304 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:20.776041 20321 raft_consensus.cc:606] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.776095 23117 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:20.776538 20321 raft_consensus.cc:614] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:20.776681 23117 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:20.777226 23117 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.741343 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 436) took 1049 ms. Trace:
I20260709 12:18:20.777798 20327 rpcz_store.cc:276] 0709 12:18:19.691668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.691797 (+   129us) service_pool.cc:224] Handling call
0709 12:18:20.741142 (+1049345us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54002da0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:20.741282 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584360704}
W20260709 12:18:20.743958 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81825.5us
I20260709 12:18:20.780434 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.781548 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.743857 22936 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.785737 22936 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.757810 20252 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.789788 21043 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:20.765821 23101 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.766942 23060 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:20.797977 20178 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:20.796530 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.799543 20177 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
W20260709 12:18:20.799659 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.796811 20180 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:18:20.800280 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.760984 22969 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 12:18:20.801672 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:20.807668 20180 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.807871 20327 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:20.798756 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:20.728688 23103 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:20.804025 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.804651 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.756680 22859 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.815510 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:20.816042 22859 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:20.817029 22859 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.818010 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:20.818255 22859 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.812175 22943 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.805538 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:20.819185 22943 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:20.819689 23017 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:20.819906 21038 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:20.820147 23017 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.820348 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:20.820577 23017 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.820945 20172 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.821941 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.744143 22384 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:20.824036 23091 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.441s	user 0.000s	sys 0.003s
I20260709 12:18:20.824184 22384 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.825081 20255 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:20.825228 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:20.825667 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:20.826399 20173 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:20.825990 20178 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5. Re-sending same reply.
I20260709 12:18:20.833113 23105 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.834890 23098 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.836627 20172 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:20.838814 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:20.840132 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.836654 23123 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:20.846086 23123 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:20.846493 23123 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.744957 22964 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.806313 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:20.813936 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.815415 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:20.852393 20251 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:20.854579 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48338.7us
I20260709 12:18:20.855576 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:20.861344 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 51325.8us
I20260709 12:18:20.814772 23103 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:20.872341 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 58491.1us
I20260709 12:18:20.828532 23003 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:20.835807 23081 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.873984 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.873454 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:20.884900 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:20.833161 23062 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:20.889067 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 271292us
I20260709 12:18:20.845332 22384 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:20.905824 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 261323us
I20260709 12:18:20.904954 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.812323 23060 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.910861 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:20.915918 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.812577 22969 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:20.911366 20251 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:20.878383 23031 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.886708 20321 raft_consensus.cc:606] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:20.914659 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 318661us
I20260709 12:18:20.887627 23098 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:20.900955 20252 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:20.919108 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:20.926409 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:20.936420 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.876353 22759 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.936506 20253 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:20.906693 23062 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.947309 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.946779 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:20.911856 22384 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:20.952768 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79429.2us
I20260709 12:18:20.953300 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:20.954048 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:20.954473 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:20.921970 22964 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.927294 23031 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:20.948092 23027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.014s	sys 0.017s
I20260709 12:18:21.007370 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:21.007452 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:20.930405 23058 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:21.009332 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:21.029428 23060 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.029302 22999 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:21.030035 22876 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:21.005820 22963 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.037526 22384 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:21.042510 23027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.014s	sys 0.017s
I20260709 12:18:21.031155 22969 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:21.031304 22901 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:20.931756 22936 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.010862 23094 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.106657 23058 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:20.948457 23066 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:21.148356 23110 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:18:21.040493 20175 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:21.043376 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:21.007545 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53553.2us
W20260709 12:18:21.214169 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 170884us
I20260709 12:18:21.047593 23120 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:21.049307 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:21.030629 23101 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:20.938206 23098 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.041139 22759 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:21.118325 23124 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:18:21.122887 22963 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.042977 23031 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:21.132920 22975 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 12:18:21.132979 22993 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.137480 23103 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.123526 22974 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:21.140787 23114 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
W20260709 12:18:21.142037 22938 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.000s
I20260709 12:18:21.050427 23099 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.009676 23105 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:21.158354 20247 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 12:18:21.241335 20247 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:21.159221 20180 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
W20260709 12:18:21.127203 22878 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.002s
I20260709 12:18:20.906612 23003 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:18:21.210762 22384 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:21.149093 22983 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.235s	user 0.014s	sys 0.000s
I20260709 12:18:21.147791 23027 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:21.207618 23121 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:18:21.273671 22983 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.275923 22983 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:21.255975 22878 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.278152 22990 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.278775 22878 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.246181 22938 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.280409 22958 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.281286 22938 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.282207 20249 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:21.287704 23127 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:18:21.257035 23105 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:21.290496 23117 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.001s
I20260709 12:18:21.290066 23105 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.265748 23058 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.295706 23027 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:21.296888 23027 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.215389 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:21.220067 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 363321us
I20260709 12:18:21.150300 22901 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.160863 22876 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:21.223306 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 269344us
W20260709 12:18:21.228680 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 354751us
I20260709 12:18:21.313582 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.316476 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:21.220353 23120 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.223115 23098 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.230544 22963 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.325929 22759 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.326474 22759 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.246363 20247 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:21.259490 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:21.328681 20175 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:21.328855 22759 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:21.257081 22935 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.175s	user 0.011s	sys 0.002s
I20260709 12:18:21.329773 22935 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.332465 22935 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.221510 23112 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:18:21.234055 22975 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.220014 22964 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 12:18:21.270567 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 259679us
W20260709 12:18:21.299180 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 83873.2us
I20260709 12:18:21.348126 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:21.299789 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:21.349742 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50152.9us
I20260709 12:18:21.350144 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:21.350739 20247 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.351416 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:21.348126 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:21.315088 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.239089 22974 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:21.308516 23082 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.025s	user 0.007s	sys 0.009s
I20260709 12:18:21.321024 23120 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.323462 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:21.324584 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:21.264683 23132 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:18:21.412349 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.321903 22938 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.318948 22384 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.309058 22901 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.464278 23021 raft_consensus.cc:993] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:21.464818 23021 raft_consensus.cc:1081] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:21.464874 22975 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.465337 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.397464 23133 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.466061 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:21.466780 21037 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:21.467105 23103 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.466992 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:21.467988 20176 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:21.468955 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.469136 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:21.469624 20176 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.470399 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:21.470975 20248 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:21.321700 23089 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:21.394559 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 79565.3us
I20260709 12:18:21.472724 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.473904 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:21.475015 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.474892 23031 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.396814 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:21.397636 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48297.7us
I20260709 12:18:21.399199 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2045) took 1105 ms. Trace:
I20260709 12:18:21.401822 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:21.334404 23056 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:18:21.412971 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.434266 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:21.487268 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.484409 20176 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
W20260709 12:18:21.487763 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53650.7us
I20260709 12:18:21.413190 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.355813 22983 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.490720 20178 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:21.460605 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:21.492439 20251 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:21.460929 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:21.401548 22700 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:21.462879 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:21.463903 22938 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.494427 23125 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:21.494976 23125 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.495761 22938 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.309531 22959 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.476193 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:21.497184 23125 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.290918 23117 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.501255 23117 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:21.396987 20174 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:21.479158 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:21.481031 20171 rpcz_store.cc:276] 0709 12:18:20.293583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.295498 (+  1915us) service_pool.cc:224] Handling call
0709 12:18:20.324348 (+ 28850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:20.371804 (+ 47456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:20.371854 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:20.371911 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:20.371956 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.398945 (+1026989us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54003e7454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:21.398994 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.399116 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108492032}
I20260709 12:18:21.322363 22876 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.507284 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:21.508229 20247 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:21.491449 20172 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:21.397405 23138 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:21.511617 20178 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:21.400715 23003 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:21.410889 20175 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:21.515208 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.515954 22384 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:21.563462 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48379.1us
I20260709 12:18:21.536438 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:21.564874 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:21.516752 20248 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.555809 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:21.485332 23133 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.562027 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.483273 23144 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:21.489068 23089 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.558359 22700 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:21.558146 21034 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:21.504309 22975 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.577500 22384 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:21.620581 22384 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:21.621628 22384 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.578907 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:21.624328 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45525.5us
I20260709 12:18:21.561568 23138 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.404482 23082 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:21.590646 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 83553.2us
I20260709 12:18:21.633605 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:21.595645 23143 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:18:21.585341 22983 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:21.617127 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 817) took 1989 ms. Trace:
I20260709 12:18:21.578102 23007 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.644467 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:21.645764 20322 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:21.625260 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:21.583863 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 107729us
I20260709 12:18:21.564687 23112 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:21.656786 23112 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.657267 23112 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.657616 22845 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.558879 23125 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:21.572042 22759 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.640697 23081 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.640318 22700 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:21.637619 22993 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.642524 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:21.531038 23062 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.674738 20256 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:21.676421 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:21.577979 23103 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:18:21.648061 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:21.563105 23105 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:21.635895 23138 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.650110 20180 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:21.690337 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:21.691092 20180 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:21.639317 21042 rpcz_store.cc:276] 0709 12:18:19.630715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.677073 (+ 46358us) service_pool.cc:224] Handling call
0709 12:18:20.324588 (+647515us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:18:21.616861 (+1292273us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54005870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:21.617051 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743692928}
I20260709 12:18:21.651798 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:21.637228 23003 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:21.637781 22943 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:21.653621 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.701608 20324 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:21.670526 23081 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.654583 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:21.684154 23123 consensus_meta.cc:287] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.000s
I20260709 12:18:21.656107 22964 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:21.592787 23140 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.577239 22959 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:21.660174 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.592579 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:21.590632 23089 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:21.624611 22999 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:21.729661 22999 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:21.730613 22999 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.671049 20179 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:21.734040 22983 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.735641 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 403) took 1246 ms. Trace:
I20260709 12:18:21.736066 20179 rpcz_store.cc:276] 0709 12:18:20.489155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.489319 (+   164us) service_pool.cc:224] Handling call
0709 12:18:21.735383 (+1246064us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400319cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:21.735544 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662403456}
I20260709 12:18:21.737571 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:21.628692 23144 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.738287 20179 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
W20260709 12:18:21.740175 23149 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:18:21.740331 23144 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.741210 23144 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:21.662714 22975 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:18:21.641543 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.747506 20321 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:21.678161 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:21.681064 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.649673 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:21.748943 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 67972.1us
I20260709 12:18:21.644363 23007 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.688107 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1412) took 1148 ms. Trace:
I20260709 12:18:21.653172 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.759897 20255 rpcz_store.cc:276] 0709 12:18:20.539951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.540075 (+   124us) service_pool.cc:224] Handling call
0709 12:18:21.687852 (+1147777us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540024f4d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:21.688021 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651277184}
I20260709 12:18:21.686861 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1414) took 1127 ms. Trace:
I20260709 12:18:21.694448 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.654031 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.761008 20252 rpcz_store.cc:276] 0709 12:18:20.559381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.559510 (+   129us) service_pool.cc:224] Handling call
0709 12:18:21.686634 (+1127124us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54001978d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:21.686780 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418440576}
I20260709 12:18:21.761776 20328 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:21.655195 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.669925 23126 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:21.696126 22759 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:21.672657 22993 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:21.776998 22993 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.723764 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.723824 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.782714 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.783686 20323 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:21.785070 20323 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:21.741950 21034 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:21.708850 20330 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:18:21.793642 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.798142 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.798898 20321 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:21.764189 23007 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:21.723935 23148 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:18:21.729043 23089 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.663327 23056 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:18:21.681764 23105 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:21.686830 22859 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.565259 22938 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:18:21.749845 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.785266 22876 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.697127 22956 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:21.714862 23017 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.000s
I20260709 12:18:21.761340 20177 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:21.725504 23123 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.762298 23136 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.683916 23115 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:18:21.766806 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:21.766254 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:21.767518 23031 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.768586 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:21.769667 23082 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.707808 22901 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.748667 20256 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:21.682534 23125 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.759326 23144 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.775439 23062 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.803710 20323 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:21.762996 22974 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.727264 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:21.798403 22943 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.832300 20329 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.829576 20328 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 3.
W20260709 12:18:21.840492 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 158237us
I20260709 12:18:21.744403 23140 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.849622 20173 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:21.789142 22759 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.821798 22956 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.786860 23126 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.838176 22975 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:21.863900 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 153971us
I20260709 12:18:21.858080 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:21.881174 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:21.881757 20256 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.849959 23031 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.891389 22964 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:21.892164 22964 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.869055 23003 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:21.901726 23142 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.638s	user 0.003s	sys 0.000s
I20260709 12:18:21.874584 22956 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.907090 22901 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.828200 23017 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.909196 22759 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.909277 23017 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.910104 22975 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.911767 23123 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.913355 22886 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:21.913192 23031 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.913877 22886 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:21.883313 21008 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:21.884189 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:21.916589 20250 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:18:21.862439 23105 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:21.917263 20171 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:21.825924 22963 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.868302 22943 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:21.972432 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.973373 20179 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.936671 20329 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
W20260709 12:18:21.950191 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.981683 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:21.915445 23031 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:21.886265 22974 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:21.903143 23081 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.985743 20256 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:21.989751 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:18:21.939682 23017 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.003804 20171 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:22.004374 20171 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.941787 23123 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.997833 20180 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:21.914985 22886 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:21.952688 22901 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:21.982615 23094 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.772s	user 0.004s	sys 0.008s
I20260709 12:18:22.012840 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:21.975469 23021 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.029022 20179 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:22.034619 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 284895us
I20260709 12:18:21.974632 22845 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:22.059659 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:22.068668 20171 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.072327 20171 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:21.856345 22959 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.075364 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:22.075052 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:22.012892 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:22.087492 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:22.032038 23094 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.010761 22974 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.101357 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:22.115705 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.116178 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.116344 20323 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.116918 20326 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:22.118685 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.119446 20321 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:22.119773 20177 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:22.120616 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.122474 20330 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:22.125286 20330 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:18:22.125916 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.127913 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.018814 23017 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.017652 23123 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.129403 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:22.079205 22999 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:22.091398 22886 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.142213 20323 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:22.137507 23021 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:22.137709 23152 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:18:22.138584 23154 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:22.076383 23160 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.136742 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:22.145403 22700 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.145525 23136 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:22.145887 23123 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.146528 22845 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.182991 20321 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:22.135444 23170 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:22.178889 23155 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:18:22.129467 23166 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:22.159776 23098 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.001s
I20260709 12:18:22.137648 23031 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.185294 23027 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.201659 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.209174 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 571) took 1298 ms. Trace:
I20260709 12:18:22.223421 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.232885 20250 rpcz_store.cc:276] 0709 12:18:20.910757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.910934 (+   177us) service_pool.cc:224] Handling call
0709 12:18:20.911350 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:21.927117 (+1015767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.208803 (+281686us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002bff54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:22.209077 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310997376}
I20260709 12:18:22.233525 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.234694 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.227437 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.235250 20323 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:22.143314 23169 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.102104 23158 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:18:22.086544 23112 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.236071 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.238775 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.239892 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.245724 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.247331 20323 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.248168 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.250466 20330 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:22.248328 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.251003 20328 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:22.159739 22999 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.229866 23166 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.183473 23021 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.238262 23027 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:22.265183 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 186731us
I20260709 12:18:22.198606 23160 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:22.264683 23138 consensus_meta.cc:287] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260709 12:18:22.297453 22963 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.247591 23126 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.237344 23098 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.267530 23144 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.229853 23170 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.268435 23166 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.298601 23027 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.244602 23031 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:18:22.247450 23169 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:22.337297 23165 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:18:22.338248 23168 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:18:22.339200 23174 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:18:22.328442 23164 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:18:22.396378 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 363042us
W20260709 12:18:22.344575 23159 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:18:22.411615 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:22.412722 20327 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:22.416510 20323 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:22.318149 23138 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.410099 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:22.437314 20180 raft_consensus.cc:2368] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:18:22.448002 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:22.430408 23173 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.164s	user 0.003s	sys 0.007s
I20260709 12:18:22.419224 22528 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.430114 23093 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.459970 20171 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:22.439757 23120 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.961s	user 0.012s	sys 0.004s
I20260709 12:18:22.431643 23123 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:22.411509 23126 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.440168 22963 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.435786 23171 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.489998 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1433) took 1080 ms. Trace:
I20260709 12:18:22.460876 23081 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.455629 23175 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.490540 20254 rpcz_store.cc:276] 0709 12:18:21.409713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.505771 (+ 96058us) service_pool.cc:224] Handling call
0709 12:18:21.512447 (+  6676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:21.563355 (+ 50908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:21.563392 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:21.571930 (+  8538us) log.cc:844] Serialized 26 byte log entry
0709 12:18:22.008667 (+436737us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:22.008710 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.008775 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.489762 (+480987us) raft_consensus.cc:1685] finished
0709 12:18:22.489788 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.489933 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55725,"raft.queue_time_us":53183,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":12972,"thread_start_us":382152,"threads_started":1,"wal-append.queue_time_us":474540}
W20260709 12:18:22.495313 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 79044.7us
I20260709 12:18:22.490521 21034 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:22.510916 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.507498 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:22.509583 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.517761 20330 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.471632 22528 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.494480 23112 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:22.478801 23093 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.485458 23120 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:22.567700 23162 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:18:22.568527 23120 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:22.568835 23093 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.570391 21043 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:22.571938 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 833) took 1256 ms. Trace:
I20260709 12:18:22.572283 21043 rpcz_store.cc:276] 0709 12:18:21.316045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.316188 (+   143us) service_pool.cc:224] Handling call
0709 12:18:22.571727 (+1255539us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54006617d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:22.571858 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882108288}
I20260709 12:18:22.427907 23144 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:18:22.530031 22993 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.001s
I20260709 12:18:22.503924 23175 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.576223 22993 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.577839 23175 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.578367 22993 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.581609 23138 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.582872 22975 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.587000 23140 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.587440 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:22.588105 20322 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:22.588394 20322 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:22.530766 23179 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.533994 23160 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:22.535835 22964 consensus_meta.cc:287] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.007s
I20260709 12:18:22.487741 23126 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.510653 22974 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:22.589397 23007 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.724s	user 0.014s	sys 0.007s
I20260709 12:18:22.540097 22528 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.607009 23007 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:22.554131 22956 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.003s
W20260709 12:18:22.718861 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.544739 23098 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.515755 23021 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.512147 23017 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.511337 23081 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.715756 20322 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.784341 22956 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.785342 20322 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.497782 23171 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.788136 20324 raft_consensus.cc:2368] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:22.790014 22956 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:22.790738 23171 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:22.548228 23172 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:18:22.792045 23126 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.598963 23179 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.565533 23188 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.797554 23188 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:22.745975 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 297903us
I20260709 12:18:22.800791 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:22.802724 23126 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.761145 23170 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.773442 20178 raft_consensus.cc:2368] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7.
W20260709 12:18:22.793071 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.797715 23196 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:22.803517 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:22.803297 23126 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:22.772253 23031 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:22.604001 23089 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.008s
I20260709 12:18:22.807353 23089 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.601640 22964 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.816008 23126 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.831911 23197 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:22.832612 23089 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.832916 23197 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:22.836128 23197 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.840692 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:22.863648 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:22.864773 20254 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:22.865851 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:22.866668 23166 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.021s
I20260709 12:18:22.841898 23190 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:22.843173 20253 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.843498 23179 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:22.843354 23007 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.844112 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:22.845003 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:22.845151 20256 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:22.847054 23188 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:22.847580 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2616) took 1414 ms. Trace:
I20260709 12:18:22.848883 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2058) took 1982 ms. Trace:
I20260709 12:18:22.850101 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2053) took 2047 ms. Trace:
I20260709 12:18:22.851125 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:22.851296 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:22.849094 22964 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:22.849095 20255 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:22.859418 20144 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:22.867235 23166 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.867161 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:22.957412 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:22.959919 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:22.960508 23007 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:22.955960 23190 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:22.950903 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:22.961925 20177 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:22.962155 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:22.963469 20205 heartbeater.cc:646] Failed to heartbeat to 127.18.132.126:44843 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.18.132.126:44843 timed out after 15.000s (SENT)
I20260709 12:18:22.964747 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:22.965121 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:22.966209 23115 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:22.967835 21040 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:22.968137 23179 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:22.968636 23197 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:22.969326 22845 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:23.012176 20254 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:23.011829 23197 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.012367 22845 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.014822 22845 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.014518 23179 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.017127 20252 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.018563 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.019757 20321 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:23.015184 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 156050us
I20260709 12:18:22.970278 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:22.973553 21038 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:22.977941 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:23.020563 21041 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:22.980360 22901 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.949s	user 0.019s	sys 0.002s
W20260709 12:18:22.950513 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.874760 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:22.948951 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1453) took 1297 ms. Trace:
I20260709 12:18:22.987624 22943 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:23.006609 21035 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:23.023965 20248 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:23.025142 20322 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:23.014725 21037 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.001737 20172 rpcz_store.cc:276] 0709 12:18:21.432943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.510460 (+ 77517us) service_pool.cc:224] Handling call
0709 12:18:21.510797 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:21.621050 (+110253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:21.621093 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:21.621707 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:18:21.798171 (+176464us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:21.823954 (+ 25783us) log.cc:844] Serialized 14 byte log entry
0709 12:18:22.033864 (+209910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.846740 (+812876us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000c53d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:22.846839 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.846932 (+    93us) raft_consensus.cc:1685] finished
0709 12:18:22.847053 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.847304 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27263,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":40211,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":11185,"spinlock_wait_cycles":252596096,"thread_start_us":385433,"threads_started":2,"wal-append.queue_time_us":251902}
I20260709 12:18:23.035638 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.036324 20248 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.036828 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.037562 21039 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:23.011731 23105 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.002246 20174 rpcz_store.cc:276] 0709 12:18:20.802366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.802687 (+   321us) service_pool.cc:224] Handling call
0709 12:18:20.803017 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.504490 (+701473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.849608 (+1345118us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54002364d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:22.849887 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365527936}
I20260709 12:18:23.043529 20253 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:23.024573 20327 rpcz_store.cc:276] 0709 12:18:21.651368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.651512 (+   144us) service_pool.cc:224] Handling call
0709 12:18:22.874100 (+1222588us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400328a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:22.948649 (+ 74549us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322630912}
I20260709 12:18:23.002187 20173 rpcz_store.cc:276] 0709 12:18:20.866371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.866527 (+   156us) service_pool.cc:224] Handling call
0709 12:18:20.866956 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.865165 (+998209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.848330 (+983165us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54003e7954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:22.848661 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259363584}
I20260709 12:18:23.019372 23081 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.042735 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.045820 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.048156 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:23.032958 23170 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.057224 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.049139 22901 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:23.059062 23027 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.008s
I20260709 12:18:23.066983 20253 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:23.070767 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.080435 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:23.056239 23007 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.097355 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.080781 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:23.080219 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:23.110651 20174 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:23.071422 23027 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.114595 20247 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:23.115125 20330 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.596s	user 0.014s	sys 0.007s
I20260709 12:18:23.115657 20330 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:23.115830 23027 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.076300 22384 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:18:23.116485 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:23.118855 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:23.101569 20253 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:23.123770 23098 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:23.124526 23098 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.127175 23098 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.129837 20172 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.131111 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:23.071029 22964 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.132861 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.079612 22886 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:23.139878 20248 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:23.096611 23093 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:23.119671 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:23.147228 20175 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:23.148665 23007 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.149652 23093 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.080349 22938 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:18:23.153257 23093 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.155550 20177 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:23.162880 21041 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:23.164070 23098 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.166528 23098 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:23.167169 23098 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.167892 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.168787 21038 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:23.168015 20329 raft_consensus.cc:2955] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:23.142210 23170 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:23.172067 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 119494us
I20260709 12:18:23.071259 23081 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:23.076140 23138 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:18:23.183614 20252 raft_consensus.cc:2410] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:23.188337 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.174654 22938 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.193624 20248 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:23.176905 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:23.199916 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.194108 22938 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.201357 23188 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:23.200701 22384 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.184278 22964 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:23.207038 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.184484 22886 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.209334 23188 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.214977 22384 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.217108 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2627) took 1225 ms. Trace:
I20260709 12:18:23.218525 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2069) took 1229 ms. Trace:
I20260709 12:18:23.207893 22938 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.222914 21038 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:23.211796 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.220616 20171 rpcz_store.cc:276] 0709 12:18:21.991285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.128993 (+137708us) service_pool.cc:224] Handling call
0709 12:18:23.216601 (+1087608us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54003e6a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:23.216864 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735618944}
I20260709 12:18:23.221218 20180 rpcz_store.cc:276] 0709 12:18:21.988969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.059338 (+ 70369us) service_pool.cc:224] Handling call
0709 12:18:23.218158 (+1158820us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54000a28d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:23.218329 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859628800}
I20260709 12:18:23.214470 20248 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:23.230866 23081 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.233726 23179 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.235339 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.236986 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.238270 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:23.238852 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:23.239010 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.239701 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.245332 23099 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:23.245869 23099 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.235426 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.246439 20326 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:23.247757 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.244813 20322 raft_consensus.cc:2376] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4. Re-sending same reply.
I20260709 12:18:23.250105 20328 raft_consensus.cc:2368] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5.
I20260709 12:18:23.252231 20251 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:23.246773 20255 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:23.231271 22999 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.252321 20327 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:23.257042 23188 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:23.251631 23123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.008s	sys 0.025s
I20260709 12:18:23.260507 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.261790 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:23.264493 23123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.009s	sys 0.025s
W20260709 12:18:23.261994 22983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.452s	user 0.009s	sys 0.015s
I20260709 12:18:23.247107 22886 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:23.274511 22964 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.267877 22384 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.267047 21036 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:23.272307 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.254894 23126 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.281101 23160 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.277269 22983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.539s	user 0.009s	sys 0.016s
I20260709 12:18:23.284626 20251 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:23.290318 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100736us
I20260709 12:18:23.265261 23123 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:23.296447 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:23.294454 23160 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.298951 23141 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:23.299443 23141 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:23.300609 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.300611 23141 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.295665 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:23.307266 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.303398 22964 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.300590 23160 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.327597 23169 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.334581 23126 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.305028 23188 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.342008 23197 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.343307 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.348206 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.351014 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.352048 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.355698 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.356168 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:23.356827 20328 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.356910 22964 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:23.358124 22964 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.361449 21038 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:23.331113 22938 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.363443 20172 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:23.367163 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:23.365602 20253 raft_consensus.cc:2376] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9. Re-sending same reply.
W20260709 12:18:23.360370 20324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1463) took 1705 ms (client timeout 1721 ms). Trace:
I20260709 12:18:23.369742 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.339756 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.373297 22943 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:23.373618 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.378571 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:23.369477 20324 rpcz_store.cc:269] 0709 12:18:21.655311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.702560 (+ 47249us) service_pool.cc:224] Handling call
0709 12:18:23.360150 (+1657590us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540022e054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:23.360301 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317996288}
I20260709 12:18:23.377625 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.346150 21037 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:18:23.381440 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 97103.2us
I20260709 12:18:23.384069 21039 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:23.383904 22943 consensus_queue.cc:1243] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:23.386021 20325 raft_consensus.cc:606] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:23.388917 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:23.375883 22999 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:18:23.393721 22999 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:23.394097 22999 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:23.398604 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.402261 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.403005 21043 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:23.404579 23190 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.410344 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:23.411084 21041 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:23.411487 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.417342 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.435850 20255 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.441457 21041 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
W20260709 12:18:23.422282 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.860s (SENT) [suppressed 18 similar messages]
I20260709 12:18:23.455247 20328 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:18:23.425288 23207 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.321s	user 0.004s	sys 0.000s
I20260709 12:18:23.458212 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.458894 21035 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:23.461143 21043 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:23.461746 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.462560 20252 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:23.419962 23166 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.412933 22938 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.431239 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.472678 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:23.473729 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.466465 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.395207 22999 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.479193 20256 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:23.479627 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:23.483920 20247 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:23.484531 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.484712 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.488766 23123 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.491989 20253 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:23.494024 23098 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.494972 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:23.497504 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57341.5us
I20260709 12:18:23.498656 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.499922 22886 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:23.500743 22886 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:23.491428 22999 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:23.505656 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.507627 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.517171 23099 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:23.518707 20178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 422) took 1986 ms (client timeout 1860 ms). Trace:
I20260709 12:18:23.521426 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:23.522188 20174 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.522985 20255 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:18:23.519186 20178 rpcz_store.cc:269] 0709 12:18:21.532465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.561685 (+ 29220us) service_pool.cc:224] Handling call
0709 12:18:23.518453 (+1956768us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400002154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:23.518631 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650422656}
I20260709 12:18:23.524045 23062 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:23.525677 23093 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:23.526005 23093 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:23.526926 23093 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.532025 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 444) took 1420 ms. Trace:
I20260709 12:18:23.532442 20329 rpcz_store.cc:276] 0709 12:18:22.112074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.112221 (+   147us) service_pool.cc:224] Handling call
0709 12:18:22.112822 (+   601us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:22.246190 (+133368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.246222 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:22.401591 (+155369us) log.cc:844] Serialized 527 byte log entry
0709 12:18:23.167473 (+765882us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b54004342a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddae6f6b8 00007f5ddaef892b 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c
0709 12:18:23.167599 (+   126us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:23.447389 (+279790us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.467710 (+ 20321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.486241 (+ 18531us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:23.486286 (+    45us) raft_consensus.cc:1685] finished
0709 12:18:23.531779 (+ 45493us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:23.531935 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19185,"raft.queue_time_us":52781,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":44273,"spinlock_wait_cycles":90301312,"thread_start_us":373119,"threads_started":2,"wal-append.queue_time_us":213742}
I20260709 12:18:23.534718 20174 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:23.536852 23115 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:23.537379 23115 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:23.538491 23115 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.539870 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:23.541002 23125 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:23.542616 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.479235 21034 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:23.551240 20252 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:23.551947 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:23.540891 21037 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:23.546177 23093 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.575724 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.575958 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.576737 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.577075 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.577627 23141 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.578327 20323 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:23.579442 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.581627 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:23.519490 23099 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.589448 20324 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:23.568650 23105 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 12:18:23.569151 22938 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:23.593010 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 126880us
I20260709 12:18:23.594220 20250 raft_consensus.cc:2410] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:23.594871 20326 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:23.599015 23190 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:23.599778 23190 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.581801 23098 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.604894 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:23.605700 20171 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:23.611363 20173 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:23.615846 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.616189 20172 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:23.619333 20179 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:23.569128 22901 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:23.627516 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.618498 22943 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:18:23.641167 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:23.648135 22959 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:23.648291 20176 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:23.651863 22759 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.651727 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:23.652633 22943 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:23.627664 22938 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.676803 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69792.4us
I20260709 12:18:23.648821 22964 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:23.678856 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 223043us
I20260709 12:18:23.680743 22759 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.654821 23027 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:23.691886 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81094.7us
I20260709 12:18:23.663975 22943 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:23.709679 22940 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:23.698510 22959 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.710502 22940 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.712668 22959 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.712795 22940 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:23.714056 23172 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:23.689440 22938 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:23.716699 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 65117.3us
I20260709 12:18:23.717519 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.717741 22938 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.719630 23144 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:23.720091 23144 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.720444 23144 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:23.723266 20254 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:23.725610 20252 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:23.725517 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.726824 20249 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:18:23.727159 20247 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:23.727320 23106 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.728012 23106 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.728785 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:23.729749 23145 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:18:23.731765 23133 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:23.732621 22846 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.734532 20329 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:23.727165 20249 pending_rounds.cc:85] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 2
I20260709 12:18:23.744867 22759 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.747500 23031 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:23.707690 23169 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:23.752149 23169 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:23.735149 20249 pending_rounds.cc:107] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:18:23.753360 20249 raft_consensus.cc:2889] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:23.754503 23169 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:23.759531 23190 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:23.781847 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57336 (request call id 30) took 1948 ms. Trace:
W20260709 12:18:23.783754 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 444181us
I20260709 12:18:23.782341 20325 rpcz_store.cc:276] 0709 12:18:21.833341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.833571 (+   230us) service_pool.cc:224] Handling call
0709 12:18:23.781540 (+1947969us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002d96d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef2853 00007f5ddfec060a 00007f5dd94467d4 00007f5dd9446762 00007f5dd9446691 00007f5dd944660c 00007f5dd94458c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:23.781686 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3459023616}
I20260709 12:18:23.809795 20295 leader_election.cc:400] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:18:23.810266 20295 leader_election.cc:403] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:18:23.836424 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.788587 23123 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:23.809680 23115 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.848119 23007 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:23.865140 23007 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:23.865541 23007 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:23.865674 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.866454 23169 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:18:23.866617 23007 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.848285 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:23.760393 22943 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:23.853678 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 116853us
I20260709 12:18:23.854151 23160 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.861467 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 136060us
I20260709 12:18:23.762621 22901 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:18:23.872318 23123 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.874838 23123 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.786234 22940 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:18:23.887216 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:23.887354 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:23.886755 23098 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:23.914173 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:23.869436 22959 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:18:23.887681 23169 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.886315 22846 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:23.919724 23123 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:23.920253 22759 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.885164 22964 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:18:23.898761 23007 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:23.932332 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 225485us
W20260709 12:18:23.940383 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 58677.4us
I20260709 12:18:23.939016 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:23.917346 23106 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:23.946265 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:23.893257 23160 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.932816 22943 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.931416 23098 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:23.990679 22759 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:23.991210 22759 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.991688 22759 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.991258 23098 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.992971 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:23.929088 23062 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.939901 22940 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.947270 22956 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.950311 23123 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:23.898095 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:24.004431 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:24.013024 20325 raft_consensus.cc:606] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:23.988358 23141 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.986707 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:24.010319 22956 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:24.016597 22956 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.017426 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:24.018649 23226 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.019062 23226 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.019423 23226 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:24.012050 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:24.012444 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.008391 22958 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:24.020965 22958 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:24.021981 23227 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:24.022172 22958 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.023178 23227 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:24.020901 23145 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:18:24.023937 23227 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:24.024392 23227 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:24.024609 23145 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:24.025048 23145 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:24.025413 23227 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.026117 23145 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.028591 23123 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.030133 23160 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.030479 23183 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:24.030673 23160 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:24.031096 23183 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:24.031738 23058 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:18:24.031656 23133 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:24.034159 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.038597 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.015048 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:24.014159 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100105us
I20260709 12:18:24.044817 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:24.014696 22940 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:24.027038 23227 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.055411 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:24.055753 23089 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:24.055601 22940 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.056425 23089 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.060812 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.064548 23183 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.066032 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:24.066856 22886 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.070034 22886 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:24.070617 22886 consensus_queue.cc:1243] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:24.072628 22886 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:24.011375 23144 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.074692 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.075201 23144 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:24.076269 22886 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:24.077646 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.078361 21034 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:24.078747 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:24.080438 20076 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.082599 22886 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:24.083376 22886 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:24.083402 20076 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.084569 22886 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:24.086411 23220 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.519s	user 0.006s	sys 0.000s
I20260709 12:18:24.086794 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:24.090854 22943 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:24.086338 22956 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.038954 23141 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:24.039026 23062 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.048985 22846 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.052021 22964 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:24.096892 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 59754.7us
I20260709 12:18:24.048272 23145 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:24.100217 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50703.5us
I20260709 12:18:24.095696 23106 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 12:18:24.156239 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43823us
I20260709 12:18:24.100589 23058 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:24.097173 23123 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:24.161072 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71343us
I20260709 12:18:24.110200 22901 raft_consensus.cc:2764] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:18:24.164906 23105 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.165015 23141 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.166314 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.165639 23234 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:24.061133 23169 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:18:24.156256 23160 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.205117 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.205464 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.206061 20327 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:24.206255 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.206619 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.206833 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.207508 20327 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:24.207715 23106 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.171087 23093 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:24.171339 22983 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:24.168845 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:24.093786 23115 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:18:24.208356 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:24.208262 23106 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.208993 23115 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:24.209337 23115 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:24.209668 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:24.210392 23106 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.210114 23115 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.210930 23133 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:24.177601 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.212009 21037 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:24.178874 21038 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:24.212920 22959 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:24.165692 23062 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:24.208374 23093 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:24.197611 23105 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:24.214784 23093 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.204351 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.216121 23166 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.216559 23166 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.205075 23160 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.217324 23031 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.176877 22956 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.213246 23238 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.103247 23137 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:18:24.167282 23082 raft_consensus.cc:476] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:24.218703 20324 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:24.232877 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.223405 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:24.219712 20322 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.233611 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.180706 23058 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:24.203833 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.216898 23166 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.211496 23115 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.241081 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.216150 23105 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:24.220492 23123 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:24.250442 20327 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:24.252077 20328 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:24.209339 21041 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:24.247993 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.253381 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.239544 23093 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.255195 20173 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:24.194442 23233 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:24.224159 23133 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:18:24.258909 23123 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.262948 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.238212 23226 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.270413 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:24.267900 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77385.7us
W20260709 12:18:24.268181 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.272020 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.257416 23062 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:24.265568 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.268122 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.263343 22956 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.235914 23238 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:24.285313 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 88794.4us
I20260709 12:18:24.277967 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.287004 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:24.263147 22999 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:24.287706 20250 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:24.291328 20322 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:24.292320 20173 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:24.293269 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:24.292614 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:24.286320 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:24.294443 22999 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:24.305155 22999 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.306639 22999 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.308885 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.294615 22956 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.311964 23231 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:24.312290 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.311980 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.313093 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.313439 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.314268 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.314965 20328 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:24.315263 20175 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:24.316026 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.317521 20180 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:24.316363 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.313526 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.313668 20174 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:24.316761 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.314340 20173 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:24.293023 20253 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:24.330718 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:24.333984 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.334555 20179 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.336227 20329 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:24.340231 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.337661 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:24.348065 21043 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:24.345242 21036 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:24.356616 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.368489 20175 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:24.359014 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.366452 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.346590 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.329365 23160 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.373478 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.373886 21039 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:24.375999 20171 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:24.292599 23058 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.379458 20328 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 3.
I20260709 12:18:24.347031 22943 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:24.368208 23133 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.393704 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.402994 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.389780 23133 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.388737 22943 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:24.449013 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.423556 20171 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:24.426581 23246 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:18:24.431675 22993 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.477833 22993 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:24.478226 22993 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.434077 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.480299 20176 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:24.461969 23183 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:24.462620 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:24.464004 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:24.467361 23226 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:24.467474 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.469010 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.414762 22940 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:24.417740 23232 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.438656 23242 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:18:24.474731 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.417182 23233 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:24.475654 23248 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:18:24.477051 22943 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.467386 20178 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:24.484840 20251 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:18:24.481252 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.481078 20325 raft_consensus.cc:606] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:18:24.487011 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.433346 23133 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.492580 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.496199 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.506990 20322 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
W20260709 12:18:24.495481 23235 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:18:24.503713 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 90873us
I20260709 12:18:24.415012 22759 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.511762 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.511852 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.512333 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.513792 23089 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:24.514460 23240 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:18:24.515792 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.508662 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:24.518107 20178 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:24.516335 20176 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:24.532241 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:24.536202 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:24.528710 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:24.539120 20322 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:24.540227 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.543553 20250 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:24.537016 20249 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:24.506880 22901 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:24.551131 20176 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:24.495611 23233 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.560423 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:24.563798 22878 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.496435 23232 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.499239 22940 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.565954 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.497684 23183 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.585050 20180 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:24.642086 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:24.649948 20175 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:24.652159 20327 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:18:24.575347 23227 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
W20260709 12:18:24.609236 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.656122 20322 pending_rounds.cc:85] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 6
I20260709 12:18:24.659916 20322 pending_rounds.cc:107] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:24.660239 20322 raft_consensus.cc:2889] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:24.555475 23238 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.661967 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:24.572288 22759 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.578359 22964 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:24.588383 22958 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
W20260709 12:18:24.688578 23243 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 12:18:24.739019 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.566133 23232 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.701488 20249 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:24.567324 22940 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.707151 23133 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.708381 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.710525 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.720747 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.723598 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:24.734951 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:24.700551 23082 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.659341 23115 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:24.657420 22846 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.572914 22901 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:24.828480 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 262578us
I20260709 12:18:24.651906 22993 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.843855 21035 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:24.839968 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.744935 22759 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:24.905221 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:24.854725 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 343034us
I20260709 12:18:24.855876 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:24.845180 23190 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.857661 23062 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.005s
I20260709 12:18:24.838742 22956 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:24.880537 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 351852us
I20260709 12:18:24.881662 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:24.886567 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:24.875212 20255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.001s	sys 0.008s
W20260709 12:18:24.913910 20255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.001s	sys 0.008s
I20260709 12:18:24.915198 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:24.893489 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.755264 20321 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:18:24.887802 23166 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 12:18:24.853221 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:24.911782 23105 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:24.888695 23141 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:24.922827 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.924515 21043 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:24.901016 22846 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.916280 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:24.938256 20256 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:24.938531 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.902814 23115 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:24.938822 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:24.924340 23105 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:24.942687 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.944482 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:24.945798 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.924271 23089 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.937572 23062 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:24.961977 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.964462 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.939898 23027 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:24.968918 20179 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
W20260709 12:18:24.969475 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48610.5us
I20260709 12:18:24.940783 22846 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.974035 20179 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:24.975219 20178 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:24.947060 23160 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:24.946663 23105 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.912230 22759 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:24.945066 23115 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.946067 23233 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.981737 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:24.976384 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:24.992729 23268 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:24.960940 23089 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:24.994618 23089 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:24.988478 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44077.4us
I20260709 12:18:24.939225 23166 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.997993 20252 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:24.999078 23166 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:24.999770 23166 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:25.000073 23166 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.000387 23166 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:24.990018 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.941455 23265 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:18:25.004947 22759 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.005162 23274 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:24.957749 23190 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:25.005792 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63780.4us
I20260709 12:18:25.006651 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:24.990955 23062 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:25.008956 23062 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.010499 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.011389 22958 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:25.011978 22958 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:25.012806 23098 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.012900 22958 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.982507 21034 raft_consensus.cc:2410] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:25.018671 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.014272 23166 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:24.981017 23238 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.981575 23160 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:25.024658 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 50294.1us
W20260709 12:18:25.039315 23271 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:18:25.041056 23263 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:18:25.044451 23190 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:25.048702 23254 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:18:25.022948 23265 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:25.052142 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.053563 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:25.015580 23183 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.069439 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.072667 20144 leader_election.cc:400] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5.
I20260709 12:18:25.074501 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.076974 22993 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:25.084069 22999 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.777s	user 0.014s	sys 0.000s
I20260709 12:18:25.086851 20323 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:25.034608 23238 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.068658 22901 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.090076 23238 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:25.034929 23160 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:25.048729 23276 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:25.098081 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.099274 20322 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:18:25.100417 23093 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.000s
I20260709 12:18:25.106428 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.107760 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.108610 23141 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:25.109149 23141 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:25.109323 23098 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:25.110252 23141 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:25.111722 23237 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.991s	user 0.005s	sys 0.000s
W20260709 12:18:25.126796 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.134320 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:25.131672 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:25.147884 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:25.152017 20173 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:25.124485 23098 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.160357 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.167763 20322 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:25.164542 20180 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:25.175273 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:25.188293 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.193938 20172 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:25.194865 22943 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.196836 20144 leader_election.cc:400] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:25.197172 20144 leader_election.cc:403] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:25.145386 23279 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:18:25.197752 23062 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.198884 23123 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:25.199337 23245 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.919s	user 0.005s	sys 0.000s
I20260709 12:18:25.194658 23261 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:25.201174 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:25.162279 23226 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.147306 22956 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:18:25.219327 23123 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:25.221067 23166 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:25.222072 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47654.7us
I20260709 12:18:25.222340 22958 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.186559 23231 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:25.231393 20322 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:25.246622 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45519.4us
W20260709 12:18:25.249296 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52591.5us
I20260709 12:18:25.223330 23268 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.163730 23098 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.169790 23115 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:25.257768 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.261677 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.262019 23227 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:25.228601 23238 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.263535 23227 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:25.263451 23238 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.264205 23227 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:25.265754 23227 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.267234 23238 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.267273 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:25.283035 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:25.276980 23160 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.285363 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.287783 20325 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:25.256808 22940 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:25.267283 23227 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.300204 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.237380 22958 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.301147 22878 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:25.299014 22940 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.321483 23058 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.307166 23082 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.330910 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2657) took 1116 ms. Trace:
I20260709 12:18:25.333372 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.331318 20328 rpcz_store.cc:276] 0709 12:18:24.214707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.271704 (+ 56997us) service_pool.cc:224] Handling call
0709 12:18:25.330732 (+1059028us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b540025e254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:25.330839 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92166528}
I20260709 12:18:25.337308 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.339668 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.315899 22956 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.302321 22846 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.346314 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:25.326493 22940 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.348495 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:25.308414 23089 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.347923 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.351226 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.354832 21038 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.349110 20326 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.356222 21039 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:25.357545 22993 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:25.355405 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.360358 23105 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.344025 22999 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:25.362367 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.382737 21042 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.341267 23166 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:25.336771 22878 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:25.351769 21040 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:25.367131 20321 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:25.351848 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:25.370167 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.381008 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.377048 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.390569 21041 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:25.394260 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.397755 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 840) took 1075 ms. Trace:
I20260709 12:18:25.398141 21034 rpcz_store.cc:276] 0709 12:18:24.322796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.707956 (+385160us) service_pool.cc:224] Handling call
0709 12:18:25.397549 (+689593us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400472f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:25.397695 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411777920}
W20260709 12:18:25.399530 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44224.7us
I20260709 12:18:25.400226 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:25.413021 22878 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.415453 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.416190 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.352154 23190 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:18:25.385740 22999 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:25.416868 21040 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:25.397110 22993 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:25.439262 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.440972 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.438618 21040 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:25.434237 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.442118 23283 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.442210 23261 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:25.442744 23283 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.443786 23093 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.444393 23093 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.445385 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 837) took 1123 ms. Trace:
I20260709 12:18:25.445747 21035 rpcz_store.cc:276] 0709 12:18:24.322027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.322152 (+   125us) service_pool.cc:224] Handling call
0709 12:18:24.838835 (+516683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.905190 (+ 66355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.445158 (+539968us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400462150. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:25.445290 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151735168}
I20260709 12:18:25.446439 23093 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.443876 23266 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:25.448570 23259 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.612s	user 0.003s	sys 0.002s
W20260709 12:18:25.451220 23285 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.323s	user 0.000s	sys 0.002s
W20260709 12:18:25.438598 23291 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:18:25.454496 23282 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.456648 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.464119 21042 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:25.464897 21043 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.456840 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:25.423671 22999 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:25.436331 22964 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:25.436127 22958 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.488540 23166 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:25.469197 23115 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.490780 23303 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.493189 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.494061 21040 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:25.500240 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.501103 21035 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:25.507925 23105 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.510159 20326 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:25.512473 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.512854 22956 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:25.520190 21038 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:25.520183 22993 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.476187 23266 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:25.521754 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.522630 23089 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.479820 22964 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.524186 23262 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.488525 23160 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:25.526124 23295 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:18:25.527516 23293 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:18:25.554440 22964 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.561407 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.440600 22759 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:18:25.562767 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:25.538909 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45103.4us
I20260709 12:18:25.563820 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.563894 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:25.542373 23105 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:25.567718 23105 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.570294 23105 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:25.539266 21039 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.540580 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.543396 21035 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:25.544855 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.554104 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:25.540267 23082 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:25.521862 22846 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:25.573444 21034 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:25.575008 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.576967 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2652) took 1363 ms. Trace:
I20260709 12:18:25.580719 20327 rpcz_store.cc:276] 0709 12:18:24.213335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.256014 (+ 42679us) service_pool.cc:224] Handling call
0709 12:18:25.574297 (+1318283us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54002d96d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:25.576873 (+  2576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842912512}
I20260709 12:18:25.546739 23115 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.585695 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:25.594535 20251 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:25.595779 23260 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:25.596241 20251 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:25.596340 23260 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:25.596926 23260 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:25.597764 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 220791us
I20260709 12:18:25.598966 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:25.602969 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.574733 23093 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.594529 20322 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:18:25.649992 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 301565us
I20260709 12:18:25.650425 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:25.660459 20255 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:25.683777 20327 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:18:25.684099 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 85213us
I20260709 12:18:25.648631 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:25.677153 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.689163 20322 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:25.689472 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.679441 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.693121 20247 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:25.694581 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.699728 20249 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:25.694283 23082 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:25.702488 23082 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:25.703032 23082 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.648200 23232 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.584419 23089 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:18:25.683964 23166 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.714318 20327 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:25.584072 22940 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.694412 23141 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.719990 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.721336 20327 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:18:25.721423 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:25.724339 21034 raft_consensus.cc:2368] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:25.604856 23115 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.583110 23262 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.712270 22886 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:25.740960 23300 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:25.749822 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:25.785646 20250 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.746290 22964 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.750573 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.751272 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:25.752020 23294 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.431s	user 0.000s	sys 0.005s
I20260709 12:18:25.752700 23082 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.754716 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:25.799209 20247 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.748188 20252 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:25.748524 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.761345 23133 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.761677 20328 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 4: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:25.761547 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:25.747846 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:25.762862 23286 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.633s	user 0.000s	sys 0.004s
I20260709 12:18:25.816143 20330 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:18:25.818017 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2653) took 1604 ms (client timeout 2103 ms). Trace:
I20260709 12:18:25.762877 23115 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:25.821120 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 101234us
I20260709 12:18:25.821954 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.823179 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.768683 20076 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 3, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.524674 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.772320 23098 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.689807 23093 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.724984 23166 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.776729 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:25.776840 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.840026 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.771338 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 464) took 1124 ms. Trace:
I20260709 12:18:25.794083 20249 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:25.709587 23169 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:18:25.726680 23160 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:25.849124 23160 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:25.849566 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:25.850253 23160 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.851176 20249 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.759068 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 868) took 1436 ms. Trace:
I20260709 12:18:25.852696 20249 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:18:25.851778 21036 rpcz_store.cc:276] 0709 12:18:24.322616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.868993 (+546377us) service_pool.cc:224] Handling call
0709 12:18:25.418259 (+549266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.457841 (+ 39582us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:25.480814 (+ 22973us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.575995 (+ 95181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.576064 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:25.576117 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.576188 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.758861 (+182673us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400472f50. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:25.758999 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5130,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7766,"raft.queue_time_us":97,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":1214771456,"thread_start_us":46849,"threads_started":1,"wal-append.queue_time_us":106038}
I20260709 12:18:25.853991 20249 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.804102 22940 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:25.804976 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:25.867470 20256 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:25.804386 22964 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.870457 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:25.804353 20075 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 204) took 12706 ms (client timeout 15000 ms). Trace:
I20260709 12:18:25.793049 22901 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:25.809075 23082 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.833372 23232 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.813349 23262 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.846024 23145 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.813730 23305 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.796995 22846 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 12:18:25.827677 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.792102 23227 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:25.828047 23141 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:25.818526 20330 rpcz_store.cc:269] 0709 12:18:24.213652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.254369 (+ 40717us) service_pool.cc:224] Handling call
0709 12:18:25.817779 (+1563410us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54001a2054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:25.817947 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569513344}
I20260709 12:18:25.767416 23190 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:25.829445 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81710.7us
I20260709 12:18:25.892596 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:25.893904 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.793270 22886 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.829974 23303 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:25.830250 23027 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:25.832204 23260 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.837994 20250 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:25.838122 20321 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:25.833460 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:25.842847 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62940.4us
I20260709 12:18:25.845345 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.840760 20325 rpcz_store.cc:276] 0709 12:18:24.647272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.054006 (+406734us) service_pool.cc:224] Handling call
0709 12:18:25.054285 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.288337 (+234052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.771065 (+482728us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002b6954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:25.771272 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533223808}
I20260709 12:18:25.802090 20248 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:25.855710 20249 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.866297 20328 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:25.868521 20180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.002s	sys 0.009s
I20260709 12:18:25.872546 20247 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
W20260709 12:18:25.907486 20180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.002s	sys 0.009s
I20260709 12:18:25.808866 20168 tablet_service.cc:1558] Processing DeleteTablet for tablet 8271323bedc7421a87f787fc100b6efe with delete_type TABLET_DATA_TOMBSTONED (TS f5c544fad8874e818acaad733a9d14f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:18:25.838861 23268 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.873872 20251 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:25.915606 23268 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.917809 23268 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.813107 22999 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.863478 23098 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:25.919480 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.926231 20325 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:25.927332 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:25.928145 20329 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.878325 23160 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.911376 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.901362 23133 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:25.914644 23062 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:25.914995 23260 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:25.944442 20327 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:25.921579 20321 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:25.903056 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:25.925436 23123 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:25.940210 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 94958.5us
W20260709 12:18:25.959389 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 257822us
I20260709 12:18:25.878006 22901 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.880613 23232 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:25.923766 23303 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:25.918730 23027 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:25.925369 23305 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.961691 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:25.902622 23190 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:25.966135 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 63180us
I20260709 12:18:25.967267 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:25.937368 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:25.941506 23133 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:25.980134 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66600.4us
W20260709 12:18:26.026168 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 64571.3us
I20260709 12:18:26.027060 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:26.028801 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:26.026773 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52742.2us
I20260709 12:18:26.032804 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:25.968636 22993 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.036491 20329 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:26.039302 20323 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:26.025494 23276 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:26.034547 23231 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:26.023224 23133 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:26.043286 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 73332.2us
I20260709 12:18:25.972044 23279 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:18:26.034755 22958 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.048336 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:26.050679 23328 tablet_replica.cc:333] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:18:26.038359 23305 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:26.059096 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:25.871497 20075 rpcz_store.cc:269] 0709 12:18:13.097666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.097948 (+   282us) service_pool.cc:224] Handling call
0709 12:18:25.804079 (+12706131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:17.387118 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:17.590719 (+203601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:17.596216 (+  5497us) write_op.cc:435] Acquired schema lock
0709 12:18:17.598036 (+  1820us) tablet.cc:662] Decoding operations
0709 12:18:17.978231 (+380195us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:17.985714 (+  7483us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:17.985754 (+    40us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:18:17.987230 (+  1476us) tablet.cc:701] Row locks acquired
0709 12:18:17.987253 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:18:17.987452 (+   199us) write_op.cc:270] Start()
0709 12:18:17.987615 (+   163us) write_op.cc:276] Timestamp: P: 1783599497987398 usec, L: 0
0709 12:18:17.987635 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:17.988438 (+   803us) log.cc:844] Serialized 6660 byte log entry
0709 12:18:19.296830 (+1308392us) op_driver.cc:464] REPLICATION: finished
0709 12:18:20.048345 (+751515us) write_op.cc:301] APPLY: starting
0709 12:18:20.050648 (+  2303us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:20.119497 (+ 68849us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:20.145614 (+ 26117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:21.050309 (+904695us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:21.142316 (+ 92007us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:18:21.142373 (+    57us) write_op.cc:312] APPLY: finished
0709 12:18:21.142824 (+   451us) log.cc:844] Serialized 119 byte log entry
0709 12:18:21.445300 (+302476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:21.504792 (+ 59492us) write_op.cc:454] Released schema lock
0709 12:18:21.516756 (+ 11964us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:21.558681 (+ 41925us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:21.562380 (+  3699us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111573,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":731481,"apply.run_cpu_time_us":36420,"apply.run_wall_time_us":1515942,"num_ops":17,"prepare.queue_time_us":229499,"prepare.run_cpu_time_us":38043,"prepare.run_wall_time_us":879069,"raft.queue_time_us":857976,"raft.run_cpu_time_us":78651,"raft.run_wall_time_us":375995,"replication_time_us":1308982,"thread_start_us":1715759,"threads_started":5,"wal-append.queue_time_us":848034,"wal-append.run_cpu_time_us":191747,"wal-append.run_wall_time_us":2990091}]]}
I20260709 12:18:26.055434 23307 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.062467 23082 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.078778 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:26.077553 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:26.077924 23332 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:26.063014 23305 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:26.081108 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:26.064116 23093 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:26.086766 20219 leader_election.cc:400] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:26.088311 20219 leader_election.cc:403] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:18:26.052271 22846 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:18:26.089581 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45029.4us
I20260709 12:18:26.094532 23082 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:26.094887 23232 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:26.057777 22878 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:18:26.095078 20220 leader_election.cc:336] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.690s (SENT)
I20260709 12:18:26.095788 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.096640 23324 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:26.097944 23315 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:18:26.098958 23312 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:18:26.100589 23311 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:18:26.101897 23262 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.064239 23141 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:18:26.095072 23082 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:26.075999 23231 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:26.116443 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 71112us
I20260709 12:18:26.117528 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:26.086076 23089 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:26.089295 22759 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:26.084506 23305 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:26.089871 23166 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:26.076613 23227 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:26.127300 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.116328 23082 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.113183 22999 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:26.115183 22886 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.111058 23307 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:26.125430 22759 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:26.133404 23317 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:18:26.121085 23233 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.115060 22878 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:26.125818 23093 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.114416 23332 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:18:26.076319 23303 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.147328 22759 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.117286 23262 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.135151 23115 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:26.136699 23166 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.163368 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:26.165879 20328 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:26.136111 23089 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:26.163477 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.173333 22878 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:26.175266 23141 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.175918 23141 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.177150 23141 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.178771 23331 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:26.179430 23331 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.181917 23331 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:26.182520 23310 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:18:26.164964 23227 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:18:26.183719 23115 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.184302 23115 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.159330 22901 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:26.182541 23027 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.187002 23115 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:26.189986 23305 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.184226 23089 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.145653 22846 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:26.193358 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66163.9us
W20260709 12:18:26.193349 23313 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:18:26.192570 23305 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.211103 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:26.211750 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:26.216413 20249 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:26.214293 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:26.221580 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.222507 21039 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:26.223971 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.224143 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:26.224859 23344 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:26.225526 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:26.225955 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:26.226215 20248 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:26.152050 23233 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.204944 22846 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.227846 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:26.231285 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:26.227254 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.241374 21040 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:26.153625 23093 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.235210 20249 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:26.164014 22958 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.196321 23190 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:26.227310 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:26.241931 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 152843us
I20260709 12:18:26.251937 20248 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:26.250852 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:26.240089 21042 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 4 to 8, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:26.252841 21034 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.237298 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:26.214973 23141 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:26.255980 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 150137us
I20260709 12:18:26.242702 22846 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.259495 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.260131 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:26.261255 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.262110 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.262449 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.263177 20180 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:26.263322 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.263589 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.263967 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:26.262112 21037 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:26.276016 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.285569 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.267076 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:26.290644 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.299593 20323 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:26.267956 20321 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:18:26.301143 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.556s (SENT)
I20260709 12:18:26.285835 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.302784 20174 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:26.303435 20178 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:26.267835 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:26.305969 20322 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:26.300163 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.310050 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:26.268304 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:26.251039 23279 raft_consensus.cc:993] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:26.302279 20176 raft_consensus.cc:2376] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5. Re-sending same reply.
I20260709 12:18:26.315388 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.248051 23334 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:26.317836 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.319484 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.321310 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.321547 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.313921 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.311739 20248 raft_consensus.cc:2410] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:26.329784 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74578.6us
I20260709 12:18:26.328289 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.330843 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.332531 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:26.334028 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:26.336249 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.336848 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.253950 23265 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.344341 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.344309 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.266316 23332 consensus_queue.cc:1243] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:18:26.349383 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.350960 20179 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:26.197531 23231 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.354277 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.358860 21034 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:26.313894 23344 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:26.360847 20176 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:26.362684 21041 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:26.362071 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:26.368234 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.319819 23334 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.369879 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.374974 20180 raft_consensus.cc:2376] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6. Re-sending same reply.
I20260709 12:18:26.370050 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.371816 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.372835 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.377034 20179 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:26.374574 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:26.377779 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.349651 23318 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.345180 23265 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.393795 23265 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.392156 20173 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:26.348224 23279 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:26.381803 21036 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:26.402325 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.380690 23334 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.382294 23166 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.377082 23344 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.364635 23082 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.399375 23169 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:26.400396 23115 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:26.401957 23265 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.400044 23279 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.438712 20179 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:26.447306 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.428745 23342 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:26.491519 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 117036us
I20260709 12:18:26.496915 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:26.503265 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.443008 23166 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:26.524537 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.528611 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.446933 23279 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.496778 23227 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:26.398034 22958 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.537073 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:26.542371 20180 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.522442 23340 raft_consensus.cc:1081] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:26.505796 23342 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.529650 23262 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:26.557560 20178 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:26.559990 23284 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.226s	user 0.008s	sys 0.002s
W20260709 12:18:26.561715 23347 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:18:26.563700 23336 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.564277 23336 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.524847 23166 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.552538 23338 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:26.580540 23338 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:26.580967 23338 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.583750 23093 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:26.575294 23160 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.002s
I20260709 12:18:26.625667 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.626699 20178 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:26.554093 23342 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:26.558852 23350 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:18:26.554370 23233 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:26.662583 20247 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:26.667490 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.543972 23227 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.621338 23336 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.680565 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.686432 20173 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:26.693076 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 321329us
I20260709 12:18:26.694000 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.708825 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.693361 23062 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.719312 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:26.719652 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2661) took 2369 ms. Trace:
I20260709 12:18:26.722523 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:26.538264 23344 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.723865 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.725557 20256 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:18:26.726424 20251 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:26.726167 20324 rpcz_store.cc:276] 0709 12:18:24.349892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.012243 (+662351us) service_pool.cc:224] Handling call
0709 12:18:25.012617 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.013029 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.013061 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.013574 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:18:25.123944 (+110370us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:26.272918 (+1148974us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:26.718833 (+445915us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b1800476080. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf
0709 12:18:26.719010 (+   177us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.719266 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.719373 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.719421 (+    48us) raft_consensus.cc:1685] finished
0709 12:18:26.719434 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.719589 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":157562,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":1550,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"spinlock_wait_cycles":14562944,"thread_start_us":205654,"threads_started":2,"wal-append.queue_time_us":153039}
I20260709 12:18:26.734617 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:26.735752 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:26.737111 21038 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:26.738919 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:26.739820 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:26.741344 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:26.742256 23233 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:26.742697 23233 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.743047 23233 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.738961 21037 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:26.748852 23227 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:26.750494 23279 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.757650 20326 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:26.759292 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:26.760000 22846 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 12:18:26.760473 22846 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.760906 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:26.761716 21043 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:26.763113 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:26.756196 23233 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.730391 23341 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.707546 23340 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:26.763682 23082 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.764597 23137 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:26.793248 23137 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:26.794458 23137 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.763515 23266 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:26.804085 23305 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.804570 23305 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.805446 23305 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.806738 23305 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.808036 23226 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:26.808485 23226 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:26.809413 23226 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.810470 23226 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.814143 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2133) took 1033 ms. Trace:
I20260709 12:18:26.814803 23342 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.815239 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:26.815847 21041 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:26.816994 23133 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.001s
I20260709 12:18:26.817447 23133 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:26.824163 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.779110 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:26.829061 20324 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:26.770387 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:26.830410 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:26.831408 21041 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:26.831367 20326 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:26.842079 20180 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:26.814570 20175 rpcz_store.cc:276] 0709 12:18:25.781053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.782571 (+  1518us) service_pool.cc:224] Handling call
0709 12:18:25.798831 (+ 16260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.244252 (+445421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.244304 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.244358 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:26.244387 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.813922 (+569535us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54000a5854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:26.813968 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.814083 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023759744}
I20260709 12:18:26.848740 23342 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:26.780187 23141 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 12:18:26.849409 23283 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.770471 23062 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.773746 23340 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.852025 20174 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:26.852455 23340 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.767390 23233 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:26.784684 23333 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:26.855252 23333 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.856212 23333 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.856915 23339 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:26.857386 23339 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:26.857577 23333 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:26.860510 23324 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:26.860972 23324 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:26.861832 23324 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.863039 23324 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.852043 23062 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.770614 23169 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:26.865370 23169 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.865808 23169 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.872273 23277 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.872483 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.872876 23277 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:26.873978 23227 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.874059 23277 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:26.875392 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:26.858256 23339 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:26.881366 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:26.884320 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.891901 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:26.896416 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 489078us
W20260709 12:18:26.900225 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.883206 23359 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:18:26.847697 23133 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.876746 23339 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:26.884456 22878 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:26.765341 22846 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:26.875524 23277 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.846983 23318 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.946591 23227 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.878468 23283 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:18:26.896166 23062 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:26.896380 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.987725 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.993657 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.948513 23093 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:26.979992 23314 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.006338 23334 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.000s
W20260709 12:18:27.009888 23316 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.977s	user 0.000s	sys 0.010s
I20260709 12:18:27.005097 22878 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:27.007529 23303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.019s	sys 0.045s
I20260709 12:18:27.020618 23093 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:26.950112 23338 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.038612 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.007850 23062 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.042502 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:27.054216 20256 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.044412 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.041792 20247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:18:27.052412 20254 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:27.055061 20255 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:27.055269 20247 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:27.055897 20247 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.053506 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1822) took 1458 ms. Trace:
I20260709 12:18:27.056835 20253 rpcz_store.cc:276] 0709 12:18:25.593405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.593535 (+   130us) service_pool.cc:224] Handling call
0709 12:18:25.597424 (+  3889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.597773 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.597805 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.598282 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:18:25.756859 (+158577us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b180004cde0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:18:25.883636 (+126777us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:25.883692 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.883776 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.955859 (+1072083us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b24001422c8. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9 00007f5dd7e4aa55 00007f5dd7e4a09d 00007f5ddaa7c10e 00007f5ddaa9388c 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221
0709 12:18:27.051268 (+ 95409us) raft_consensus.cc:1685] finished
0709 12:18:27.051301 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.051466 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13002,"raft.queue_time_us":1748,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7144,"spinlock_wait_cycles":27504128,"thread_start_us":126511,"threads_started":1,"wal-append.queue_time_us":296227}
I20260709 12:18:27.047613 23093 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.064424 20252 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:27.066375 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:27.063023 23265 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.006s
I20260709 12:18:27.068316 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:27.069325 21040 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.062136 23279 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.069208 23336 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.081254 20247 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.078168 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:27.082099 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.088811 23368 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:18:27.089828 23062 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:27.092835 23338 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.023972 23314 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.023444 23334 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.098556 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:27.099978 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:27.101608 23372 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:27.103873 23169 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:27.104856 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.107489 23169 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:27.100512 23373 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:18:27.109079 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:27.109897 21034 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.113737 21042 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:27.108788 22759 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:27.115193 22759 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:27.116497 22759 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:27.118014 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.118661 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.108422 23303 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.122618 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.148837 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.124398 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.149770 20175 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.150243 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:27.128623 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.129812 20247 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:27.151096 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.152237 20248 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:27.151101 20256 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:27.150837 20250 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.154007 21043 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:27.154716 21040 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:27.123306 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.133369 23226 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:27.136150 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:27.137012 22878 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.137684 21039 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:27.137988 23334 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.138131 20249 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:27.140278 23314 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.142023 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:27.194010 20254 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:27.142745 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.181560 23093 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.144040 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.144997 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.197988 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.198695 20327 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:27.199018 20180 raft_consensus.cc:2410] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:27.146507 21041 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:18:27.200151 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.150944 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:27.200977 21042 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:27.200881 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.168606 21034 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:27.164134 20177 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:27.172483 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.172999 20322 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:27.174011 20250 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:27.174437 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.203851 20325 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:27.177431 23279 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.180004 20323 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:27.180812 22956 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:27.180835 20321 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:27.169911 23226 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:27.184672 21036 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:27.109066 23340 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.212024 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.212674 20327 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:18:27.185591 20175 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:27.186743 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:27.187625 23367 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.180s	user 0.003s	sys 0.000s
I20260709 12:18:27.188563 23277 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:27.192217 22901 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:27.192395 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.230036 22901 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:27.230360 20176 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:27.230521 22901 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:27.194543 20328 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.143467 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:27.195322 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72084.3us
I20260709 12:18:27.196305 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:27.146158 20253 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:27.204263 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.198693 20326 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:27.174695 23336 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:18:27.206368 23303 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:18:27.210124 20323 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:18:27.218140 23377 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:18:27.221163 23374 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:18:27.211481 21036 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:27.224690 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.226015 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.229120 20179 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:27.249087 20175 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:27.205583 23183 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:27.216286 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.207903 23334 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.240188 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.245478 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.245308 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.240387 20326 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.211884 22956 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.237977 23133 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.237457 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.204744 23314 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:27.242974 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.250079 23268 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:27.248961 20328 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:27.250376 20321 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:27.234936 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.253877 20326 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.261250 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.261951 20326 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:27.241909 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55259us
W20260709 12:18:27.234674 23370 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 12:18:27.242763 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:27.235762 23227 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:27.256554 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:27.257994 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 373549us
I20260709 12:18:27.207911 23279 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.262504 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:27.233013 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.263059 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:27.267654 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.256951 23231 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:27.269474 20144 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.872s (SENT)
I20260709 12:18:27.270737 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:27.269305 23169 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:27.275894 23283 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:27.276522 23268 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.276782 23340 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.279402 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.282045 23335 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.282055 23277 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:27.231559 22901 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.265372 23183 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.293632 23105 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:27.294010 20220 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.312312 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.294629 23303 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:27.278319 23133 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:27.296470 23166 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:27.264911 23341 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.301388 20326 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:27.255256 23334 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.273101 23227 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.278497 23236 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:27.312312 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:27.282433 23137 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:27.286229 22846 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.265117 23314 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.286588 23232 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:27.331972 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 62533.3us
I20260709 12:18:27.333875 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:27.320315 23282 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.320637 23133 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.337028 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:27.322870 23321 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.329195 23227 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.331943 23236 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.362138 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:27.363780 21040 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:27.338753 22846 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.339442 23169 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:27.352907 23133 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.367753 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.340298 22878 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.368598 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:27.376628 21034 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.347482 22901 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.334679 22759 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:27.325263 23340 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:18:27.351236 23266 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:27.333106 23137 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:27.321534 22956 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.366777 23236 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.361946 23232 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.351476 23338 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:27.371332 22846 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.369331 23098 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:18:27.369441 23238 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:27.356935 23268 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.381007 22878 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.389997 23137 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.407341 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:27.408054 23382 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:27.410992 23314 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.412017 23334 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.413126 23279 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.394196 23266 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.383083 23169 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.416903 21034 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:27.425194 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:27.427096 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 114866us
I20260709 12:18:27.429252 23389 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:27.429948 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.418097 23238 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.429816 23265 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:27.430684 23344 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:27.442042 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:27.426371 23338 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:27.395952 23231 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.442055 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:27.427110 22886 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:27.446012 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:27.446043 23277 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:27.475739 22886 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:27.476480 23277 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:27.476979 22886 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:27.452822 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.453125 23387 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:27.453909 23231 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.443310 23238 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.480083 23226 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.481261 23226 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.460119 23356 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:27.487156 23356 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:27.487346 22964 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:27.461172 23319 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.405s	user 0.003s	sys 0.000s
I20260709 12:18:27.487915 22964 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.488965 22964 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.489807 23231 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.497553 22878 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.437846 23123 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.466415 23328 raft_consensus.cc:2243] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:27.445005 23338 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.501394 23328 raft_consensus.cc:2272] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:27.502214 23338 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.503556 23338 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.439543 23266 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.469677 23093 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.443850 23334 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:18:27.505997 23334 consensus_queue.cc:1243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:27.470119 22999 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:27.506652 22999 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.439594 23169 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.474588 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.442723 23324 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.477025 23277 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:27.451830 23232 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.478585 23387 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:27.509801 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 71419.2us
I20260709 12:18:27.533315 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:27.512406 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:27.515245 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.516732 23328 ts_tablet_manager.cc:1916] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:27.511442 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.523952 21041 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:27.509306 22999 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.534287 21040 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:27.541517 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.539255 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:27.526500 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52027.2us
I20260709 12:18:27.543282 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.467234 23236 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.533555 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.532325 22759 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.544121 23233 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:27.553249 23356 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.554911 23356 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.555920 23233 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.556126 23277 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.557034 23233 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.545475 23387 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.540143 23333 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:27.548982 23137 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.551925 20173 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:27.565269 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:27.566576 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:27.569547 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:27.570765 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.575120 23303 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.577878 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.579182 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:27.581362 23282 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.572077 23141 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:27.572885 22940 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:27.574563 22759 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.607724 23141 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:27.609007 23141 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.543998 23123 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:18:27.611814 23236 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:27.573923 23279 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:27.571738 22878 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:27.630275 21036 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.635068 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:27.591363 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:27.584909 23339 raft_consensus.cc:2764] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:27.577569 23333 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:27.624286 23133 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.613189 23305 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:18:27.642577 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 51322us
I20260709 12:18:27.622586 23238 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.669925 20327 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:27.670329 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.671186 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.677076 20328 raft_consensus.cc:2376] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7. Re-sending same reply.
I20260709 12:18:27.589915 22940 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:27.677887 20327 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:27.672379 20325 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:27.682035 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:27.633931 23279 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:27.654487 23123 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.655963 23265 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.692575 23137 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.693655 23133 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:27.694151 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:27.694640 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.695680 20323 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:27.679950 22940 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.701462 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.702770 21037 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:27.704499 23169 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.704563 23227 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.705199 23169 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.706849 23227 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:27.707231 23169 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:27.725917 23395 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 12:18:27.664696 23098 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:18:27.685708 21036 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.711719 21041 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:27.714388 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.665333 22943 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:27.729988 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.731451 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:27.731727 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.732235 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.742348 20176 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.742425 20328 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:27.730283 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:27.667878 23344 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:18:27.739960 20247 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:27.740351 20252 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:27.744964 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.745523 20251 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:27.734778 22940 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.751695 23387 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:27.748301 23333 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:27.713757 23279 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.746837 20250 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:27.752146 20323 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:18:27.758795 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.664661 23389 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:18:27.764122 20321 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:18:27.727594 23238 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.761523 20175 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.763352 23387 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.773026 23387 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:27.777171 22940 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:27.779873 20254 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:27.744256 20327 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:18:27.762507 20328 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:27.783126 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:27.762878 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.760914 20323 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
W20260709 12:18:27.784162 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.766928 20326 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:27.753805 22943 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.786355 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:27.797991 23277 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:27.798445 23277 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.800580 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.801169 20327 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:27.802017 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:27.789129 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 151098us
I20260709 12:18:27.810207 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.811069 20327 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.735426 23265 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.814739 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:27.817322 20175 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:27.818496 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.808645 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:27.819108 20247 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:27.819204 20252 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:27.798807 23277 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.790880 22943 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.846102 20247 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:18:27.847268 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.856841 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:27.860589 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.858846 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:27.824633 20180 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:27.799151 22901 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:27.830590 22846 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:27.816027 23282 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:27.832940 22759 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.813593 23303 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:18:27.835917 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:27.836509 23336 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:27.842319 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:27.882490 20323 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.883512 20251 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:27.887176 21034 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:27.889478 20255 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:27.875243 23266 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:27.872195 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:27.882891 22901 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:27.874689 23328 ts_tablet_manager.cc:1929] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:18:27.914215 20323 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:27.915313 23328 log.cc:1199] T 8271323bedc7421a87f787fc100b6efe P f5c544fad8874e818acaad733a9d14f1: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/wals/8271323bedc7421a87f787fc100b6efe
I20260709 12:18:27.888938 23282 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:27.895186 23336 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:27.940322 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.941563 20251 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:27.942512 20175 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:18:27.942919 20175 pending_rounds.cc:85] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 1
I20260709 12:18:27.943140 20175 pending_rounds.cc:107] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:18:27.943372 20175 raft_consensus.cc:2889] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:27.943602 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.944294 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.943459 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:27.945104 20172 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.949517 20175 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:27.951292 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.954030 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.953451 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.954761 20174 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:18:27.902606 23266 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:27.906714 23238 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:27.952175 20175 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:27.964943 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.965288 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:27.973614 20179 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:27.966562 20247 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:27.969099 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.970266 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:27.975998 20251 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:27.977092 20252 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:27.929414 23227 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.983937 20178 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:27.987964 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:27.996039 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.916538 23277 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.002496 20172 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:28.006161 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:28.006984 20179 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:27.987161 23238 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:28.010393 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 184650us
I20260709 12:18:28.012385 21042 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:28.015800 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.016536 20178 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:28.021987 20176 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:27.987430 23227 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.034543 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.035322 20179 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:28.024238 23145 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:18:28.041157 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:28.042160 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:28.000633 22901 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.042768 20256 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:28.043110 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:28.043711 20177 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:28.044626 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.046144 20249 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:28.047186 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.047634 23334 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:28.049424 23227 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:28.050520 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.008074 23282 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.054167 23408 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:28.054865 23408 consensus_queue.cc:1243] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:28.055395 23389 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:28.055727 23389 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:28.019198 23336 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.056409 20256 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:28.056600 23389 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.057574 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:28.058446 23227 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:28.042778 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:28.059019 23227 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:28.059741 22846 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:28.059973 23227 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:28.060757 23397 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:18:28.064443 23342 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.064565 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.065232 20247 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:28.065142 23342 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.067281 23342 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.041177 23277 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:28.065359 20176 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:28.072290 20327 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:28.058324 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:28.080880 23098 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:28.082489 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:28.083616 23098 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:28.084899 23328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45116 (request call id 75) took 2276 ms. Trace:
I20260709 12:18:28.085547 23098 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:28.086413 23403 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:18:28.088413 23401 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:18:28.088584 23098 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:28.014928 23266 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.094311 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.098881 21036 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:18:28.102121 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.102195 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:28.103164 20256 raft_consensus.cc:2410] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:28.107808 20254 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:28.112465 20253 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:28.098146 23226 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.115283 21036 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:28.046769 23238 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.125185 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:28.120148 23324 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:28.096837 23344 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:18:28.149960 20178 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:28.151643 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:28.113104 23303 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:28.085479 23328 rpcz_store.cc:276] 0709 12:18:25.808185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.808502 (+   317us) service_pool.cc:224] Handling call
0709 12:18:26.032011 (+223509us) ts_tablet_manager.cc:1151] Deleting tablet 8271323bedc7421a87f787fc100b6efe
0709 12:18:26.034424 (+  2413us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:18:27.603446 (+1569022us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:27.871460 (+268014us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:28.084788 (+213328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1405311,"tablet-delete.queue_time_us":99967,"thread_start_us":57428,"threads_started":1}
I20260709 12:18:28.122987 23339 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:18:28.159240 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:28.162844 20253 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:28.151073 23141 raft_consensus.cc:2764] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:28.161500 21037 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [7.6-8.7]
W20260709 12:18:28.174839 23399 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.427s	user 0.003s	sys 0.000s
I20260709 12:18:28.179930 22878 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:28.180821 23339 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.181336 23339 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:28.188076 23411 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:18:28.180521 22878 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.150204 23324 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:28.191737 22878 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:28.192265 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.167182 22943 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.196980 23339 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:28.198911 20172 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:28.207912 20172 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:28.199992 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.202445 20174 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:28.201138 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:28.211166 20174 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:28.206172 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.665s (SENT)
W20260709 12:18:28.228380 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.204373 23324 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:28.209081 20172 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.231943 20322 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:28.212074 20174 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.235419 20172 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.235965 20174 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.242755 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:28.190164 23305 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:18:28.229703 23336 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:28.252012 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 135334us
I20260709 12:18:28.236760 23391 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:28.258906 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:28.260291 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 133760us
I20260709 12:18:28.273774 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:28.281883 20174 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:18:28.283505 20174 pending_rounds.cc:85] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:28.284613 20174 pending_rounds.cc:107] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:28.285688 20174 raft_consensus.cc:2889] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:28.247001 23341 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.292375 20172 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:18:28.293116 20172 pending_rounds.cc:85] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:28.293349 20172 pending_rounds.cc:107] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:18:28.293581 20172 raft_consensus.cc:2889] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:28.293576 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:28.298130 23425 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:28.299379 22943 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:28.248924 23333 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:28.299772 23425 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:28.300189 23333 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.302336 23333 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.305246 22901 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.305608 23344 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:28.305770 22901 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.262651 23305 consensus_queue.cc:1243] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:28.262315 23391 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.292889 23334 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:28.318702 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.254562 23238 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:18:28.328598 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.319700 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77067.5us
I20260709 12:18:28.321712 23233 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.319615 20253 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:28.330864 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:28.325186 23336 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:28.308799 23366 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:28.309029 23314 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.319545 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74134.1us
I20260709 12:18:28.332294 21040 raft_consensus.cc:2410] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:28.342386 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.312700 23307 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.292351 22878 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:18:28.314397 23344 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:28.317700 23277 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:28.319747 23391 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:28.344342 23123 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.646s	user 0.014s	sys 0.000s
I20260709 12:18:28.326988 23334 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.370690 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.312065 23341 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.315888 22759 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:18:28.413936 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.400329 22901 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:28.362555 23366 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:28.372666 23279 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.000s
I20260709 12:18:28.367183 23338 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:28.401218 23123 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:28.418609 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 99907.2us
I20260709 12:18:28.375360 23334 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:28.344588 23233 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.425024 21040 pending_rounds.cc:85] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 6
I20260709 12:18:28.425328 21040 pending_rounds.cc:107] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:18:28.425542 21040 raft_consensus.cc:2889] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:28.420864 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50276.3us
I20260709 12:18:28.360939 23314 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:28.420631 23417 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:18:28.369853 23277 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.367182 23344 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:28.429462 23419 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:18:28.431845 20171 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:18:28.423316 23279 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.423024 23338 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.427983 23336 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.441115 23233 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:28.444448 23356 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.889s	user 0.014s	sys 0.002s
I20260709 12:18:28.482627 23437 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:28.488771 23366 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.458631 23314 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:28.461725 23418 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:18:28.466197 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.493964 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.469170 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:28.480913 23338 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:28.495643 20327 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:28.427215 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.496707 22846 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:28.496901 23436 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:28.483492 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 120291us
I20260709 12:18:28.497541 22846 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:28.498232 22846 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:28.498968 23266 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:28.500759 23266 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:28.501420 20328 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:28.479032 23427 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:28.483758 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:28.503710 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:28.505028 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 207504us
W20260709 12:18:28.505061 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.505944 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:28.506780 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:28.507462 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.503196 20327 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:28.508641 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:28.509007 20249 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:28.509837 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:28.503144 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:28.513460 20325 raft_consensus.cc:2410] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:28.503686 20321 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.516122 20178 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:18:28.500836 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73696.1us
I20260709 12:18:28.485101 22964 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:28.526930 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 164950us
I20260709 12:18:28.527875 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.499106 22846 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.500839 23344 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.518486 22886 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:28.518196 23227 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:28.542659 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:28.543095 20321 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:18:28.544387 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:28.546411 23183 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:28.546736 23438 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:28.547609 23366 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:28.524896 23305 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.516345 22878 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:28.571174 20178 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:28.535935 23233 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:28.572708 20178 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:28.570119 23432 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.573769 20178 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.558364 23227 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.558120 22901 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.519430 23391 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.583849 21036 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:28.582827 23227 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.548642 23123 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:18:28.593894 23421 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:18:28.592088 22901 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.586462 23442 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:18:28.572177 23366 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.575117 22878 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.578423 23344 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:18:28.572324 23439 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:18:28.613318 22878 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:28.615057 23434 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:18:28.597681 23441 raft_consensus.cc:2764] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:28.579998 23233 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.611809 23366 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:28.593130 23432 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:18:28.666633 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 102268us
I20260709 12:18:28.665910 22940 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:28.694037 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 173777us
W20260709 12:18:28.706300 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 140805us
I20260709 12:18:28.707242 21036 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:28.709761 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:28.711176 20253 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:28.713809 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.668666 23307 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:18:28.712805 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:28.716414 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:28.717073 20324 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:18:28.698554 23279 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.711431 20252 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:28.721154 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:28.721870 20252 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:28.723078 23452 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:28.724179 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:28.724884 20321 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:28.724733 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:28.723603 23452 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.727523 23452 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:28.693506 22940 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.693241 23277 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:28.712613 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.755748 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.756228 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.757184 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.755831 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.757854 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.758087 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:28.758905 20179 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:28.760625 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:28.767169 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:28.770527 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:28.771157 21036 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:28.773185 20252 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:28.711234 23457 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:28.777347 20179 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:28.713281 22901 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:28.781828 20179 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:28.784906 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:28.785434 20329 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:18:28.758458 20256 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:28.803778 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.813874 20251 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:28.780680 23442 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.781129 23277 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.790105 23307 consensus_queue.cc:1243] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:18:28.790084 22901 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.815014 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53206.4us
I20260709 12:18:28.790447 23334 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:28.821273 23448 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
W20260709 12:18:28.851970 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125499us
I20260709 12:18:28.788376 23457 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.803259 23444 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:18:28.859616 21040 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:18:28.860438 23338 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:28.861930 20324 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:28.864260 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:28.870138 20250 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:28.875893 20323 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:28.844002 22901 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.888639 20173 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:28.841801 23277 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.869225 23333 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.896605 20321 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:28.874202 23463 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:28.874311 23460 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.926749 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 623) took 1197 ms. Trace:
I20260709 12:18:28.927525 21038 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:28.891812 23277 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:28.928421 20255 rpcz_store.cc:276] 0709 12:18:27.729232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.729384 (+   152us) service_pool.cc:224] Handling call
0709 12:18:27.752497 (+ 23113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.889952 (+137455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.926480 (+1036528us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003ca0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:28.926681 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314554624}
I20260709 12:18:28.888213 23391 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.935071 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:28.869530 23452 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:18:28.897125 23449 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:28.978868 23334 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:28.981449 23462 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:28.995519 23451 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.996193 23451 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:28.998545 23451 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.957341 22940 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.963088 23389 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.961642 22901 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.003634 23233 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:28.974485 23324 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.000s
I20260709 12:18:29.004369 23324 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.007171 23324 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:29.008775 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.014473 23446 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
W20260709 12:18:29.017635 23393 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.264s	user 0.006s	sys 0.000s
I20260709 12:18:29.020365 23457 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:28.895509 22878 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.028273 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:29.024885 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.029778 20325 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:29.030972 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.032588 21042 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:29.034086 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:29.038141 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 436) took 1372 ms. Trace:
I20260709 12:18:29.038646 21041 rpcz_store.cc:276] 0709 12:18:27.665698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.665846 (+   148us) service_pool.cc:224] Handling call
0709 12:18:27.666167 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.735803 (+ 69636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.037817 (+1302014us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b5400662454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:29.038063 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101190912}
I20260709 12:18:29.043614 20172 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:28.948455 23333 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:18:29.058894 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.061650 21041 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:29.042740 23457 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:28.934060 23460 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:29.060303 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 478001us
I20260709 12:18:29.074913 20247 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:29.075335 20247 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:29.061120 23467 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.077329 23467 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.096160 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.096662 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.097631 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:29.100679 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.103857 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.101532 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:29.141304 20247 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.146597 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.130807 23226 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:18:29.074095 23457 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:29.151115 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:29.152365 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:29.152525 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.149734 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.150281 21038 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:29.149251 20327 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:29.130898 23277 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.161093 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:29.161856 23456 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:18:29.155753 23467 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:29.086982 23338 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:29.178954 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:29.146652 23468 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:18:29.180634 23336 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:29.184350 23227 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
I20260709 12:18:29.184825 23227 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.188329 22878 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.188642 23389 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:29.188886 20174 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:18:29.189147 22878 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.189111 23389 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:29.189918 22878 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.190986 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.131515 23442 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:29.192097 23389 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.193504 23389 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:29.157400 23457 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.194417 21042 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:29.198340 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:29.153429 23454 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:29.199764 23454 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:29.199921 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.200587 21041 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:29.200742 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:29.202571 23338 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:29.203050 23338 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:29.169766 20248 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:29.168910 23277 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.172853 23460 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.201403 23467 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:29.201026 23454 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.199961 23468 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:29.205138 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.243602 21038 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:29.149102 20255 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:29.244864 23277 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.245811 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.246703 20256 raft_consensus.cc:2410] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:29.246837 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:29.215870 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.247522 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.229389 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:29.229807 23338 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.252923 20251 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:29.230517 23227 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.234361 23460 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.234974 23366 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.556s	user 0.014s	sys 0.000s
I20260709 12:18:29.235556 22878 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.247416 20255 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:29.259052 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:29.266170 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.269981 21035 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:29.272507 21035 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:29.275012 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:29.277809 23366 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.287745 23468 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:29.277982 23460 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.290215 23468 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.290616 23468 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:29.264289 23422 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.785s	user 0.002s	sys 0.000s
I20260709 12:18:29.302064 20255 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:29.278414 23449 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:29.309825 23460 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.310611 23464 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:29.311342 23464 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.311864 23471 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.312435 23471 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.288455 23227 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.314002 23227 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.314743 23471 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.315733 23334 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.316215 23227 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.316215 23334 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.319340 23334 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.324671 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.326368 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.291543 22943 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:29.332928 23449 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:29.333079 20326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1509) took 1664 ms (client timeout 1668 ms). Trace:
I20260709 12:18:29.333424 23449 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:29.333508 20326 rpcz_store.cc:269] 0709 12:18:27.668767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.668952 (+   185us) service_pool.cc:224] Handling call
0709 12:18:29.332911 (+1663959us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b5400087ad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:29.333018 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127124352}
I20260709 12:18:29.335054 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 437) took 1666 ms. Trace:
I20260709 12:18:29.335426 21034 rpcz_store.cc:276] 0709 12:18:27.668224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.668368 (+   144us) service_pool.cc:224] Handling call
0709 12:18:29.334823 (+1666455us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54006d1fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:29.334969 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441713024}
I20260709 12:18:29.291209 23366 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:29.328517 23457 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.345933 20251 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:29.361846 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 455) took 1408 ms. Trace:
I20260709 12:18:29.397490 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.398334 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.398252 20171 rpcz_store.cc:276] 0709 12:18:27.953789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.953932 (+   143us) service_pool.cc:224] Handling call
0709 12:18:27.954220 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.471066 (+516846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.361604 (+890538us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000c5dd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:29.361789 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097803008}
W20260709 12:18:29.397663 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.356817 23305 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:29.400128 23305 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:29.401152 23305 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.388540 21037 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:29.402370 23305 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.405118 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:29.406762 20175 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:18:29.407250 20175 pending_rounds.cc:85] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:29.407519 20175 pending_rounds.cc:107] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:18:29.407914 20175 raft_consensus.cc:2889] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:29.411585 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:29.413162 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:29.307523 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:29.421016 20255 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:29.341277 23457 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:29.434360 23123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.029s	sys 0.033s
I20260709 12:18:29.387537 23340 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.358145 23141 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.314014 23464 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:29.372447 23105 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.433915 23261 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:29.454069 22943 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.475216 20179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.040s	sys 0.127s
W20260709 12:18:29.504890 20179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.040s	sys 0.127s
W20260709 12:18:29.470219 23123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.030s	sys 0.034s
I20260709 12:18:29.456795 23166 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.463809 23282 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:29.464679 23463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.027s	sys 0.039s
W20260709 12:18:29.474100 22846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.030s
W20260709 12:18:29.555510 20180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.030s	sys 0.034s
I20260709 12:18:29.503966 23141 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.539486 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:29.539760 23344 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:29.504026 23321 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:18:29.508811 23105 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.566936 20255 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:29.507854 23307 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.520320 22943 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:29.556384 22846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.000s	sys 0.031s
W20260709 12:18:29.570524 20180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.030s	sys 0.035s
I20260709 12:18:29.497730 23340 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:29.556208 23463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.027s	sys 0.040s
I20260709 12:18:29.586063 23307 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.542994 23166 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.597501 23265 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.585321 23344 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.599690 21036 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:18:29.593084 23105 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.593721 21043 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:29.601207 23344 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.601500 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 875) took 1045 ms. Trace:
I20260709 12:18:29.602035 23341 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.601922 21043 rpcz_store.cc:276] 0709 12:18:28.556078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.556253 (+   175us) service_pool.cc:224] Handling call
0709 12:18:29.593117 (+1036864us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:18:29.593358 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.601206 (+  7848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.601438 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17451264}
I20260709 12:18:29.544510 23282 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.590371 23141 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.594509 23340 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:29.599167 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 905) took 1074 ms. Trace:
I20260709 12:18:28.179265 20064 catalog_manager.cc:5028] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): tablet 8271323bedc7421a87f787fc100b6efe (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:18:29.606683 21040 rpcz_store.cc:276] 0709 12:18:28.524267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.525357 (+  1090us) service_pool.cc:224] Handling call
0709 12:18:28.525743 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.862862 (+337119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.598851 (+735989us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54006e0854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:29.599079 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767175424}
I20260709 12:18:28.011982 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:29.639020 22846 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:29.639238 20064 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.46006e+06us
I20260709 12:18:29.639979 22846 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.647466 22846 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.648023 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.653954 23123 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.654558 23123 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:29.655696 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.656378 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.657094 23123 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.657306 20327 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:29.657622 20253 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:29.657976 20253 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:29.658807 20253 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.660234 20253 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.660631 20178 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.675227 23366 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:29.676043 22943 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:29.635624 23457 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.680382 23457 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:29.691111 23408 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:29.691629 23408 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:29.693301 23408 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.704566 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:29.705518 20250 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:29.712215 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:29.715706 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.729557 20178 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:18:29.792622 20178 pending_rounds.cc:85] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:29.792986 20178 pending_rounds.cc:107] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:29.793282 20178 raft_consensus.cc:2889] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:29.794034 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2192) took 1235 ms. Trace:
I20260709 12:18:29.794343 20178 rpcz_store.cc:276] 0709 12:18:28.558711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.558866 (+   155us) service_pool.cc:224] Handling call
0709 12:18:28.571049 (+ 12183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.659831 (+1088782us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b58004facd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae540aa 00007f5ddaed6447 00007f5ddaeeefe7 00007f5ddaef07de 00007f5ddaefab49 00007f5ddaefb416 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4
0709 12:18:29.793749 (+133918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.793974 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274587392}
I20260709 12:18:29.732352 23449 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.735504 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 874) took 1180 ms. Trace:
I20260709 12:18:29.803200 20324 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:29.694938 23408 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.743494 20253 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:29.748965 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1523) took 1984 ms. Trace:
I20260709 12:18:29.752372 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 466) took 1029 ms. Trace:
I20260709 12:18:29.805660 20172 rpcz_store.cc:276] 0709 12:18:28.723338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.755975 (+ 32637us) service_pool.cc:224] Handling call
0709 12:18:29.752170 (+996195us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400102f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:29.752312 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644349184}
I20260709 12:18:29.761850 23166 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.763053 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:29.807221 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44302.8us
I20260709 12:18:29.808030 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:29.810667 23464 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:29.811183 23464 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.811666 23464 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:29.816497 23339 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:18:29.816866 23277 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:29.804811 20322 rpcz_store.cc:276] 0709 12:18:27.764773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.764895 (+   122us) service_pool.cc:224] Handling call
0709 12:18:27.765207 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.235328 (+470121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.748700 (+1513372us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540040f954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:29.748893 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072787200}
I20260709 12:18:29.802315 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.818667 20328 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:29.806526 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.819651 20327 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:29.762635 23468 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.803591 21039 rpcz_store.cc:276] 0709 12:18:28.555239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.555397 (+   158us) service_pool.cc:224] Handling call
0709 12:18:29.734654 (+1179257us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:18:29.734892 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.735130 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.735161 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.735210 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.735248 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.735310 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.735437 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19146624}
I20260709 12:18:29.821779 20330 raft_consensus.cc:2368] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
I20260709 12:18:29.824090 23468 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.828948 23457 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.830906 23307 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.837563 20247 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.816409 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:29.840015 23282 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.841531 23277 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:29.842161 23277 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:29.844002 23277 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:29.850569 23449 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:29.851554 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:29.853153 23227 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:29.854579 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:29.855515 23227 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:29.855947 23227 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.856314 23227 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:29.858837 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.564s (SENT) [suppressed 22 similar messages]
I20260709 12:18:29.864413 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1883) took 1143 ms. Trace:
I20260709 12:18:29.865041 20253 rpcz_store.cc:276] 0709 12:18:28.720843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.767446 (+ 46603us) service_pool.cc:224] Handling call
0709 12:18:28.767822 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.657516 (+889694us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b54003c1a20. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefa1c0 00007f5ddaefb231 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c
0709 12:18:29.863990 (+206474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.864339 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124843904}
I20260709 12:18:29.867966 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.869244 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:29.876236 20175 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:29.863515 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:29.887221 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:29.887929 20254 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.889629 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:29.893559 20247 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:29.896574 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.898370 23481 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.897727 23389 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.899964 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:29.900245 23433 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:18:29.900894 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.901711 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.971658 20328 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:29.902303 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:29.972798 20330 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:29.895615 20074 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 6 to 7, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:29.886822 23463 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.906862 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.974860 20324 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
W20260709 12:18:29.909567 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.909646 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47107.5us
I20260709 12:18:29.976724 20172 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:29.909648 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 103460us
W20260709 12:18:29.924883 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52756.8us
I20260709 12:18:29.888321 21037 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:29.938786 23468 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:29.986203 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:29.925755 21041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.029s	sys 0.031s
I20260709 12:18:29.928908 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:29.937417 20329 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:29.920933 23307 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:29.941619 20254 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:29.967499 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:29.976676 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:29.920090 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:29.992802 20178 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:18:29.993225 20326 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:29.992069 20175 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:29.992923 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:29.921535 23344 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:29.995733 20074 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:29.995024 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:29.996294 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:30.000269 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:30.001165 20172 raft_consensus.cc:2410] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:29.926102 23305 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:30.011451 20076 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 308) took 22035 ms (client timeout 15000 ms). Trace:
W20260709 12:18:30.011516 20256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.011s	sys 0.051s
W20260709 12:18:30.012311 20256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.051s
W20260709 12:18:29.992574 21041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.030s	sys 0.032s
I20260709 12:18:29.983354 23389 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.001901 23344 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.001175 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:30.042673 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:30.014488 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.144s	user 0.019s	sys 0.057s
W20260709 12:18:30.043866 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.020s	sys 0.058s
I20260709 12:18:30.062187 20330 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:29.984696 23226 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:29.994731 23265 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.045284 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 1.17563e+06us
I20260709 12:18:30.079663 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:30.040661 23305 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.081446 23344 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.081914 23305 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:29.982314 23481 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.085156 23481 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.002111 23314 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:30.091854 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:30.092038 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 90901us
I20260709 12:18:30.098121 20172 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:29.984030 23169 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:18:30.101451 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:30.104781 20172 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:30.104122 21034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.017s	sys 0.057s
W20260709 12:18:30.105455 21034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.017s	sys 0.058s
I20260709 12:18:30.013603 23431 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:30.014359 23183 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:30.092926 23324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.030s	sys 0.012s
I20260709 12:18:30.098207 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:30.098932 20176 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.027s	sys 0.033s
I20260709 12:18:30.041256 23478 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:30.112663 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.989346 23282 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:18:30.113466 20074 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 4 to 5, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
W20260709 12:18:30.012238 20076 rpcz_store.cc:269] 0709 12:18:07.956181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.956374 (+   193us) service_pool.cc:224] Handling call
0709 12:18:12.422970 (+4466596us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5de0cb6e9c 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:18:29.991609 (+17568639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:26.126786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:26.147471 (+ 20685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:26.147538 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:18:26.147556 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:26.148368 (+   812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:26.148476 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:26.148515 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:26.148996 (+   481us) tablet.cc:701] Row locks acquired
0709 12:18:26.149048 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:18:26.149210 (+   162us) write_op.cc:270] Start()
0709 12:18:26.149368 (+   158us) write_op.cc:276] Timestamp: P: 1783599506149145 usec, L: 0
0709 12:18:26.149420 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:18:26.227849 (+ 78429us) log.cc:844] Serialized 1317 byte log entry
0709 12:18:27.034417 (+806568us) op_driver.cc:464] REPLICATION: finished
0709 12:18:27.193810 (+159393us) write_op.cc:301] APPLY: starting
0709 12:18:27.193921 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:27.194089 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:27.209072 (+ 14983us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:27.213816 (+  4744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:27.217617 (+  3801us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:18:27.217704 (+    87us) write_op.cc:312] APPLY: finished
0709 12:18:27.218106 (+   402us) log.cc:844] Serialized 35 byte log entry
0709 12:18:27.218359 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:27.218498 (+   139us) write_op.cc:454] Released schema lock
0709 12:18:27.218586 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:27.219179 (+   593us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:27.219223 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1776062,"reported_tablets":24,"spinlock_wait_cycles":1244600704,"child_traces":[["op",{"apply.queue_time_us":79915,"apply.run_cpu_time_us":3367,"apply.run_wall_time_us":25302,"num_ops":3,"prepare.queue_time_us":166844,"prepare.run_cpu_time_us":10732,"prepare.run_wall_time_us":204449,"raft.queue_time_us":463429,"raft.run_cpu_time_us":2107,"raft.run_wall_time_us":37894,"replication_time_us":884818,"thread_start_us":573417,"threads_started":4,"wal-append.queue_time_us":175439,"wal-append.run_cpu_time_us":100435,"wal-append.run_wall_time_us":1820436}]]}
W20260709 12:18:30.110953 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.120594 20219 leader_election.cc:400] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
I20260709 12:18:30.169421 20219 leader_election.cc:403] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:18:30.110222 23338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.000s	sys 0.030s
W20260709 12:18:30.170136 23338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.001s	sys 0.031s
I20260709 12:18:29.990248 23463 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.172799 23463 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:30.131924 20176 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.028s	sys 0.033s
I20260709 12:18:30.112604 23342 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:30.111755 23324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.030s	sys 0.012s
I20260709 12:18:30.112179 23133 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:30.154619 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.174494 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75661.6us
W20260709 12:18:30.175339 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50731.6us
I20260709 12:18:30.176900 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:30.184276 20172 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:30.181454 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:30.167955 23481 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.097388 23265 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.096956 23226 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.208287 23389 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.183349 23464 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.210075 23226 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:30.192768 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 72346.9us
I20260709 12:18:30.183976 20074 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 3, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.195046 23481 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:30.195683 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.196516 23486 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:18:30.197319 23479 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:18:30.198099 23477 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:18:30.192365 23133 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:30.174197 23478 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.182808 23166 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.206460 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:30.252959 20248 raft_consensus.cc:2410] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:30.174671 23459 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:30.207284 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:30.255195 20247 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:30.244367 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:30.211503 23464 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:30.246604 20172 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:30.246104 20074 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:30.269039 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:30.272220 21042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.011s	sys 0.003s
W20260709 12:18:30.273402 21042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.011s	sys 0.003s
W20260709 12:18:30.274879 21035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.004s	sys 0.023s
W20260709 12:18:30.275251 21035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.004s	sys 0.023s
W20260709 12:18:30.275553 20251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.000s	sys 0.014s
W20260709 12:18:30.276681 20251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.001s	sys 0.014s
W20260709 12:18:30.278347 21038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.005s	sys 0.009s
W20260709 12:18:30.279294 21038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.006s	sys 0.009s
I20260709 12:18:30.228363 23457 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
I20260709 12:18:30.194543 23463 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.193297 23433 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:18:30.250913 23133 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:30.280093 23329 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.348s	user 0.005s	sys 0.014s
I20260709 12:18:30.265683 23459 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.342857 23166 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:30.345396 23461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.015s	sys 0.025s
W20260709 12:18:30.376362 21043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.014s	sys 0.011s
W20260709 12:18:30.346704 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 77760.6us
I20260709 12:18:30.242523 23307 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
W20260709 12:18:30.273808 23452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.011s	sys 0.021s
W20260709 12:18:30.354203 23440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.808s	user 0.000s	sys 0.026s
W20260709 12:18:30.391613 21043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.011s
W20260709 12:18:30.375310 23329 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.446s	user 0.006s	sys 0.015s
I20260709 12:18:30.393185 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:30.248062 23342 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
W20260709 12:18:30.403952 23452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.012s	sys 0.021s
I20260709 12:18:30.353345 22886 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:30.404263 23440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.858s	user 0.000s	sys 0.028s
I20260709 12:18:30.346771 22846 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:30.374475 22956 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:30.250950 23233 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.123s
W20260709 12:18:30.460747 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 67687.3us
I20260709 12:18:30.248292 23389 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:30.368046 23480 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:30.365056 23141 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:30.443181 23477 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:18:30.463694 20074 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.390336 23459 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.394287 23305 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.509876 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 892) took 1170 ms. Trace:
I20260709 12:18:30.463315 23339 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.464227 20173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.005s	sys 0.036s
I20260709 12:18:30.369244 23463 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:30.548709 20173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.335s	user 0.007s	sys 0.038s
I20260709 12:18:30.516489 23438 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:30.524583 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 888) took 1327 ms. Trace:
I20260709 12:18:30.580473 21041 rpcz_store.cc:276] 0709 12:18:29.197152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.201226 (+  4074us) service_pool.cc:224] Handling call
0709 12:18:29.201836 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.202188 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.202214 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.203261 (+  1047us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.013095 (+809834us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:30.013550 (+   455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.013645 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.524279 (+510634us) raft_consensus.cc:1685] finished
0709 12:18:30.524307 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.524505 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7097,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":13642,"thread_start_us":809400,"threads_started":1,"wal-append.queue_time_us":1139141}
I20260709 12:18:30.376441 23282 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:18:30.526252 22956 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:30.530071 21034 rpcz_store.cc:276] 0709 12:18:29.339051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.339297 (+   246us) service_pool.cc:224] Handling call
0709 12:18:29.339658 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:29.340343 (+   685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.340388 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:29.341044 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 12:18:30.107608 (+766564us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:30.107675 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.107782 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.509615 (+401833us) raft_consensus.cc:1685] finished
0709 12:18:30.509640 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.509804 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1900,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9481,"thread_start_us":766113,"threads_started":1,"wal-append.queue_time_us":1131551}
I20260709 12:18:30.511790 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 890) took 1257 ms. Trace:
W20260709 12:18:30.527629 23227 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260709 12:18:30.501919 23452 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:30.464494 23454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.006s	sys 0.038s
I20260709 12:18:30.557864 23482 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:18:30.411377 23461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.016s	sys 0.028s
I20260709 12:18:30.600000 21038 rpcz_store.cc:276] 0709 12:18:29.254890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.255027 (+   137us) service_pool.cc:224] Handling call
0709 12:18:29.274283 (+ 19256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.282386 (+  8103us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:29.282432 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.283028 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.741572 (+458544us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4800200358. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:18:30.279763 (+538191us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:30.279828 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.279926 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.511377 (+231451us) raft_consensus.cc:1685] finished
0709 12:18:30.511410 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.511713 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7440,"raft.queue_time_us":8830,"raft.run_cpu_time_us":4700,"raft.run_wall_time_us":453032,"spinlock_wait_cycles":3481984,"thread_start_us":996360,"threads_started":1,"wal-append.queue_time_us":1226810}
I20260709 12:18:30.550473 23437 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:30.615327 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2704) took 1799 ms. Trace:
I20260709 12:18:30.602898 23438 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:30.610318 23443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.035s	sys 0.028s
I20260709 12:18:30.614741 23265 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.671325 23265 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.671864 23265 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.672529 23438 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.673034 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 916) took 1212 ms. Trace:
I20260709 12:18:30.674072 23265 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.623111 23105 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:30.676478 23166 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.676798 23105 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:30.675890 21035 rpcz_store.cc:276] 0709 12:18:29.460720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.461038 (+   318us) service_pool.cc:224] Handling call
0709 12:18:29.461439 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.461938 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.461981 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.462524 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.275664 (+813140us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:30.275716 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.275794 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.672814 (+397020us) raft_consensus.cc:1685] finished
0709 12:18:30.672833 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.672966 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1926,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5638,"thread_start_us":756454,"threads_started":1,"wal-append.queue_time_us":1037079}
I20260709 12:18:30.677983 23105 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.680577 23463 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.681638 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 889) took 1484 ms. Trace:
I20260709 12:18:30.674096 23478 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.682056 21042 rpcz_store.cc:276] 0709 12:18:29.197457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.270485 (+ 73028us) service_pool.cc:224] Handling call
0709 12:18:29.270883 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.283617 (+ 12734us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:29.283663 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.284193 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.274688 (+990495us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:30.274916 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.275203 (+   287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.681403 (+406200us) raft_consensus.cc:1685] finished
0709 12:18:30.681439 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.681577 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13171,"raft.queue_time_us":12293,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4429,"thread_start_us":901584,"threads_started":1,"wal-append.queue_time_us":1338119}
I20260709 12:18:30.674899 23481 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.557372 23305 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.686018 23305 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.527858 23389 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.688139 23389 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:30.688910 20074 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 3 to 4, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:30.690532 20074 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:18:30.700330 23488 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.575s	user 0.003s	sys 0.000s
I20260709 12:18:30.699798 20074 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 3 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.701725 20074 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 5 to 6, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:18:30.681572 23463 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:30.703882 23463 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:30.704864 23463 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.705416 22886 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:30.705906 22886 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:30.615008 23455 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.458s
W20260709 12:18:30.670759 23443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.035s	sys 0.028s
W20260709 12:18:30.675505 23500 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:18:30.668108 20179 rpcz_store.cc:276] 0709 12:18:28.816162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.817013 (+   851us) service_pool.cc:224] Handling call
0709 12:18:28.817351 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.838858 (+ 21507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.838899 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.839452 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.505443 (+665991us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:29.542481 (+ 37038us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.542776 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.542889 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.644162 (+101273us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b180025f0c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:30.586361 (+942199us) raft_consensus.cc:1685] finished
0709 12:18:30.615004 (+ 28643us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.615236 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21088,"prepare.queue_time_us":38842,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":54,"raft.queue_time_us":24895,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":11879,"spinlock_wait_cycles":20237056,"thread_start_us":665503,"threads_started":1,"wal-append.queue_time_us":1144781}
W20260709 12:18:30.731916 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.732443 23105 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:30.740784 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2191) took 2214 ms. Trace:
I20260709 12:18:30.745220 20074 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.746754 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 647) took 1346 ms. Trace:
I20260709 12:18:30.747298 20251 rpcz_store.cc:276] 0709 12:18:29.400462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.405202 (+  4740us) service_pool.cc:224] Handling call
0709 12:18:29.458360 (+ 53158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.458871 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.458922 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.459555 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.342510 (+882955us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:30.342689 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.342893 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.746342 (+403449us) raft_consensus.cc:1685] finished
0709 12:18:30.746377 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.746660 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":995,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8041,"thread_start_us":759260,"threads_started":1,"wal-append.queue_time_us":897095}
I20260709 12:18:30.699249 23459 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:30.758037 23498 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 12:18:30.764427 23492 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:18:30.766644 23495 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:18:30.717161 23437 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.767983 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1890) took 1783 ms. Trace:
I20260709 12:18:30.769368 20256 rpcz_store.cc:276] 0709 12:18:28.984214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.250109 (+265895us) service_pool.cc:224] Handling call
0709 12:18:29.250456 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.253722 (+  3266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.253752 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.255100 (+  1348us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.012786 (+757686us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:30.012829 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.012899 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.763531 (+750632us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:30.767673 (+  4142us) raft_consensus.cc:1685] finished
0709 12:18:30.767699 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.767918 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2680,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":101083008,"thread_start_us":745511,"threads_started":1,"wal-append.queue_time_us":1272252}
I20260709 12:18:30.772972 23437 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.741415 20177 rpcz_store.cc:276] 0709 12:18:28.505955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.511901 (+  5946us) service_pool.cc:224] Handling call
0709 12:18:28.512261 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.666363 (+154102us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:29.100083 (+433720us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.580443 (+480360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.584146 (+  3703us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.584323 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:29.584363 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.584453 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.699769 (+1115316us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:30.712296 (+ 12527us) raft_consensus.cc:1685] finished
0709 12:18:30.719901 (+  7605us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.720142 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9053,"prepare.queue_time_us":430397,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":59956,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":7025,"spinlock_wait_cycles":8176512,"thread_start_us":1044083,"threads_started":3,"wal-append.queue_time_us":990815}
W20260709 12:18:30.828361 20252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.009s	sys 0.009s
W20260709 12:18:30.828886 20252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.009s	sys 0.009s
W20260709 12:18:30.833963 20175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.016s	sys 0.001s
W20260709 12:18:30.602202 23436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.008s	user 0.012s	sys 0.047s
W20260709 12:18:30.834431 20175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.017s	sys 0.001s
W20260709 12:18:30.617966 23454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.006s	sys 0.039s
I20260709 12:18:30.802518 20074 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 3 to 4, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.827067 23459 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:30.837239 23430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.041s	sys 0.117s
W20260709 12:18:30.836427 21040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.013s	sys 0.005s
W20260709 12:18:30.842118 21040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.013s	sys 0.005s
W20260709 12:18:30.828140 23277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.012s	sys 0.004s
I20260709 12:18:30.556550 23339 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:30.835714 23436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.244s	user 0.012s	sys 0.049s
W20260709 12:18:30.841675 23430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.041s	sys 0.117s
I20260709 12:18:30.636741 23227 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.839175 20074 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 3 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
W20260709 12:18:30.845580 21009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.008s	sys 0.048s
W20260709 12:18:30.853549 21009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.009s	sys 0.048s
W20260709 12:18:30.846995 23356 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.271s	user 0.033s	sys 0.077s
W20260709 12:18:30.845541 23277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.013s	sys 0.005s
W20260709 12:18:30.846148 23303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.000s	sys 0.017s
W20260709 12:18:30.856814 23356 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.283s	user 0.033s	sys 0.078s
I20260709 12:18:30.837594 22956 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:30.871722 21006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.000s	sys 0.018s
W20260709 12:18:30.872167 21006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.000s	sys 0.018s
W20260709 12:18:30.869273 21007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.009s	sys 0.010s
W20260709 12:18:30.875985 21007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.009s	sys 0.010s
W20260709 12:18:30.876804 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 881791us
I20260709 12:18:30.879470 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:30.880165 20326 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:30.891394 21036 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:30.892793 20176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.012s	sys 0.022s
W20260709 12:18:30.893148 20176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.012s	sys 0.022s
I20260709 12:18:30.894161 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 470) took 2134 ms. Trace:
W20260709 12:18:30.869019 23303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.000s	sys 0.018s
I20260709 12:18:30.897890 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 898) took 1030 ms. Trace:
I20260709 12:18:30.898375 21036 rpcz_store.cc:276] 0709 12:18:29.867874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.886951 (+ 19077us) service_pool.cc:224] Handling call
0709 12:18:30.897706 (+1010755us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54004ad154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:30.897835 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260718464}
W20260709 12:18:30.880291 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.894632 20176 rpcz_store.cc:276] 0709 12:18:28.759730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.760209 (+   479us) service_pool.cc:224] Handling call
0709 12:18:28.760659 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.760989 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.761031 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.769756 (+  8725us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.047599 (+277843us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:30.173981 (+1126382us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.893645 (+719664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.893833 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.893891 (+    58us) raft_consensus.cc:1685] finished
0709 12:18:30.893908 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.894087 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49862,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"thread_start_us":2067092,"threads_started":3,"wal-append.queue_time_us":306426,"wal-append.run_cpu_time_us":1726,"wal-append.run_wall_time_us":1001758}
I20260709 12:18:30.928539 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:30.929710 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:30.930214 23454 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:30.930987 23454 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.933460 23454 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.933909 23454 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.934304 23454 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.936000 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:30.937584 22846 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:30.938127 22846 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:30.940198 22846 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:30.941358 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:30.942570 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:30.945454 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:30.944461 22846 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.946067 22846 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:30.946528 22846 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.952498 23454 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:30.953527 23454 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.958184 23464 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:30.961452 23277 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:30.962016 23277 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.962503 23277 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.968555 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:30.973371 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:30.897751 23324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.008s	sys 0.011s
I20260709 12:18:30.857437 23133 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:30.988572 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:30.989782 20321 raft_consensus.cc:2410] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:30.896711 23344 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:30.991791 20253 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.009s	sys 0.018s
W20260709 12:18:30.993366 20253 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.009s	sys 0.019s
W20260709 12:18:30.996569 21008 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.005s	sys 0.024s
W20260709 12:18:30.996976 21008 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.005s	sys 0.024s
W20260709 12:18:30.997320 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.13844e+06us
I20260709 12:18:30.999591 20326 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:18:30.982076 23324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.008s	sys 0.011s
W20260709 12:18:31.007896 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.020s	sys 0.010s
W20260709 12:18:31.008293 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.020s	sys 0.010s
W20260709 12:18:31.008575 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 546880us
I20260709 12:18:31.010447 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.036267 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:31.023164 23314 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.020s	sys 0.045s
I20260709 12:18:31.032073 23443 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.043653 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:31.044759 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:31.053661 20326 raft_consensus.cc:606] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.043690 23389 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.055555 20326 raft_consensus.cc:614] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:31.030375 23333 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:18:31.008577 23344 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.058279 23305 raft_consensus.cc:2764] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:31.060217 23141 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:31.045663 23493 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:18:31.041618 23464 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:31.077201 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:31.082039 20326 raft_consensus.cc:606] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.088280 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.089237 20176 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:31.069383 23227 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.071764 23339 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.093940 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.095032 20176 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:31.040707 23314 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.021s	sys 0.046s
W20260709 12:18:31.096396 20180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.032s	sys 0.042s
I20260709 12:18:31.065428 23141 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:31.099478 23504 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:18:31.100986 20180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.032s	sys 0.042s
I20260709 12:18:31.072149 23443 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:31.106552 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:31.074486 22886 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.107203 20175 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.076009 23464 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:31.108234 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:31.113919 20176 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.111743 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.115304 20179 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:31.117074 20177 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:31.117779 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.118705 20172 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
W20260709 12:18:31.120625 20174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.052s	sys 0.077s
W20260709 12:18:31.123338 20174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.052s	sys 0.077s
W20260709 12:18:31.129112 20221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.002s	sys 0.035s
I20260709 12:18:31.128664 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:31.129474 20221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.002s	sys 0.035s
I20260709 12:18:31.106261 23227 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:31.132406 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.009s	sys 0.030s
W20260709 12:18:31.135521 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.010s	sys 0.031s
W20260709 12:18:31.136418 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 892079us
I20260709 12:18:31.117296 23464 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.129652 23133 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:31.130300 20218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.012s	sys 0.027s
I20260709 12:18:31.134847 23141 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.159897 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:31.168839 20178 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.172179 20175 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:31.145172 23227 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.176550 23227 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:31.177201 23227 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.177911 23227 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.145020 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:31.180711 23468 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.181180 23468 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.181607 23468 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.186556 20178 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
W20260709 12:18:31.193205 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.007s	sys 0.014s
W20260709 12:18:31.193710 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.008s	sys 0.014s
W20260709 12:18:31.198729 20173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.018s
W20260709 12:18:31.199250 20173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.001s	sys 0.018s
W20260709 12:18:31.207165 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.019s	sys 0.024s
I20260709 12:18:31.161609 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
W20260709 12:18:31.208197 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.019s	sys 0.024s
I20260709 12:18:31.208426 20326 raft_consensus.cc:606] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.208989 20326 raft_consensus.cc:614] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:31.157562 23503 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:18:31.211416 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 649) took 1361 ms. Trace:
I20260709 12:18:31.212734 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.213433 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.214962 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.145437 20179 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:31.218423 20179 pending_rounds.cc:85] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:31.218809 20179 pending_rounds.cc:107] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:18:31.152302 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.220078 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.171830 23513 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.221297 20179 raft_consensus.cc:2889] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:31.167143 20218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.013s	sys 0.027s
I20260709 12:18:31.200152 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:31.210042 20143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.007s	sys 0.030s
I20260709 12:18:31.191702 23133 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:31.210790 20176 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:31.231197 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:31.218472 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2706) took 2365 ms. Trace:
W20260709 12:18:31.222951 20143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.030s
W20260709 12:18:31.161039 21043 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.017s	sys 0.021s
I20260709 12:18:31.211845 20252 rpcz_store.cc:276] 0709 12:18:29.849655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.849848 (+   193us) service_pool.cc:224] Handling call
0709 12:18:29.850264 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.903437 (+ 53173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.903479 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.904136 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.829423 (+925287us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:30.829484 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.829574 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.211174 (+381600us) raft_consensus.cc:1685] finished
0709 12:18:31.211194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.211350 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52745,"raft.queue_time_us":58580,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7018,"thread_start_us":924810,"threads_started":1,"wal-append.queue_time_us":1231925}
I20260709 12:18:31.231457 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:31.156554 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.005s	sys 0.035s
I20260709 12:18:31.232286 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.234436 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.234746 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.172948 23515 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:18:31.235806 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 894) took 1561 ms. Trace:
W20260709 12:18:31.276577 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.005s	sys 0.037s
W20260709 12:18:31.277132 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46016.7us
W20260709 12:18:31.246193 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.162220 23480 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.022s
I20260709 12:18:31.278293 20179 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:31.327826 20175 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:31.329242 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:31.279194 21043 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.019s	sys 0.024s
I20260709 12:18:31.207261 23340 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:18:31.281080 23507 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.275707 23436 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:31.162358 23329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.017s
I20260709 12:18:31.238451 23133 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.286049 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.286839 23303 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:31.289816 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:31.404848 21034 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:31.405033 20248 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.405220 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.291028 23307 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:31.293066 20254 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:31.293776 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.297380 23459 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.300786 23441 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.312214 20176 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:31.412272 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.237323 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.289880 23478 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.333542 23526 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.327108 21040 rpcz_store.cc:276] 0709 12:18:29.674886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.683673 (+  8787us) service_pool.cc:224] Handling call
0709 12:18:29.684003 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.684540 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.684578 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.685128 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.843461 (+1158333us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:31.234008 (+390547us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.235393 (+  1385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.235506 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.235576 (+    70us) raft_consensus.cc:1685] finished
0709 12:18:31.235596 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.235739 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40,"prepare.queue_time_us":374764,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":2378,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":9925,"thread_start_us":1543810,"threads_started":2,"wal-append.queue_time_us":1489019}
I20260709 12:18:31.414407 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:31.327387 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.07556e+06us
W20260709 12:18:31.339901 23480 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.009s	sys 0.023s
I20260709 12:18:31.378716 23454 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.278549 20173 rpcz_store.cc:276] 0709 12:18:28.852706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.892778 (+ 40072us) service_pool.cc:224] Handling call
0709 12:18:28.893075 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.212629 (+319554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.212677 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.213638 (+   961us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.557143 (+1343505us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:30.610710 (+ 53567us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.763804 (+153094us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:31.199779 (+435975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.199878 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.199942 (+    64us) raft_consensus.cc:1685] finished
0709 12:18:31.218206 (+ 18264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.218408 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59247,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":189062,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":173,"spinlock_wait_cycles":19351936,"thread_start_us":2245568,"threads_started":3,"wal-append.queue_time_us":1315485}
I20260709 12:18:31.378608 20256 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:31.331458 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.278400 23468 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.411509 23533 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.380510 20172 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:18:31.333581 23339 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:31.418761 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:31.273926 23452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.022s
I20260709 12:18:31.233345 23105 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.383491 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:31.207100 23451 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.173s
I20260709 12:18:31.326267 23463 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.386513 23482 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.415899 23478 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.431847 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.334930 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:31.427448 23452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.009s	sys 0.022s
I20260709 12:18:31.328253 23305 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:31.245608 23356 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:31.317780 23227 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.325362 23344 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.427902 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.326762 23389 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.332906 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.333870 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.332355 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2198) took 1460 ms. Trace:
I20260709 12:18:31.396137 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.326489 23528 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:31.399529 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.399893 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2217) took 1188 ms. Trace:
I20260709 12:18:31.387001 23512 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:31.406068 21042 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:31.322065 22846 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.315502 23277 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.237112 23513 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:31.402834 23329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.011s	sys 0.021s
I20260709 12:18:31.433305 23480 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.409899 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.410614 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.303978 20178 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:31.414918 21040 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:31.454936 20248 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:31.416754 23441 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.417042 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.420655 20172 pending_rounds.cc:85] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:31.460701 20172 pending_rounds.cc:107] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:18:31.421097 20255 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
W20260709 12:18:31.443002 23520 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 12:18:31.411669 23307 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.424018 23468 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:31.420539 23459 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:31.425633 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 391298us
I20260709 12:18:31.425734 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.466252 20247 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 5: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:31.421182 23526 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:31.404536 23507 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:31.321355 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.428495 20326 raft_consensus.cc:606] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.417870 23530 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:31.422674 23537 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.434060 21036 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:31.505259 21036 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:31.422932 23339 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:31.405462 23436 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.408218 23303 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.316047 22886 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.446532 21038 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:31.431978 23451 consensus_queue.cc:1243] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:18:31.447546 20174 rpcz_store.cc:276] 0709 12:18:29.872418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.873831 (+  1413us) service_pool.cc:224] Handling call
0709 12:18:29.874200 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.919045 (+ 44845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.919079 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.921063 (+  1984us) log.cc:844] Serialized 26 byte log entry
0709 12:18:31.125741 (+1204678us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:31.125792 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.125871 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.332001 (+206130us) raft_consensus.cc:1685] finished
0709 12:18:31.332036 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.332265 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72043,"raft.queue_time_us":62050,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":16699,"thread_start_us":1204268,"threads_started":1,"wal-append.queue_time_us":1406436}
I20260709 12:18:31.450138 20249 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:31.450929 21035 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:31.447120 20250 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:31.452670 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.453860 20254 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:31.455658 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.462059 23480 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.447669 20180 rpcz_store.cc:276] 0709 12:18:30.211941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.213792 (+  1851us) service_pool.cc:224] Handling call
0709 12:18:30.242885 (+ 29093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:30.251212 (+  8327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.251247 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.251785 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:18:31.101582 (+849797us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:31.101629 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.101705 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.399651 (+297946us) raft_consensus.cc:1685] finished
0709 12:18:31.399677 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.399817 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11384,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":88689,"thread_start_us":849443,"threads_started":1,"wal-append.queue_time_us":982741}
I20260709 12:18:31.417152 20295 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.469092 23528 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:31.521560 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 104486us
I20260709 12:18:31.522424 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.523308 21035 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:31.433624 23478 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.458840 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.446995 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:31.525081 23538 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:18:31.525738 21042 raft_consensus.cc:2410] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:31.461992 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.439123 23454 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.462800 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.528213 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:31.529517 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.530081 23340 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.530591 23340 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:31.423449 20256 raft_consensus.cc:2410] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:31.531019 23340 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.461011 20172 raft_consensus.cc:2889] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.531708 20172 pending_rounds.cc:107] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:18:31.532016 20172 raft_consensus.cc:2889] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.533593 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.402702 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 895) took 1724 ms. Trace:
I20260709 12:18:31.464956 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.465337 21034 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:31.419987 23533 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.470161 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:31.438236 23452 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:31.470762 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.549155 20321 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:31.436076 23305 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:31.494081 20173 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:31.495009 20175 pending_rounds.cc:85] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:31.559376 20175 pending_rounds.cc:107] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:31.559703 20175 raft_consensus.cc:2889] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.560027 20175 pending_rounds.cc:107] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:31.560279 20175 raft_consensus.cc:2889] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.496819 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:31.431233 23105 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.499274 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:31.566496 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 113926us
I20260709 12:18:31.499208 20322 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.501298 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1483) took 1322 ms. Trace:
I20260709 12:18:31.501503 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.506539 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:31.509593 23307 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.513088 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:31.570427 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63973.7us
I20260709 12:18:31.440498 23324 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:18:31.514484 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.573187 20251 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:31.463248 23449 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:31.517802 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.455992 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.465211 23536 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.524289 23507 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.530776 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:31.439205 23482 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.520814 20174 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:18:31.534317 20249 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:31.593875 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.446802 23356 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.550129 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.534312 21043 rpcz_store.cc:276] 0709 12:18:29.678556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.678723 (+   167us) service_pool.cc:224] Handling call
0709 12:18:29.679110 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:29.679603 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.679645 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:29.680441 (+   796us) log.cc:844] Serialized 52 byte log entry
0709 12:18:30.439892 (+759451us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:31.395849 (+955957us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.402310 (+  6461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.402400 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.402497 (+    97us) raft_consensus.cc:1685] finished
0709 12:18:31.402510 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.402643 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6102,"prepare.queue_time_us":751786,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1284,"raft.queue_time_us":16375,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":2828,"thread_start_us":1679067,"threads_started":2,"wal-append.queue_time_us":1172529}
I20260709 12:18:31.602375 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.511474 23509 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.537192 23314 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:18:31.541033 23525 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:31.561277 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.561827 20179 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.461012 23512 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.569407 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:31.569381 20253 rpcz_store.cc:276] 0709 12:18:30.179039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.179190 (+   151us) service_pool.cc:224] Handling call
0709 12:18:30.179495 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.201772 (+ 22277us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:30.994602 (+792830us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.387833 (+393231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.387896 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:31.387948 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.501065 (+113117us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54003ea154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:31.501115 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.501239 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":348265,"prepare.run_cpu_time_us":2882,"prepare.run_wall_time_us":11171,"raft.queue_time_us":92,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":50626944,"thread_start_us":1185256,"threads_started":2,"wal-append.queue_time_us":514818}
W20260709 12:18:31.570786 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 57793.3us
I20260709 12:18:31.616849 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.571990 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:31.574777 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.587278 23227 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.578220 20256 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:31.518249 23527 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:31.585464 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46258.2us
I20260709 12:18:31.589138 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:18:31.591240 20323 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:31.540951 23430 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.460510 23389 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.604076 23133 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.514158 23537 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.582237 23481 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.663030 23481 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.663599 23481 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.623804 23525 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.666157 23525 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.587033 23529 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.592015 23339 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:31.614311 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 64288.7us
I20260709 12:18:31.668357 23339 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.670029 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:31.617982 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46066.2us
I20260709 12:18:31.618072 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:31.575953 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.673059 23549 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.673497 23549 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.673843 23549 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:31.674443 23544 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:18:31.583461 23546 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.630134 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:31.624487 23169 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.677436 23169 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.624150 23141 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.562085 23545 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:31.679813 23436 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.679924 23545 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.680372 23546 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.593163 23536 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.682752 23546 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.683135 23536 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.614861 23265 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:31.623894 23535 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.590886 23340 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.587474 22886 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:31.656103 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.511026 23530 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.633062 23105 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.623690 23480 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.591217 23449 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.661072 23526 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:31.662009 23305 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.647452 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:31.679850 23141 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.684514 23513 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.622063 23227 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:31.758347 23227 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.686345 23169 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:31.691797 23452 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.759917 23340 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:31.760643 23548 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:18:31.672005 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:31.762358 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 90456.7us
I20260709 12:18:31.763039 23537 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.763260 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:31.763732 23537 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:31.764175 23537 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.764552 23537 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.764575 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.696593 23441 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.697984 23459 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.698979 23277 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.621272 22956 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:31.704627 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.767119 20323 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:31.592232 23464 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:31.709093 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 141785us
I20260709 12:18:31.768692 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.769171 23464 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.769738 23464 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:31.770378 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.770640 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.771104 20329 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:31.772922 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.773238 21041 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:31.654583 20179 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:31.644107 23507 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.778146 23536 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:31.778683 23536 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.779184 23536 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:31.742547 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.615913 23509 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:31.780158 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.701095 23389 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.781000 23389 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.750820 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.781414 23480 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.781649 23509 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.781898 20326 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
W20260709 12:18:31.753266 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 105907us
I20260709 12:18:31.782150 23480 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.782431 22846 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.783828 20327 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:31.784216 23530 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.772056 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.786106 20325 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:31.792037 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.791436 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.793258 20253 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:31.793664 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.797107 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:31.798612 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.795392 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.711242 23535 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:31.819661 23535 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.802042 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:31.802559 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.824380 23449 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:31.826023 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:31.826431 23463 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.828449 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:31.804317 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:31.805430 23533 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.806356 23141 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.804262 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:31.790143 23324 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:31.831012 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.831265 20330 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.831359 23324 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:31.832680 23324 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.806991 23305 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:31.834314 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.807729 22846 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:31.808264 23480 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.836330 22846 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:31.837590 22846 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.838759 23536 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.808179 23277 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.644716 23527 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.808663 23513 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:31.841207 23513 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:31.842103 23527 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.650161 23528 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.842348 23513 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:31.707599 23546 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:18:31.845309 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:31.846110 20322 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.816668 23478 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.817157 23303 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.818328 23545 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.829138 23356 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:31.863765 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 68432.6us
I20260709 12:18:31.829362 23463 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:31.816349 23482 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:31.846628 20329 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.847985 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.810768 23512 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:31.709545 23265 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:31.714430 23436 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:31.881691 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.882520 20330 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:31.882972 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:31.910948 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:31.913147 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:31.913354 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 65503.7us
I20260709 12:18:31.913826 20321 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:31.886507 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:31.914702 20323 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 1.
I20260709 12:18:31.891682 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:31.916397 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:31.917287 20179 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:31.904124 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.862520 23480 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.933791 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.942515 21034 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:31.937278 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.920579 20177 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:31.926263 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.927908 21040 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:31.929679 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.945479 20250 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:31.930876 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.946965 20256 raft_consensus.cc:2410] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:31.933333 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.934043 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.902614 23545 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.959542 20329 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:31.954988 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:31.963876 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.965080 20247 raft_consensus.cc:2410] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:31.965693 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:31.967700 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 330068us
I20260709 12:18:31.956269 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:31.941426 23482 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.941020 23480 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.955799 23463 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.919713 23512 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:18:31.991743 20322 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
W20260709 12:18:31.999202 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.920521 23436 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.974581 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:31.989682 23480 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:32.037151 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 365924us
I20260709 12:18:32.051054 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:32.052031 23449 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:32.038049 23555 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:32.079860 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 310393us
I20260709 12:18:32.039795 23546 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:32.124040 23340 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:32.110110 23449 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:32.128561 23554 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:18:32.129592 23553 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:18:32.131237 23535 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:32.133001 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60558.2us
I20260709 12:18:32.033412 23561 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:32.034162 23463 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:31.987957 23265 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.049582 21037 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
W20260709 12:18:32.145475 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 234606us
W20260709 12:18:32.150944 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 259389us
I20260709 12:18:32.137799 23555 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:32.044369 23558 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:18:32.166349 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.166890 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.179735 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.167464 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.167879 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.167135 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.180303 21036 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
W20260709 12:18:32.183554 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 64829.4us
I20260709 12:18:32.142161 23546 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.137354 23481 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.056617 23549 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.184778 23555 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:32.217027 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69794.6us
I20260709 12:18:32.195310 23546 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.245808 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:32.247200 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:32.219116 23265 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.250705 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:32.248198 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:32.254143 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:32.223309 23513 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.255828 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:32.227025 23536 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.260980 20180 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:32.275381 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.244668 23478 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.257439 23537 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:32.305219 23572 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:18:32.327692 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 142661us
I20260709 12:18:32.239849 23449 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.336706 20175 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:32.262270 23513 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.346884 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:32.347430 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:32.320636 23436 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:32.370394 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 417307us
W20260709 12:18:32.371083 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.373309 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:32.374442 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:32.375229 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.368674 23227 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.000s
W20260709 12:18:32.407150 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.387034 23482 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:32.420850 23549 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:32.421226 23564 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:18:32.421033 23339 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.422470 23339 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.383343 23569 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:32.384967 23481 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.373065 23536 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:32.373172 23535 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.384661 23452 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:32.385010 23463 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.438060 23536 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:32.442719 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.476553 23513 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.476737 23570 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.477602 23570 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.479247 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:32.433303 21037 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:32.448688 23589 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:32.483610 20256 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:32.484580 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:32.427917 23537 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.507625 20247 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:32.508833 20256 pending_rounds.cc:85] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 6
I20260709 12:18:32.525195 20256 pending_rounds.cc:107] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:18:32.525503 20256 raft_consensus.cc:2889] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:32.449165 23452 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:32.546581 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 62141.2us
I20260709 12:18:32.551712 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:32.566308 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:32.570657 20326 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:32.570902 20323 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:32.572422 20324 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:32.572500 20329 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:32.574342 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.513562 23227 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.548421 23537 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:32.546487 23452 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.588145 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.610111 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:32.609916 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.609041 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.611881 20330 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:32.613091 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.615026 20323 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:32.542433 23480 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.609500 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.618049 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.604717 23570 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.668732 23339 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:32.568473 23535 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:32.747774 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:32.575707 23583 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:32.581151 23586 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.576526 23592 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:32.581941 23478 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:32.749356 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:32.762315 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.764283 20330 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:32.814870 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:32.813715 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51325.6us
I20260709 12:18:32.823243 20176 raft_consensus.cc:2368] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:32.831614 20252 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:32.874437 20247 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.876828 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.879861 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.881486 20256 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.813331 23482 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.814978 23227 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:32.886483 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:32.899447 20252 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:32.900036 23265 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.641s	user 0.016s	sys 0.009s
W20260709 12:18:32.900992 23594 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.474s	user 0.005s	sys 0.002s
W20260709 12:18:32.902652 23546 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.009s
I20260709 12:18:32.888294 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.813345 23537 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:32.904647 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.904569 23537 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.780700 23535 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.897298 23480 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.822819 23339 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.903937 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:32.904857 23556 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.946s	user 0.000s	sys 0.010s
I20260709 12:18:32.896097 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.905927 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.919796 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.815477 23463 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.903025 23546 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.906387 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:32.883258 20326 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:32.899482 23482 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.924278 20329 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:32.831849 23536 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:32.830767 23481 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.915112 23141 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:32.839892 23478 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:32.917547 23535 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.837894 23583 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.916028 23227 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:32.874437 23586 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.917832 23576 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:32.942842 23605 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:18:32.940301 23555 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.010s
I20260709 12:18:32.943915 23555 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.947438 23555 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:32.947773 23576 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.926254 23463 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.949757 23546 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.921169 23569 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:32.950531 23537 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.952414 23583 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:32.953537 23535 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.956202 23482 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.958235 23586 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:32.933362 23478 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.963541 23463 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.963007 23569 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.933921 23481 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:32.969663 23481 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:32.881844 23592 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:32.826093 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:33.015023 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.016767 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.018977 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 192771us
W20260709 12:18:33.020576 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.021958 20173 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:33.022452 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:33.028003 20173 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:33.036470 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:32.903236 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.038044 20180 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.038931 20252 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:33.039402 20253 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:33.041584 20253 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.044816 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:33.052408 20256 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:33.047489 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:33.069197 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:33.069303 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:33.070302 20328 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:33.073989 21043 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:33.068187 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:33.082250 20324 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:33.087399 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:33.084473 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:33.085531 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:33.083320 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:33.090077 23265 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.922880 23339 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:32.929009 23141 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:33.063869 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:33.068176 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:33.091325 23265 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:33.113562 20180 raft_consensus.cc:2410] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:33.091267 23227 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.116806 23463 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.118235 23593 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.118927 23463 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.121692 23583 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.122378 23463 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.123345 23592 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.120833 23604 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:33.116882 23482 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:33.121773 23586 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.130657 23480 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:33.124536 23305 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.133983 23305 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.135813 23481 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:33.136242 23536 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.123518 23583 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:33.126001 23586 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:33.142004 20179 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:33.124719 23604 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.125141 23482 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.140583 20253 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:33.151715 23482 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.125161 23452 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.152549 23481 consensus_queue.cc:1243] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:33.153796 23480 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:33.154382 23480 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.154820 23480 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.154924 23452 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.151132 23535 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.144081 23586 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.157159 23339 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.157598 23586 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.159269 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:33.142484 23583 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.159439 23586 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.150601 23513 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.171986 23513 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.173230 23305 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.173484 23227 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.150162 23265 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.174889 23583 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.170572 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.178015 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:33.184011 23513 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.184566 23583 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.187533 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.205983 20175 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:33.190238 23340 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:33.191469 20176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2724) took 1276 ms (client timeout 1604 ms). Trace:
W20260709 12:18:33.208344 20176 rpcz_store.cc:269] 0709 12:18:31.914890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.915016 (+   126us) service_pool.cc:224] Handling call
0709 12:18:33.190932 (+1275916us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540015de54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:33.191208 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981752704}
I20260709 12:18:33.209020 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:33.210276 23340 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:33.210768 23340 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:33.211201 23340 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.217263 23169 raft_consensus.cc:993] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:33.218169 23169 raft_consensus.cc:1081] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:33.192896 20174 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:33.197383 23265 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.197546 20247 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:18:33.196858 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2710) took 1983 ms (client timeout 2011 ms). Trace:
W20260709 12:18:33.223068 20171 rpcz_store.cc:269] 0709 12:18:31.213467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.234503 (+ 21036us) service_pool.cc:224] Handling call
0709 12:18:33.196247 (+1961744us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001d2ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:33.196588 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678870784}
W20260709 12:18:33.192478 20177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2709) took 1979 ms (client timeout 2241 ms). Trace:
W20260709 12:18:33.225291 20177 rpcz_store.cc:269] 0709 12:18:31.213205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.237022 (+ 23817us) service_pool.cc:224] Handling call
0709 12:18:33.192012 (+1954990us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003e6f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:33.192254 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148425472}
I20260709 12:18:33.200723 23559 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:18:33.246512 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.247699 20172 raft_consensus.cc:2410] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:33.247876 23559 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:33.248433 23559 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.200449 23604 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.193276 23530 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:33.263372 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 199761us
I20260709 12:18:33.268659 23105 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:18:33.263382 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.2741e+06us
I20260709 12:18:33.263382 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:33.269083 23593 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.251834 20180 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:33.289805 23604 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.300419 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.252741 23478 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.302094 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.303411 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.304215 20252 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:33.321889 20325 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:33.303443 23478 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.330159 23356 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:33.330662 23133 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.331540 23329 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.331686 23557 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.331981 23436 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:33.332460 23329 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.334856 23105 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:33.331605 23133 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.335552 23105 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:33.330763 23356 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:33.336875 23105 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.337612 23141 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.337673 23356 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.338604 23105 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:33.340462 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2716) took 1850 ms. Trace:
I20260709 12:18:33.313221 23314 raft_consensus.cc:993] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:33.332617 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:33.251485 20172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:18:33.341449 23314 raft_consensus.cc:1081] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:33.342015 20172 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.342485 20172 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.342944 23169 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:33.343185 23615 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
I20260709 12:18:33.343364 23169 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.310926 23480 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.344496 23169 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.345629 23480 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.345916 23169 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.346967 23329 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.347729 23329 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:33.339429 23141 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.340726 23133 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.347805 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:33.330462 23482 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.350786 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:33.355046 20252 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:33.358613 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:33.249980 23559 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.354833 23356 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.356643 23480 raft_consensus.cc:2764] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:18:33.372905 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52409.2us
I20260709 12:18:33.374042 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:33.340811 23340 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.376567 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:33.383093 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61843.3us
I20260709 12:18:33.390350 23314 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:33.390857 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:33.377547 20172 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.390866 23314 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:33.425419 23314 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:33.426348 23303 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:33.426790 23303 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:33.428176 20172 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.428032 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.427171 23303 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.433602 23558 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:18:33.434473 23478 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:33.435079 23478 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:33.435626 23478 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:33.440210 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 49468.2us
I20260709 12:18:33.421921 23452 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.340920 20178 rpcz_store.cc:276] 0709 12:18:31.490440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.492991 (+  2551us) service_pool.cc:224] Handling call
0709 12:18:31.493397 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:31.700261 (+206864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.700295 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:31.700842 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.035544 (+334702us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:32.224759 (+189215us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.225023 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.339802 (+1114779us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540031a1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:33.339869 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.339931 (+    62us) raft_consensus.cc:1685] finished
0709 12:18:33.340020 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.340255 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261656,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":6179,"raft.queue_time_us":5606,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":13816,"spinlock_wait_cycles":474804480,"thread_start_us":514389,"threads_started":2,"wal-append.queue_time_us":495643}
I20260709 12:18:33.445456 23449 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.446265 23449 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.448550 23482 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.450762 23449 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.453001 23340 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.419638 23480 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:33.455291 23480 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.367488 23133 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:18:33.454802 23314 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.461959 23265 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:33.491539 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 124429us
I20260709 12:18:33.470422 23329 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:33.498677 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:33.499604 20253 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:33.478560 23480 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.507757 21038 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.508198 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:33.509565 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:33.509838 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:33.510486 21035 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:18:33.511605 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.512656 20172 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:18:33.513711 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:33.514273 20178 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.479228 23452 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:18:33.519095 20247 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:33.495214 23133 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:33.520056 23133 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:33.520200 20176 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:33.521342 23133 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.522038 20247 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:33.522516 20176 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:33.522708 23133 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.523905 23265 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.524988 23530 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:33.525604 23530 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.526407 21038 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:33.526455 23265 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.528589 23449 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:33.529834 23449 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:33.530879 23586 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.531163 23340 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:33.531323 23586 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.531498 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.531718 23340 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.532318 20250 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.532610 23586 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.532907 23340 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.534147 23586 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.534536 23530 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.539456 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.539542 23530 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:33.540393 20249 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.543998 23452 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:33.544430 23452 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:33.544713 23601 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.545360 23601 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.545631 23452 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.547118 23452 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.548079 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.548743 20179 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:33.548890 20178 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:18:33.551934 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 932) took 1383 ms. Trace:
I20260709 12:18:33.552245 21041 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:33.552189 23530 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:33.552906 23530 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:33.554765 21043 rpcz_store.cc:276] 0709 12:18:32.165924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.166053 (+   129us) service_pool.cc:224] Handling call
0709 12:18:33.548986 (+1382933us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400462154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:33.549188 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054153472}
I20260709 12:18:33.565898 20171 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:33.570843 23530 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.572345 23530 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.554030 23480 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:33.579784 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81211.3us
I20260709 12:18:33.582959 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.583187 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:33.583534 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:33.584107 20177 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:33.584415 20179 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:33.585248 23601 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.585289 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:33.588111 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.588918 20175 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:33.566354 20171 pending_rounds.cc:85] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 4
I20260709 12:18:33.591790 20171 pending_rounds.cc:107] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:33.592124 20171 raft_consensus.cc:2889] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.592445 20179 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:18:33.595733 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1500) took 1646 ms. Trace:
I20260709 12:18:33.596096 20255 rpcz_store.cc:276] 0709 12:18:31.922041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.922254 (+   213us) service_pool.cc:224] Handling call
0709 12:18:31.922652 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.922921 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:31.946889 (+ 23968us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.356012 (+1409123us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.477753 (+121741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:33.482503 (+  4750us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:33.536338 (+ 53835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.554444 (+ 18106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.568105 (+ 13661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1116295,"prepare.queue_time_us":215628,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":105,"raft.queue_time_us":1191577,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":227,"thread_start_us":397130,"threads_started":3,"wal-append.queue_time_us":661040}
I20260709 12:18:33.598428 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.599035 20255 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.543378 23478 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:33.599941 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 129520us
I20260709 12:18:33.606493 23464 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:33.608511 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.612699 20179 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:33.613799 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.599335 20249 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:33.617463 20250 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:33.624507 20247 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:33.625885 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:33.626998 20176 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:33.627267 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:33.629393 20172 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
W20260709 12:18:33.642205 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.664990 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:33.673625 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.664616 20180 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:33.664008 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:33.680612 20171 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.669890 23604 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:33.683881 20177 pending_rounds.cc:85] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:33.689143 20177 pending_rounds.cc:107] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:18:33.689410 20177 raft_consensus.cc:2889] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.639186 23436 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:33.692799 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:33.695150 20250 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:33.599947 23329 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.699589 23430 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.699944 23528 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:33.700350 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 665) took 1783 ms. Trace:
I20260709 12:18:33.700227 23430 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.700707 23528 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.698167 23480 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:33.700815 20248 rpcz_store.cc:276] 0709 12:18:31.886932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.887145 (+   213us) service_pool.cc:224] Handling call
0709 12:18:31.941529 (+ 54384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:31.942029 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:32.186420 (+244391us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.255183 (+1068763us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b1800415ea0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5ddedcc58f 00007f5dd7e0b571 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd
0709 12:18:33.263834 (+  8651us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:33.270517 (+  6683us) log.cc:844] Serialized 52 byte log entry
0709 12:18:33.270830 (+   313us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:33.419592 (+148762us) log.cc:844] Serialized 14 byte log entry
0709 12:18:33.629532 (+209940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.637884 (+  8352us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.661393 (+ 23509us) raft_consensus.cc:1685] finished
0709 12:18:33.661423 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.669902 (+  8479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1081396,"prepare.queue_time_us":273810,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":84,"raft.queue_time_us":1056827,"raft.run_cpu_time_us":503,"raft.run_wall_time_us":8627,"spinlock_wait_cycles":11129728,"thread_start_us":595479,"threads_started":4,"wal-append.queue_time_us":122251}
I20260709 12:18:33.702605 23480 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:33.703189 23480 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.678603 23593 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:18:33.710166 20249 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:33.664268 23464 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.721241 20250 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:18:33.663486 23303 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:33.732604 20171 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:33.719515 23464 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.746352 20253 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:33.757118 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:33.763603 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 76553.1us
I20260709 12:18:33.741051 23314 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:33.786461 23303 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:33.787828 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.793363 20252 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:33.795367 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.800997 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:33.803948 23601 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:33.805938 20248 pending_rounds.cc:85] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 3
I20260709 12:18:33.806361 20248 pending_rounds.cc:107] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:18:33.806666 20248 raft_consensus.cc:2889] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.793253 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.803167 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:33.826159 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.826982 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:33.828016 23141 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:33.828861 23629 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:33.830979 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.831348 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:33.827308 23513 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.832692 23513 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:33.833968 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.834203 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:33.834450 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.834879 21042 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:33.835129 23513 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.841588 23340 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.842229 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.842712 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:33.843009 20252 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:33.843972 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.845160 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.846320 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.846973 20249 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:33.838420 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.848927 20247 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.850627 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:33.745805 23436 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.851351 20171 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:33.813934 23227 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:33.816172 23464 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:33.884238 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 92692.3us
I20260709 12:18:33.892833 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.894634 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.895927 20249 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:18:33.896871 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.898114 20249 raft_consensus.cc:2410] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:33.899523 20249 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:33.887182 23227 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.904706 20252 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:33.905570 20252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:18:33.907740 23464 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:33.910575 23464 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:33.910868 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2733) took 1304 ms. Trace:
I20260709 12:18:33.911877 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:33.813823 23631 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:18:33.904724 23227 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:33.865414 23478 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:33.916671 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:33.916690 23631 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.920382 23631 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:33.920466 23576 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:33.921638 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.924293 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2734) took 1317 ms. Trace:
I20260709 12:18:33.924789 20328 rpcz_store.cc:276] 0709 12:18:32.606870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.609664 (+  2794us) service_pool.cc:224] Handling call
0709 12:18:33.923993 (+1314329us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540040f954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:33.924201 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051287296}
I20260709 12:18:33.929432 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2221) took 1687 ms. Trace:
I20260709 12:18:33.929857 20174 rpcz_store.cc:276] 0709 12:18:32.241925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.242063 (+   138us) service_pool.cc:224] Handling call
0709 12:18:33.192312 (+950249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.220353 (+ 28041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.929219 (+708866us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54003e6f50. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:33.929366 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184367488}
I20260709 12:18:33.911338 20327 rpcz_store.cc:276] 0709 12:18:32.606532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.610542 (+  4010us) service_pool.cc:224] Handling call
0709 12:18:32.610871 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.070112 (+459241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.070178 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:33.070254 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:33.070299 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.910445 (+840146us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540025e254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:33.910504 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.910663 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054368000}
I20260709 12:18:33.981530 20171 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
W20260709 12:18:33.984383 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45412.9us
I20260709 12:18:33.987145 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:33.990067 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:33.995973 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:33.996665 21040 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:33.996980 20330 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:34.000648 20255 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:34.001227 23314 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.001638 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:34.001843 23314 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.002616 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:34.002882 20247 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:34.004207 23314 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:34.008272 23586 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:34.008807 23586 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:34.009963 23586 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.014183 23583 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:34.014631 23583 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:34.015018 23583 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.025672 20174 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:34.032152 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:34.033962 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:34.036652 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.040928 21040 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:34.026356 23169 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:18:34.046481 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.046351 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 243778us
I20260709 12:18:34.050465 20247 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:33.921682 23631 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:34.062929 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.060477 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:34.049700 23559 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.076789 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.077198 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:34.081266 21040 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:34.063763 23557 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:34.081841 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.083812 22956 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:18:34.057518 23480 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.084625 23568 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:34.088023 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45336.5us
I20260709 12:18:34.088444 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.090889 20174 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:18:34.076645 23452 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.526s	user 0.013s	sys 0.000s
I20260709 12:18:34.089402 23557 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:34.084447 23637 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:18:34.090085 20252 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:34.111797 20252 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.111601 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.113271 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:34.114704 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.108781 20247 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:34.109050 23480 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:34.108651 23557 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.117029 23557 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.109724 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:34.118901 21042 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:34.109997 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.110246 23169 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:34.123030 23169 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:34.124137 23169 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.125555 23169 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.127691 23563 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:18:34.129163 22956 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:34.129257 23324 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:34.129572 22956 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:34.130124 23324 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.130650 22956 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.131901 22956 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:34.134491 23616 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.830s	user 0.000s	sys 0.003s
W20260709 12:18:34.138561 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.141041 20178 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:34.145207 21042 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:34.103350 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:34.148088 21040 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.160050 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.166515 23436 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.169080 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:34.170444 23528 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.202808 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 906) took 1837 ms. Trace:
I20260709 12:18:34.203420 21041 rpcz_store.cc:276] 0709 12:18:32.360229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.360393 (+   164us) service_pool.cc:224] Handling call
0709 12:18:33.551848 (+1191455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.552876 (+  1028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.197781 (+644905us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400462150. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:34.198032 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733386112}
W20260709 12:18:34.172035 23640 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 12:18:34.143736 20252 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.174165 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:34.176690 23638 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:18:34.183995 23631 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.194864 20256 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:34.228603 20326 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:34.151333 23568 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:34.237970 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:34.238760 21042 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
W20260709 12:18:34.221776 20220 connection.cc:256] RPC call timeout handler was delayed by -2.327157280000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 12:18:34.246780 20220 connection.cc:256] RPC call timeout handler was delayed by -2.1201572800000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 12:18:34.248210 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.170042 23430 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.256505 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:34.256239 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:34.261755 21042 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:34.261770 21041 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:34.265405 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.263134 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.269093 20321 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:34.263616 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.271979 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:34.274358 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.272615 21041 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
W20260709 12:18:34.277554 21008 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.564s (SENT)
W20260709 12:18:34.278688 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 210004us
I20260709 12:18:34.283787 20327 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.311852 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.312665 20325 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:34.315014 23480 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:34.321641 23324 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:34.277519 23558 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.329283 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 55571us
W20260709 12:18:34.336745 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.331296 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:34.341823 20173 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:34.342836 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:34.343719 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:34.345257 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:34.346800 21040 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:34.344385 20174 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:34.350754 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:34.351574 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.354775 20173 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:34.355542 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:34.353439 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:34.352821 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:34.359417 20175 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.361467 20174 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 2: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:34.369616 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.370532 20325 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
W20260709 12:18:34.371623 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 91146us
I20260709 12:18:34.384593 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:34.372852 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:34.381734 23324 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:34.391067 23324 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:34.392262 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 127305us
W20260709 12:18:34.396831 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.405272 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:34.406934 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.473875 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.488397 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 68915.2us
I20260709 12:18:34.490504 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:34.491555 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 118794us
I20260709 12:18:34.491801 23626 raft_consensus.cc:2764] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:18:34.492955 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 95073.5us
I20260709 12:18:34.485946 23430 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.501456 23452 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.501960 23430 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.502087 23452 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.504236 23452 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.504267 23430 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:34.505522 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.507375 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:34.508328 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.508121 23324 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.508925 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:34.509791 20251 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:34.509783 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.511262 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.512070 20255 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
W20260709 12:18:34.513942 23646 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:18:34.516104 23641 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:18:34.535900 23651 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:18:34.368460 23558 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:34.540702 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 156231us
I20260709 12:18:34.541911 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:34.385423 23568 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.368571 23480 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:34.549479 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.550599 23480 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.556066 20253 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:34.563449 20172 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
W20260709 12:18:34.569751 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.584230 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 93835.6us
W20260709 12:18:34.586391 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 240097us
I20260709 12:18:34.570683 23464 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.585429 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:18:34.635915 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 141937us
I20260709 12:18:34.624155 23576 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:34.644629 23557 consensus_meta.cc:287] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.003s
I20260709 12:18:34.645972 23452 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.643862 23464 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.662739 23452 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.663470 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:34.659698 20175 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:34.665596 23452 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.666225 23452 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.645859 23480 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.660742 23576 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.678408 23576 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.643536 23558 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.676894 23480 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:34.697012 23583 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.682s	user 0.015s	sys 0.000s
I20260709 12:18:34.707279 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1549) took 1829 ms. Trace:
I20260709 12:18:34.709363 20330 rpcz_store.cc:276] 0709 12:18:32.878430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.878532 (+   102us) service_pool.cc:224] Handling call
0709 12:18:33.982938 (+1104406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.997412 (+ 14474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.707037 (+709625us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540040f950. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:34.707201 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421715712}
W20260709 12:18:34.719431 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 177639us
W20260709 12:18:34.723387 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 138022us
I20260709 12:18:34.724247 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:34.725430 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:34.726177 20330 raft_consensus.cc:2376] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7. Re-sending same reply.
I20260709 12:18:34.726253 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:34.712459 23583 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:34.739615 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 76309.9us
W20260709 12:18:34.733309 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.748172 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.748917 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.729820 23627 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.753309 20330 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:34.754742 20248 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:34.755470 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:34.757442 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.758261 20321 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:34.758420 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:34.759238 23664 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:34.729640 23648 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:34.729785 23662 raft_consensus.cc:2764] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:18:34.762490 23665 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:34.763602 20326 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 1.
I20260709 12:18:34.764020 20325 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:18:34.777324 20252 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.780048 23480 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:34.764202 23648 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:34.788194 23648 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.785822 23665 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:34.791280 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:34.799755 23665 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.803673 23480 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:34.804287 23480 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:34.804622 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:34.805181 23480 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.799386 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:34.812340 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.812896 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.813705 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:34.814421 20171 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:34.815426 23430 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.815912 20179 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:34.816111 23430 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.819316 23452 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:34.820421 23452 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:34.820575 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:34.821449 23452 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.823823 23430 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.823681 23559 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:34.824787 23559 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:34.825145 23559 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:34.834779 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:34.844442 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81178.5us
I20260709 12:18:34.848536 23464 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.833892 23559 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.851922 23568 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:34.852419 20172 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:18:34.853708 23583 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.853829 23586 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.854431 23586 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.860085 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:34.834213 23626 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:34.868891 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.851511 23559 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.858500 23586 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.876199 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 504) took 1261 ms. Trace:
W20260709 12:18:34.872406 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.874640 23601 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:34.886240 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 128148us
I20260709 12:18:34.883414 23583 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.863193 23464 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:34.893472 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 501) took 1279 ms. Trace:
I20260709 12:18:34.880303 20176 rpcz_store.cc:276] 0709 12:18:33.614582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.628021 (+ 13439us) service_pool.cc:224] Handling call
0709 12:18:33.664789 (+ 36768us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:33.741495 (+ 76706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.741526 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:33.763119 (+ 21593us) log.cc:844] Serialized 52 byte log entry
0709 12:18:34.052898 (+289779us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:34.340231 (+287333us) log.cc:844] Serialized 14 byte log entry
0709 12:18:34.340933 (+   702us) log.cc:844] Serialized 14 byte log entry
0709 12:18:34.869433 (+528500us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b180048a900. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5ddaaaed70 00007f5ddaaa2293 00007f5ddaa97cea 00007f5ddaa9823a 00007f5ddaf02a2a 00007f5ddaf120bf 00007f5ddaf12038
0709 12:18:34.869783 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.869878 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.875885 (+  6007us) raft_consensus.cc:1685] finished
0709 12:18:34.875914 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.876115 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":490581,"prepare.queue_time_us":152008,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":14964,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9326,"spinlock_wait_cycles":7740928,"thread_start_us":497960,"threads_started":2,"wal-append.queue_time_us":438856}
I20260709 12:18:34.894281 20180 rpcz_store.cc:276] 0709 12:18:33.613683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.613803 (+   120us) service_pool.cc:224] Handling call
0709 12:18:33.614147 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.674206 (+ 60059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.893119 (+1218913us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5400111a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:34.893389 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115394304}
I20260709 12:18:34.887315 23277 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:34.906407 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 102233us
I20260709 12:18:34.907511 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:34.912293 23105 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:34.912724 23105 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:34.913147 23105 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:34.913590 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.823s (SENT) [suppressed 15 similar messages]
I20260709 12:18:34.921452 20177 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:34.907847 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:34.923070 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.915230 23647 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.669s	user 0.003s	sys 0.009s
I20260709 12:18:34.929937 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:34.930684 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.940842 20252 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:34.932180 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.942170 20248 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:34.932915 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.943099 20255 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:34.903719 23583 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.945561 23583 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.890117 23576 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.947692 23576 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:34.931442 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.948591 20254 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:34.937566 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:34.949791 20251 raft_consensus.cc:2410] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:18:34.936551 20294 connection.cc:256] RPC call timeout handler was delayed by -1.1989121810001961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:18:34.940884 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1918) took 1398 ms. Trace:
W20260709 12:18:34.952018 20294 connection.cc:256] RPC call timeout handler was delayed by -1.171012181000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 12:18:34.952081 20250 rpcz_store.cc:276] 0709 12:18:33.542465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.723703 (+181238us) service_pool.cc:224] Handling call
0709 12:18:33.739274 (+ 15571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.791855 (+ 52581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.791917 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.799848 (+  7931us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.049755 (+249907us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:34.049821 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.049924 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.914560 (+864636us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:34.940597 (+ 26037us) raft_consensus.cc:1685] finished
0709 12:18:34.940620 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.940824 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28108,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":4276096,"thread_start_us":231311,"threads_started":1,"wal-append.queue_time_us":332075}
I20260709 12:18:34.941854 23648 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.938676 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:34.955601 23648 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.955740 23568 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:34.956318 23568 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.944592 23105 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.958530 23568 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.961265 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:34.962842 23314 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:34.958590 23105 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.965682 23314 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:34.966199 23314 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:34.968415 23430 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.968997 23430 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.971135 23430 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:34.973126 23604 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.973368 23662 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:34.974013 23662 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:34.973860 23604 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.977665 23604 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.981176 23314 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:34.985400 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.986667 23568 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.987376 23568 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:34.990113 23568 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:34.990813 23631 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:34.992151 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.992105 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53507.4us
I20260709 12:18:34.997514 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:34.998521 20177 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:35.001722 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 79907.6us
I20260709 12:18:35.004150 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.004554 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.004874 21040 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:35.006052 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.006765 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:35.008000 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:35.008766 21043 raft_consensus.cc:2368] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:35.009909 21038 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.010560 23675 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:35.010959 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.011173 23675 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:35.011857 23324 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.012430 23675 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:34.975349 23662 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.019213 23662 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.020442 23568 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:35.021061 23568 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.021991 23626 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.022732 23583 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.036954 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:35.036998 23583 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.037803 21043 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.023515 23324 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:35.040017 23324 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.042699 23324 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:35.025930 23430 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:35.044451 23583 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:35.027150 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:35.046419 23583 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:35.046895 23583 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.047384 23583 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.023329 23568 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:35.030588 23586 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.031998 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:35.036145 21038 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.051434 21043 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:35.004158 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 96659.4us
I20260709 12:18:35.066457 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:35.095880 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.066349 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:35.101018 21039 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:35.116775 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 84877.9us
I20260709 12:18:35.117669 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:35.118738 20219 leader_election.cc:400] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:35.119192 20219 leader_election.cc:403] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:18:35.133281 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:35.105456 23631 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:35.138664 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:35.143085 23604 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.143687 23549 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:18:35.144654 23549 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:35.147744 23557 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.152181 23169 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.151786 23604 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.135790 23665 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:35.155099 23604 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:35.155427 23586 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:35.138175 23626 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.115712 23324 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:35.156412 23626 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.156075 20075 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } }
I20260709 12:18:35.157773 20075 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.158666 23626 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:35.123948 23601 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:35.159721 23549 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:35.159469 23601 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.165027 21039 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:35.140452 23631 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.104594 23583 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.159420 20075 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.141569 23303 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.188689 23452 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.174221 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:35.192080 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58888.6us
I20260709 12:18:35.178725 23631 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:35.198596 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60024.5us
I20260709 12:18:35.197979 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:35.201604 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:35.193390 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 232199us
I20260709 12:18:35.204224 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.181180 23324 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:35.216099 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:35.188345 23549 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.220908 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.220793 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:35.200747 23648 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:35.180755 23626 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 12:18:35.273084 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.210291 20075 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 4 to 6, leader changed from <none> to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 6 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.193709 23452 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.211788 23627 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:35.271624 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.272028 20177 raft_consensus.cc:2410] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:18:35.273080 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57592.4us
I20260709 12:18:35.228657 23645 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.271538 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.197072 23303 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:35.273020 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57000.9us
I20260709 12:18:35.284498 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.284992 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.283615 20176 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:35.290781 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:35.283780 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:35.293066 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.287441 23680 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.287494 23277 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:35.211333 23105 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:18:35.282467 23452 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.315928 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.316583 20173 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:35.317672 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.318305 20174 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:35.313992 23631 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.319792 23680 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.322316 23583 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:35.322762 23680 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:35.326495 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.327158 20175 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:35.328444 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.329447 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.329744 23672 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:35.330785 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.275676 23558 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:35.331853 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.331545 23558 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.333089 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:35.288414 23601 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:35.288810 23586 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.334438 23601 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:35.334762 23558 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:35.334864 23601 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:35.287523 20075 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 7, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 7 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:35.275444 23678 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:18:35.289552 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.295985 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:35.296774 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.299249 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.275688 23480 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:35.299953 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:35.335511 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.337502 20326 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:18:35.341580 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 120875us
I20260709 12:18:35.336404 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.352948 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.354671 20178 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:35.336014 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.355383 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.221464 23665 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:35.308943 20074 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 317) took 19508 ms (client timeout 15000 ms). Trace:
I20260709 12:18:35.310698 23303 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:35.275437 23324 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:35.313887 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.357477 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 62302.6us
W20260709 12:18:35.359169 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.278955 23604 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.335417 23601 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.363773 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.365859 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.364269 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:35.405146 20180 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:35.397492 20075 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:35.405736 20177 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:35.341549 23549 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.301373 23671 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.341706 23667 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:35.412454 20174 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.361179 23480 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.301512 23685 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:35.409828 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45354.9us
I20260709 12:18:35.301631 23675 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:35.346312 23670 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:35.408825 20177 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:35.416179 20175 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:35.415617 20075 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:35.419992 20180 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.420565 20174 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:35.421432 23464 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:35.421911 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63080.2us
I20260709 12:18:35.434147 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:35.368533 23303 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.416564 23627 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:35.435778 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:35.441280 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:35.435160 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 145034us
I20260709 12:18:35.449404 20178 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:35.412817 23667 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:35.400274 23604 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.427109 23480 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.458074 20327 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:35.455129 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.460741 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.434631 23670 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:35.436246 23277 raft_consensus.cc:2764] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:35.459120 20075 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.462214 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.435696 23686 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.468648 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:35.466297 20174 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:35.449532 23464 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:35.477053 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.461266 23667 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.484505 21038 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
W20260709 12:18:35.487028 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 51454.8us
I20260709 12:18:35.488924 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:35.488193 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 62556.3us
I20260709 12:18:35.439152 23672 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:18:35.490463 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:35.502687 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.491384 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:35.473709 23691 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.505221 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:35.469288 23586 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.452019 23303 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.508790 23576 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:35.476810 23671 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:35.450050 23675 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.503655 23324 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.515451 23576 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:35.515043 20075 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:35.511452 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:35.518242 23303 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:35.519493 23681 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:18:35.523329 23626 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:35.561055 23626 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:35.527119 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:35.530788 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.536412 20329 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:35.506520 23314 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.526265 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.570209 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:35.356705 20074 rpcz_store.cc:269] 0709 12:18:15.801003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.810904 (+  9901us) service_pool.cc:224] Handling call
0709 12:18:35.295306 (+19484402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:31.591001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:31.693480 (+102479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:31.693537 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:18:31.693563 (+    26us) tablet.cc:662] Decoding operations
0709 12:18:31.695206 (+  1643us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:31.695290 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:31.695316 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:18:31.818296 (+122980us) tablet.cc:701] Row locks acquired
0709 12:18:31.818318 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:18:31.818498 (+   180us) write_op.cc:270] Start()
0709 12:18:31.818640 (+   142us) write_op.cc:276] Timestamp: P: 1783599511818442 usec, L: 0
0709 12:18:31.818662 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:31.819431 (+   769us) log.cc:844] Serialized 5231 byte log entry
0709 12:18:32.986530 (+1167099us) op_driver.cc:464] REPLICATION: finished
0709 12:18:33.167157 (+180627us) write_op.cc:301] APPLY: starting
0709 12:18:33.167364 (+   207us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:33.168572 (+  1208us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:33.168819 (+   247us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:33.207661 (+ 38842us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:33.208102 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:18:33.208167 (+    65us) write_op.cc:312] APPLY: finished
0709 12:18:33.208864 (+   697us) log.cc:844] Serialized 95 byte log entry
0709 12:18:33.210537 (+  1673us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.210904 (+   367us) write_op.cc:454] Released schema lock
0709 12:18:33.210991 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:33.211733 (+   742us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.211768 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":455555,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":177205,"apply.run_cpu_time_us":6749,"apply.run_wall_time_us":45292,"num_ops":13,"prepare.queue_time_us":548696,"prepare.run_cpu_time_us":45649,"prepare.run_wall_time_us":589588,"raft.queue_time_us":41936,"raft.run_cpu_time_us":7375,"raft.run_wall_time_us":165234,"replication_time_us":1167643,"thread_start_us":1049840,"threads_started":4,"wal-append.queue_time_us":1031703,"wal-append.run_cpu_time_us":11947,"wal-append.run_wall_time_us":1323029}]]}
I20260709 12:18:35.557173 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:35.558780 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.557864 23169 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:35.488785 23593 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:18:35.558204 20254 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:35.559808 20324 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:35.548569 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.557303 23604 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:35.569356 20325 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:35.569505 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:35.556480 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:35.605049 21043 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:35.606452 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:35.576814 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.607892 21040 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:35.609356 20322 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.609421 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:35.610280 21041 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:35.610145 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.606739 21042 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.596232 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.613306 20327 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:35.616195 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.562911 20075 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.618301 20075 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:35.626874 20075 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.629786 20075 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 4 to 8, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.537118 23671 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:35.643154 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.649441 20180 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:35.477455 23686 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.479782 23665 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:35.646296 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 141163us
I20260709 12:18:35.633054 20075 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:35.542704 23576 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.545608 23689 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:35.660005 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.664541 20325 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:35.593973 23631 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:35.600174 23557 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:18:35.658047 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:35.512817 23679 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 12:18:35.652383 23671 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:35.662624 20075 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.677867 20178 raft_consensus.cc:2368] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:35.680192 20322 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:35.514302 23691 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.696903 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:35.703655 23692 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.597321 23314 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.737498 20075 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 9, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.732024 20250 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:35.668206 23169 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:35.751179 20173 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:35.742055 23604 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:35.745008 23691 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:35.753854 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.745061 23314 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:35.735013 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60777.2us
I20260709 12:18:35.677209 23586 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:35.739981 20075 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 1 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.740985 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.754365 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:35.754880 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.762300 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:35.770376 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:35.774727 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:35.775621 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:35.776364 20325 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:35.778882 20075 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.782814 20177 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:35.562930 23627 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.761744 23430 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:35.659351 23464 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.807284 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:35.771008 23586 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.647745 23670 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.781636 23688 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.781498 23709 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.813957 20075 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.799711 23430 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:35.814754 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.826174 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.764586 23662 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:18:35.792801 23558 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.795190 23685 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:35.766049 23452 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:35.830520 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 261095us
I20260709 12:18:35.819259 23698 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:18:35.841189 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:35.818116 23586 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.836823 20075 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 7, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 7 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:35.834748 21008 leader_election.cc:336] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.504s (SENT)
I20260709 12:18:35.761477 23692 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:35.798671 23687 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:35.684513 23689 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.873693 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:35.875228 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.876292 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:35.904217 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69501.9us
I20260709 12:18:35.905550 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.906145 20171 raft_consensus.cc:2368] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:18:35.828996 23430 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.908228 20075 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 4 to 8, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.911441 23679 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.911957 23679 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:35.912364 23679 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:35.917116 23690 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:18:35.920195 23604 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:35.921731 23701 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:35.922212 23701 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:35.922613 23701 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.927982 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:35.929392 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:35.933300 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.876364 23557 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:35.874015 23688 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:35.798425 23626 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:35.948302 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 122197us
I20260709 12:18:35.957023 20075 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.905884 23559 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.910100 23693 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:35.910153 23698 consensus_queue.cc:1243] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:18:35.945310 23682 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:35.965523 20075 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 7 to 8, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:35.966616 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:35.973523 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:35.974189 20075 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.989172 23627 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:35.958974 23648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.029s
I20260709 12:18:35.975443 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:35.991127 23648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.003s	sys 0.030s
I20260709 12:18:35.991519 23648 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:35.992049 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:35.992631 23648 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.994174 23627 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:35.994752 23627 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:35.995288 23627 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.990103 20075 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 4 to 6, term changed from 4 to 6, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:35.900576 23687 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.831560 23709 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:35.963743 23693 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.963413 23559 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.002700 20075 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 3 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:35.962208 23691 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.904358 23169 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:36.031641 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.976424 23557 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:35.964326 23688 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.016363 23686 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.063683 23557 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.064621 23686 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:36.065203 23686 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:36.066147 23686 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.069002 23689 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.069661 23713 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:36.070266 23713 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.049814 23675 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:36.074587 23645 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 12:18:36.075135 23645 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:36.036768 23691 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.078794 23691 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.079268 23558 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:36.079677 23558 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:36.079864 23705 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:36.080363 23705 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.080758 23705 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.080595 23558 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:36.082098 23480 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.006s
I20260709 12:18:36.087157 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:36.096096 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:36.096779 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:36.031314 23693 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.031673 23559 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:36.054200 23601 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.003s
I20260709 12:18:36.082875 23558 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:36.090862 23667 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 12:18:36.122756 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:36.136595 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.143074 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.057850 23687 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.056375 23709 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.085192 23713 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.040191 23712 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:36.167224 23105 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.129943 23645 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:36.109874 23314 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:18:36.219264 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.220081 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.226158 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.112370 23480 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.026139 23685 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.131227 23601 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:36.207465 23105 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:36.246122 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 270768us
I20260709 12:18:36.247102 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:36.249492 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:36.251546 20172 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:36.252499 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:36.253600 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 265810us
I20260709 12:18:36.163072 23667 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.232327 23645 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:36.238874 23452 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:36.284018 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.604s (SENT)
I20260709 12:18:36.265720 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:36.248175 23105 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.253376 23665 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:36.225250 23701 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.251116 23700 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:36.263541 23712 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:36.301800 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:36.291954 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 91466us
I20260709 12:18:36.295730 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.239471 23586 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:36.296808 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.298652 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:36.309280 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.295315 23665 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:36.310775 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.314294 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2293) took 1019 ms. Trace:
I20260709 12:18:36.329064 20176 rpcz_store.cc:276] 0709 12:18:35.295196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.295717 (+   521us) service_pool.cc:224] Handling call
0709 12:18:36.312142 (+1016425us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54001d24d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:36.314218 (+  2076us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050078080}
I20260709 12:18:36.309298 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:36.324303 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.325076 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:36.325340 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.297207 23709 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:36.323235 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:36.371284 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 49985.3us
I20260709 12:18:36.385900 21041 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
W20260709 12:18:36.336640 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.303584 23719 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:36.374372 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:36.370525 23557 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.370903 23665 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.433529 20247 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:36.421799 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:36.440096 20250 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:36.443490 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72661.5us
I20260709 12:18:36.390151 23626 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.431093 23709 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:36.450508 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0358856909999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:18:36.459933 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:36.468941 20330 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:36.494594 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.495656 20247 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:36.373324 23704 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:18:36.437281 23680 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:18:36.500700 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.504725 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.505071 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:36.505690 20173 raft_consensus.cc:2376] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7. Re-sending same reply.
I20260709 12:18:36.506862 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:36.507259 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.507496 20247 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.506903 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:36.510998 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.516007 20173 raft_consensus.cc:2376] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7. Re-sending same reply.
I20260709 12:18:36.457567 23303 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:36.453415 23712 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.453552 23700 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:36.511233 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.511821 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:36.529323 20329 raft_consensus.cc:2368] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:36.524458 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.525149 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.530956 20171 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:36.532503 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.532613 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.533524 20180 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:36.535288 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:36.513448 23430 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 12:18:36.550783 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:36.550551 23705 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.550642 23430 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.553213 23705 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.553905 23430 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:36.554795 20330 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:36.537606 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.556967 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:36.557186 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:36.535305 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.532619 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.558447 20321 raft_consensus.cc:2410] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:36.558606 20173 raft_consensus.cc:2393] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:36.540371 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.539667 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:36.542449 23731 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:36.542680 23707 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:18:36.543488 23732 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 12:18:36.543980 23725 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:18:36.544205 23741 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.544682 23727 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.545555 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.548059 23314 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:36.507360 23713 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:36.549870 23671 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.000s
I20260709 12:18:36.550621 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.542073 23700 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.548069 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.559701 20327 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:36.560335 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:36.704481 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.427349 23645 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.612673 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:36.707209 20180 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:36.620044 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:36.620962 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:36.623365 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.624274 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.629969 23558 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.507886 23714 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.557286 23701 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.636839 23708 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:18:36.453763 23557 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.652259 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 920) took 1048 ms. Trace:
I20260709 12:18:36.677722 20247 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:36.729950 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:36.678104 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 108842us
I20260709 12:18:36.543543 23667 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.735867 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:36.523996 23721 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:18:36.695684 20177 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:36.682984 20324 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:36.739712 20252 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:36.564929 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.723274 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.740561 20327 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:36.504968 23627 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.728472 21039 rpcz_store.cc:276] 0709 12:18:35.603814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.604136 (+   322us) service_pool.cc:224] Handling call
0709 12:18:35.604509 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.604865 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.604893 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:35.605415 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.808919 (+203504us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:35.808985 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.809086 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.651967 (+842881us) raft_consensus.cc:1685] finished
0709 12:18:36.651997 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.652167 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2345,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":190306,"threads_started":1,"wal-append.queue_time_us":321661}
I20260709 12:18:36.680703 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:36.724509 23324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.004s
I20260709 12:18:36.557443 23631 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
W20260709 12:18:36.737880 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.004s	sys 0.006s
I20260709 12:18:36.697563 23314 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:36.750387 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.006s
I20260709 12:18:36.738963 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.558590 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.726227 23714 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.747241 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:36.747859 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:36.738042 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.755071 20251 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.755221 20171 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:36.756973 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:36.735831 23576 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.055s	user 0.010s	sys 0.002s
W20260709 12:18:36.742728 23549 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.326s	user 0.014s	sys 0.001s
I20260709 12:18:36.758262 20247 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:36.765667 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.788825 20326 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:36.751962 20178 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:36.635393 23709 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:36.830130 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 317161us
I20260709 12:18:36.899219 23314 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.900408 23314 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:36.754037 23324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.005s	sys 0.005s
I20260709 12:18:36.847513 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.904574 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:36.905977 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:36.906607 20177 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.791554 20327 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:36.908480 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.909170 20327 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:36.539743 23712 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.729007 23558 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.888058 20324 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:36.888280 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 154990us
I20260709 12:18:36.704309 23671 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.682606 23727 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.921484 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.894917 20329 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:36.738623 23731 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.760169 23714 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.705374 23713 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.895787 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:36.743124 23689 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:36.722534 23559 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.911780 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.916671 20251 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:36.913856 20144 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.979s (SENT)
I20260709 12:18:36.890223 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.927287 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.927834 20220 leader_election.cc:400] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
W20260709 12:18:36.919517 23721 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:18:36.928385 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:36.928833 20220 leader_election.cc:403] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.847767 23576 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.917451 23719 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:36.928781 20324 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:36.934453 20177 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:36.935750 21042 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:36.937357 20326 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:18:36.937680 20326 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 5
I20260709 12:18:36.937881 20326 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:18:36.938092 20326 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:36.938647 23679 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.026s	user 0.013s	sys 0.002s
I20260709 12:18:36.939116 23679 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.941424 23679 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.943260 23557 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.944605 21038 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:36.944797 23558 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.945144 23727 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.945320 23740 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.945861 23740 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:36.946868 23671 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.947136 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:36.947844 20327 raft_consensus.cc:606] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:18:36.947993 23729 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.558s	user 0.005s	sys 0.000s
I20260709 12:18:36.949390 23713 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.951247 20327 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:36.951603 23716 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.022s
I20260709 12:18:36.952205 20323 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:36.945150 23576 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.953864 23700 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:36.956120 23740 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.952263 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.958694 20321 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:36.960619 20325 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:18:36.962327 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.963245 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:36.963968 20321 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.963842 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.968487 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:36.969135 20326 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:36.969210 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:36.969619 20326 raft_consensus.cc:614] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:36.970674 23722 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.971740 23726 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:36.971995 23724 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:36.972455 23726 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.972481 23724 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:36.974520 23699 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.007s	user 0.000s	sys 0.017s
I20260709 12:18:36.974746 23724 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:36.976106 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2286) took 1772 ms. Trace:
I20260709 12:18:36.976475 20179 rpcz_store.cc:276] 0709 12:18:35.203545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.204492 (+   947us) service_pool.cc:224] Handling call
0709 12:18:35.204862 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:35.365784 (+160922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.365814 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:35.436993 (+ 71179us) log.cc:844] Serialized 52 byte log entry
0709 12:18:35.763106 (+326113us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:35.763156 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.763244 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.973786 (+1210542us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:36.975744 (+  1958us) raft_consensus.cc:1685] finished
0709 12:18:36.975769 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.976042 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8500,"raft.queue_time_us":68990,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5662,"spinlock_wait_cycles":64147328,"thread_start_us":407193,"threads_started":2,"wal-append.queue_time_us":401197}
I20260709 12:18:36.979875 20175 raft_consensus.cc:1217] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.11->[12.12-12.12]   Dedup: 12.12->[]
I20260709 12:18:36.980392 20175 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:18:36.936828 23705 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:36.986642 20322 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:36.988633 20324 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:36.969676 20177 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:18:36.989557 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61872.1us
W20260709 12:18:36.963204 23693 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.004s
I20260709 12:18:36.962677 23557 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:36.989279 23697 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:37.002466 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 92323.6us
I20260709 12:18:36.975366 23726 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:37.005138 20321 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
W20260709 12:18:37.007736 20144 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.991s (SENT)
I20260709 12:18:37.009606 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.010505 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:36.973151 23692 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.011164 20254 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:37.011794 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.014233 23559 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.019718 23726 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.021528 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.010099 23697 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.023697 23670 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.031217 20249 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:37.007004 23712 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:36.971426 23722 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.041739 23722 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.039844 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.045491 23586 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.045969 20251 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:37.034588 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.032517 23705 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:37.037276 23626 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.007s
I20260709 12:18:37.037664 23480 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.059818 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.038383 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.060380 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.060957 20249 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.061055 20251 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:37.062475 20255 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:37.039064 20328 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:37.065531 23665 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.003s
I20260709 12:18:37.066013 23665 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.035426 23726 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.069702 23726 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.075841 23705 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.078074 23705 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:37.031312 23105 consensus_meta.cc:287] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.733s	user 0.007s	sys 0.005s
I20260709 12:18:37.053000 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:37.080709 20172 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:37.080821 20321 raft_consensus.cc:606] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.011268 23719 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:37.053750 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50616.5us
I20260709 12:18:37.056677 23697 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.057873 20254 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:37.001052 23693 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.081238 20321 raft_consensus.cc:614] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:37.053570 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.086374 20247 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:37.083007 20255 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:37.093251 23601 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.094134 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:37.096578 20255 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:37.083287 20249 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:37.102524 20250 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:37.105548 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.108444 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:37.109097 20321 raft_consensus.cc:606] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:18:37.109478 23710 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.855s	user 0.008s	sys 0.000s
I20260709 12:18:37.109440 20321 raft_consensus.cc:614] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:37.059367 23714 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.084499 23105 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.115670 23627 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.116350 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 690) took 1570 ms. Trace:
I20260709 12:18:37.110499 23712 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:37.118528 20253 rpcz_store.cc:276] 0709 12:18:35.545992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.546128 (+   136us) service_pool.cc:224] Handling call
0709 12:18:35.595191 (+ 49063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.595590 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.595619 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:35.653329 (+ 57710us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.788416 (+135087us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:35.788489 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.788587 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.108907 (+1320320us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:37.110720 (+  1813us) raft_consensus.cc:1685] finished
0709 12:18:37.110743 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.116277 (+  5534us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55129,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10866,"spinlock_wait_cycles":15649024,"thread_start_us":103298,"threads_started":1,"wal-append.queue_time_us":530133}
I20260709 12:18:37.117295 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.122233 20255 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.125478 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.085850 23719 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.133503 20255 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:37.135821 20173 raft_consensus.cc:2368] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:37.138856 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:37.139500 20321 raft_consensus.cc:606] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.139827 20321 raft_consensus.cc:614] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:37.141572 23731 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.141899 23693 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.134809 23601 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:18:37.144078 23689 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:37.144347 23714 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.144603 23689 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.133081 23712 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:18:37.148381 23728 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.703s	user 0.003s	sys 0.000s
I20260709 12:18:37.148754 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.149958 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.150507 20253 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:37.144229 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:37.152732 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.153936 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:37.154038 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.154827 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.155715 23314 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:37.156100 23688 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.156273 23314 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.157042 23593 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:37.157430 23593 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.157780 23593 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:37.158375 23734 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.721s	user 0.002s	sys 0.001s
I20260709 12:18:37.158664 23314 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.159282 23314 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:37.155510 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.162365 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.151103 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.166946 20255 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:37.167755 20248 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:37.175480 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.176404 20329 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:37.177811 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:37.183650 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.183482 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.187752 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:37.185000 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.190869 20322 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:37.192651 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.195114 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.196028 20321 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:37.185659 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:37.203373 20321 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:37.203838 20321 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:37.207015 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.207693 20178 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:37.204808 20321 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.177846 23693 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.239516 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.182576 23731 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:37.259279 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.268872 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.182508 23727 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.208230 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.272585 20324 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:37.280297 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.273129 20321 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:37.281167 20322 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:37.206724 23714 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:37.212455 23732 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:37.207686 23604 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:37.184118 23688 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:37.213941 23568 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:37.277951 23731 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.206955 23698 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:18:37.188691 23314 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:37.186396 23712 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:18:37.197235 23705 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:18:37.389245 20321 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:37.392131 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.207949 23601 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:18:37.300312 23732 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.395368 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.292763 23733 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.396291 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.397289 20330 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.392995 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.300249 23604 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.399914 20178 raft_consensus.cc:2410] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:37.383111 23714 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:37.404047 23601 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:37.404492 23665 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.405435 23105 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.382625 23568 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.410682 23732 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.288537 23693 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.423873 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.430831 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:37.429350 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 235582us
I20260709 12:18:37.387441 23731 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.411556 23727 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.453275 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1532) took 1124 ms. Trace:
W20260709 12:18:37.454965 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.454689 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.427443 23604 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.464329 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.458108 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.465384 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:37.458037 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.459422 20248 rpcz_store.cc:276] 0709 12:18:36.323905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.324073 (+   168us) service_pool.cc:224] Handling call
0709 12:18:37.447756 (+1123683us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003c9bd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:37.447921 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824788864}
I20260709 12:18:37.429138 23601 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:37.466473 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.450306 23568 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.470569 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:37.473649 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:37.477277 23689 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.479445 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:37.480300 20177 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:37.481288 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 954) took 1395 ms. Trace:
I20260709 12:18:37.483349 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.483916 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.484510 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.486383 20255 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:37.481801 21042 rpcz_store.cc:276] 0709 12:18:36.086371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.086524 (+   153us) service_pool.cc:224] Handling call
0709 12:18:36.086884 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.936381 (+849497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.481011 (+544630us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400602f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:37.481222 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951653632}
I20260709 12:18:37.488085 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:37.471768 23720 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.080s	user 0.005s	sys 0.000s
I20260709 12:18:37.490896 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.488744 20178 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:37.421312 23733 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.487452 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:37.491794 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.492486 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:37.493423 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.511s (SENT)
I20260709 12:18:37.493788 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.494385 20255 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.498898 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:37.501024 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.501582 20250 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:37.508296 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.508728 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:37.511940 20177 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:37.481480 23665 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:37.514480 21008 connection.cc:256] RPC call timeout handler was delayed by -1.0374724430000697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 12:18:37.517444 21008 connection.cc:256] RPC call timeout handler was delayed by -1.0356724430000668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 12:18:37.516279 20255 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:37.522135 20178 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:18:37.524667 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60455.6us
I20260709 12:18:37.464432 23727 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.525521 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.528699 21042 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:37.537395 20254 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:37.464345 23314 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.547102 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:37.548750 21039 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:37.518987 23645 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:37.519086 23697 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.544319 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.520582 23665 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.552700 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:37.553305 21042 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:37.554160 20177 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:37.529870 23688 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:37.508297 23709 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:37.517797 23712 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:18:37.535948 23679 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:37.554754 20249 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:37.572342 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:37.579550 21039 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.567531 20250 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:37.555362 23665 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.511689 23714 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.533720 23765 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:18:37.517097 23601 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:37.581702 23761 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:18:37.559554 23697 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.594337 23719 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.630308 21039 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:37.633402 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 130505us
I20260709 12:18:37.635710 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:37.607455 23772 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:37.622068 23758 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:18:37.640169 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 949) took 1878 ms. Trace:
W20260709 12:18:37.650607 20174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2751) took 2146 ms (client timeout 1604 ms). Trace:
W20260709 12:18:37.650985 23756 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:18:37.651048 20174 rpcz_store.cc:269] 0709 12:18:35.503089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.503298 (+   209us) service_pool.cc:224] Handling call
0709 12:18:37.648765 (+2145467us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540015de54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:37.648951 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878520704}
W20260709 12:18:37.642176 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.644244 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 546) took 1418 ms. Trace:
I20260709 12:18:37.592329 23763 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:18:37.609094 23713 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:37.607283 23593 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:37.670277 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 134110us
I20260709 12:18:37.632629 23748 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:37.650624 21041 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:37.673765 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.622062 23771 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:18:37.633299 23770 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:18:37.688424 23697 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.632723 23689 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:37.688596 23769 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:37.706290 23568 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.687552 23782 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:37.650032 23709 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:37.712009 23771 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:37.699728 23762 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
W20260709 12:18:37.712818 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.699950 23727 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.705471 23732 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.714095 23724 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.714684 23697 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:37.715109 20325 raft_consensus.cc:2368] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:37.715075 23697 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:37.679088 20323 rpcz_store.cc:276] 0709 12:18:36.226294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.226422 (+   128us) service_pool.cc:224] Handling call
0709 12:18:36.252472 (+ 26050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.952712 (+700240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.643922 (+691210us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54003980d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:37.644162 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608801024}
I20260709 12:18:37.712710 23771 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:37.711992 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.725287 20330 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:37.728919 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:37.730526 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:37.731257 20180 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:37.702540 23604 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.670397 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 521) took 1163 ms. Trace:
I20260709 12:18:37.718976 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:37.735914 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62250.4us
I20260709 12:18:37.650339 21038 rpcz_store.cc:276] 0709 12:18:35.761359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.761707 (+   348us) service_pool.cc:224] Handling call
0709 12:18:35.770349 (+  8642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.945058 (+1174709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.639836 (+694778us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400472f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:37.640087 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700073856}
I20260709 12:18:37.735147 20171 rpcz_store.cc:276] 0709 12:18:36.507065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.935764 (+428699us) service_pool.cc:224] Handling call
0709 12:18:36.965218 (+ 29454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.998480 (+ 33262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.998521 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.999798 (+  1277us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.284817 (+285019us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:37.284876 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.284969 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.670162 (+385193us) raft_consensus.cc:1685] finished
0709 12:18:37.670188 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.670330 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":237256,"threads_started":1,"wal-append.queue_time_us":392570}
I20260709 12:18:37.735581 20172 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:37.737416 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.689721 23593 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:37.639278 23693 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.657406 23664 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.742049 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:37.649550 23772 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.681013 23733 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:37.717417 23748 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:37.755942 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:37.741843 23169 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:37.795774 23604 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:37.796670 23731 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.799299 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:37.820489 20171 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:37.800896 23706 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 1.013s	user 0.010s	sys 0.003s
I20260709 12:18:37.747998 23776 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:37.790958 23780 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:37.800945 23775 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:18:37.716113 23697 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.652128 23688 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.743816 23727 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:37.748015 23772 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.757475 23664 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.828913 23664 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.829730 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.817446 23559 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:37.807706 23732 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:37.808660 23777 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:18:37.810407 23771 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.810804 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.812300 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.791596 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:37.815631 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59764us
I20260709 12:18:37.823401 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.837844 20326 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:37.802588 23785 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:37.806423 23568 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:37.832902 20172 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:37.822113 23786 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:37.833494 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 197949us
W20260709 12:18:37.851640 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60161us
I20260709 12:18:37.833912 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.834789 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.852000 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:37.852552 20327 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
W20260709 12:18:37.823746 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 183661us
I20260709 12:18:37.837284 23645 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.853615 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:37.841218 23731 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.843773 23697 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:37.835755 23559 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.855182 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:37.823132 23776 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:37.846830 23748 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.832849 23780 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:37.848279 23771 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.855370 23733 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:37.855862 23645 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.856832 23787 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:37.877761 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:37.879135 23645 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:37.857545 23788 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:37.826360 23169 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:37.877761 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:37.880517 20178 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.880575 23169 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:37.859525 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:37.862147 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.835012 23664 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:37.862293 20171 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:37.874585 23733 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.861954 23559 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.888403 20327 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:37.890637 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.893976 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.891521 23733 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.863401 23709 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:37.851257 23604 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:18:37.900362 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:37.901127 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64609.3us
I20260709 12:18:37.863406 23776 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:37.908588 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:37.916908 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.901397 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.928056 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.900565 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.930022 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:37.928326 20321 raft_consensus.cc:2376] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10. Re-sending same reply.
I20260709 12:18:37.887193 23787 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:37.935603 20327 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:37.853509 23785 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.936926 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.907645 20178 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:37.897249 23748 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.901463 23709 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:37.940426 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:37.941015 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.029655 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:37.886830 23645 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 12:18:37.992393 23730 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 1.622s	user 0.004s	sys 0.022s
I20260709 12:18:37.995124 23795 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:38.047549 23645 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:38.048010 23645 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:38.048880 23645 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.050904 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.052282 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.053416 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.053983 20324 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.050154 23645 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.055912 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.057507 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.058212 20322 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:38.058779 23688 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:38.064993 23741 raft_consensus.cc:993] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:38.065555 23741 raft_consensus.cc:1081] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:38.072229 23665 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.073022 23795 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:38.074484 23665 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.040371 23709 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.030237 23780 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.086494 23795 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.096259 23795 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.994259 23785 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:37.995720 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.023347 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.099956 20321 raft_consensus.cc:2376] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2. Re-sending same reply.
I20260709 12:18:38.101292 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.102877 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:38.024194 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 169101us
I20260709 12:18:37.941471 23227 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.104183 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:37.891728 23664 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.034744 23790 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:38.105855 23790 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:38.106092 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.107080 23664 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.106909 23790 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.107753 23664 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.025239 23714 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.109153 23664 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:38.109535 23714 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.031021 20327 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.111742 23714 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.104018 23227 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:37.859620 23786 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.113791 23786 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.113830 23227 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:38.115067 20173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2765) took 1604 ms (client timeout 1817 ms). Trace:
I20260709 12:18:38.115162 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:38.115543 20173 rpcz_store.cc:269] 0709 12:18:36.510742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.564702 (+ 53960us) service_pool.cc:224] Handling call
0709 12:18:38.114860 (+1550158us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400319cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:38.115001 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909160192}
I20260709 12:18:38.116274 20327 raft_consensus.cc:2368] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.117374 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.119041 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.119923 20327 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.120214 20256 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:18:38.122460 23760 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.508s	user 0.003s	sys 0.000s
I20260709 12:18:38.126627 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.127368 20329 raft_consensus.cc:2376] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6. Re-sending same reply.
I20260709 12:18:38.128124 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.129123 20321 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:38.132228 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.132769 20323 raft_consensus.cc:2410] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:38.128257 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.133505 20329 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:38.134989 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:38.126458 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.148821 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:38.149372 21008 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:38.150774 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 225054us
I20260709 12:18:38.128872 23776 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.164183 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.164551 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.164909 21043 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:38.165388 21039 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:38.165940 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.166970 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.167480 21043 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 2.
I20260709 12:18:38.098037 20324 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:38.160570 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:38.161952 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.171159 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.166574 21041 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:38.175968 21042 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:38.178597 21042 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:38.178527 20321 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:38.071161 23772 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.123194 23559 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.182482 21035 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:38.182674 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.183249 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.184124 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.091324 23733 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:38.192384 23752 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.242s	user 0.002s	sys 0.002s
I20260709 12:18:38.193141 23733 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:38.193589 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 517) took 1687 ms. Trace:
I20260709 12:18:38.194021 20329 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.168196 23785 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:38.194738 23785 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:38.195182 23785 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:38.193169 23559 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.196322 23772 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:38.169723 23713 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:18:38.200496 23713 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:38.200941 23713 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:38.201947 23713 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:38.191182 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.184625 20327 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:38.161441 23227 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.193989 20176 rpcz_store.cc:276] 0709 12:18:36.505867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.505988 (+   121us) service_pool.cc:224] Handling call
0709 12:18:36.506312 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.733926 (+227614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.733959 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.734594 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 12:18:36.928724 (+194130us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:36.928761 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.151601 (+222840us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540016ab54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:37.151658 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.191701 (+1040043us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:38.193346 (+  1645us) raft_consensus.cc:1685] finished
0709 12:18:38.193375 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.193519 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540561536,"thread_start_us":137481,"threads_started":1,"wal-append.queue_time_us":200684}
I20260709 12:18:38.216552 21040 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:38.228982 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2762) took 1477 ms. Trace:
I20260709 12:18:38.229576 20328 rpcz_store.cc:276] 0709 12:18:36.751476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.756463 (+  4987us) service_pool.cc:224] Handling call
0709 12:18:37.038852 (+282389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.063411 (+ 24559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.228743 (+1165332us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002daad0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:38.228916 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440456064}
I20260709 12:18:38.232342 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1964) took 1083 ms. Trace:
I20260709 12:18:38.175009 23786 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.232858 20247 rpcz_store.cc:276] 0709 12:18:37.149026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.151105 (+  2079us) service_pool.cc:224] Handling call
0709 12:18:37.151437 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.151683 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:37.151995 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.231682 (+1079687us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18002db920. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:18:38.231890 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.231960 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:38.232023 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.232122 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.232271 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104897,"prepare.queue_time_us":581,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"spinlock_wait_cycles":7344512,"thread_start_us":230785,"threads_started":1,"wal-append.queue_time_us":335804}
I20260709 12:18:38.180747 23731 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:38.243589 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2775) took 1034 ms. Trace:
I20260709 12:18:38.248854 20330 rpcz_store.cc:276] 0709 12:18:37.208658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.239181 (+ 30523us) service_pool.cc:224] Handling call
0709 12:18:38.243327 (+1004146us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000cf154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:38.243487 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297339648}
I20260709 12:18:38.250056 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.187768 23776 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:38.203554 23713 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:38.255981 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.251739 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:38.258194 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 89320.5us
I20260709 12:18:38.258761 20330 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.259086 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.269073 20327 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:38.276424 20328 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:38.280678 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.287985 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.288847 21038 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:38.306280 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.269356 23731 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:38.311198 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.313570 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.313846 21038 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:18:38.315447 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56471.1us
W20260709 12:18:38.315857 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.316414 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.319192 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.320771 20330 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:38.322395 21039 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:38.324047 20330 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:38.324365 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.326614 21038 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:38.328074 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.328815 21040 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:38.329159 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.313232 23700 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:38.324357 23665 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:38.337373 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.339744 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:38.342177 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.342780 21038 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.348331 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.348649 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.349309 21042 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:38.349975 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.350607 21035 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.351598 23705 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:38.352118 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.352630 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.352752 21037 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.354568 23731 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:38.355973 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.358811 21035 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
W20260709 12:18:38.360217 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 1.17458e+06us
I20260709 12:18:38.361807 23670 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.362174 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.362787 20325 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:38.359843 23709 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.363443 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.363639 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.364283 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.364648 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.366258 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.368873 21042 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.369903 21039 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:38.370231 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.341208 23714 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:38.371021 23665 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:38.367262 23700 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:38.371956 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.18419e+06us
I20260709 12:18:38.375656 23665 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:38.375797 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.371047 23780 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:18:38.380164 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.383751 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:38.374958 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 201002us
I20260709 12:18:38.384325 21037 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
W20260709 12:18:38.384491 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0884479320000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:18:38.387807 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.387714 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.389148 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:38.390652 21038 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:38.391611 20321 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:38.383493 23698 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.393061 23698 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:38.393544 23698 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.395663 23772 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.395951 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.396867 20325 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:18:38.397152 23780 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:38.397615 23780 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:38.398162 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.398485 23780 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.399852 23559 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:38.400790 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.362205 23670 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.401885 23670 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.402196 23772 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.402619 23772 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:38.402985 23772 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.403434 23776 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:38.402868 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.404876 23559 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:38.405162 23719 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.405682 23719 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.406575 23689 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:38.406913 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.407086 23689 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.409157 23689 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.409925 23788 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.411711 23788 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:38.414320 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.415053 20254 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:38.415835 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.416371 23722 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.416824 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.416925 23722 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.418519 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:38.419013 23722 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.409106 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.419205 20248 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:38.419723 20249 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:38.419935 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.420310 20248 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:38.420718 23709 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:38.411720 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50538.4us
I20260709 12:18:38.423480 20219 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:38.424338 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:38.417846 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.424343 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.427873 20219 leader_election.cc:400] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:38.428253 20219 leader_election.cc:403] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:38.429925 20249 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:38.430783 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.431720 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.433717 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:38.435495 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46433.7us
I20260709 12:18:38.437116 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:38.437297 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57195.6us
I20260709 12:18:38.426194 23689 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:38.463397 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.438844 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.440672 23169 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:38.443360 23797 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:38.445109 23303 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.478276 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.479015 21039 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:38.445488 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.445736 23691 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:38.451745 21035 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:38.463653 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:38.446576 23714 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:38.459532 20144 leader_election.cc:400] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.491791 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:38.492036 20144 leader_election.cc:400] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.492399 20173 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.493489 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:38.461333 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.461532 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.462091 21042 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:38.463260 20330 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:38.496949 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.497651 20330 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:38.468685 20249 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.468206 23796 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.500262 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.474565 23797 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.479981 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.480312 20324 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:38.476840 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:38.436745 23559 raft_consensus.cc:2764] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:38.483763 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:38.509297 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.509637 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.485303 20172 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:38.456617 23780 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.443334 23772 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.464172 23722 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.464010 23719 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.480566 23169 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.521590 23169 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.522274 23709 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.522785 23709 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.523831 23724 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.524902 23709 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.505757 21038 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:38.526139 20176 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:38.528728 20330 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:38.529176 20249 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:38.507742 20144 leader_election.cc:400] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.509754 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:38.508508 23797 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.480003 23627 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:38.512543 23782 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.506750 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.551218 20324 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:38.551612 20177 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.544507 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.545240 20144 leader_election.cc:403] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:38.546187 23227 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.527830 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:38.548099 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.558545 21041 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:38.548591 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:38.547736 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.549067 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.491034 23303 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:38.540611 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:38.542138 21039 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:38.464231 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.454280 21040 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:38.563920 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.565294 20177 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:18:38.569450 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 61961.3us
I20260709 12:18:38.525753 23712 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:38.475625 23689 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.572722 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.575186 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:38.577831 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.579722 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:38.567062 23691 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:38.583668 23691 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.585930 23691 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.581002 23719 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:38.573666 23303 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.589871 23303 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.505720 23557 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:18:38.550885 23782 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.580718 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:38.602114 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:38.556993 23227 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.603542 23713 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:38.608291 23557 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:38.608683 23557 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:38.609074 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 1950) took 1585 ms. Trace:
I20260709 12:18:38.609584 23557 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.609587 20256 rpcz_store.cc:276] 0709 12:18:37.023267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.059535 (+ 36268us) service_pool.cc:224] Handling call
0709 12:18:38.608849 (+1549314us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001978d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:38.608978 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436433664}
I20260709 12:18:38.611123 23557 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:38.611197 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.612041 20256 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.613031 23689 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.555887 23627 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.602082 23788 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:38.571964 23714 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.618312 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:38.619136 20249 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:38.595866 23700 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:38.620040 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:38.621668 20249 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:38.630546 20256 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:38.596024 23709 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:38.582511 23796 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:38.566879 23785 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.633661 23782 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.631995 23709 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:38.602825 20254 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:38.600291 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:38.639992 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 175975us
I20260709 12:18:38.646796 20173 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
W20260709 12:18:38.650935 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47732.5us
I20260709 12:18:38.582324 23604 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:38.664247 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 64042.3us
I20260709 12:18:38.662292 20220 leader_election.cc:400] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:38.662700 20144 leader_election.cc:400] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.667030 20220 leader_election.cc:403] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:38.667088 20144 leader_election.cc:403] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:38.649349 23227 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.677753 21036 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:38.681146 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.682202 20249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:18:38.682835 20249 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:38.683174 20249 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:38.652334 23713 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:38.683545 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.686318 20254 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:38.688838 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.680681 23303 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:38.689589 23719 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:38.680209 23712 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:18:38.676899 23705 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:38.693003 23705 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:38.693370 23705 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:38.694341 20254 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:38.694238 23705 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.667927 23714 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:18:38.695946 23714 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:38.696329 23714 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:38.697177 23714 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.698529 23788 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.659427 23700 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:38.699757 23790 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:38.700174 23790 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:38.700780 23772 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.700332 23700 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.701062 23790 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.690014 23105 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:38.698521 23714 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:38.704105 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.706117 23785 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.708752 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:38.702227 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.711897 23785 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.713340 23785 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:38.713613 23549 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:38.713827 23785 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.714090 23549 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:38.718370 20295 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:38.718575 23169 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:38.718402 23748 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:38.719872 23748 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.721192 23559 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:38.721760 23559 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:38.722139 23748 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.723232 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.723840 21043 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.726956 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.728159 21041 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 2: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:38.722803 23559 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.732489 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:38.689702 23689 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:38.745211 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56450.9us
I20260709 12:18:38.751927 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.664883 23670 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.753880 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.754354 23670 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.757988 23785 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.658417 23665 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:18:38.760056 20250 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:38.760677 23785 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.715123 23549 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:38.678525 23604 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:38.761942 23627 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:38.762419 23604 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.763198 23691 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:38.765069 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:38.764889 23797 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.766213 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.766981 23691 raft_consensus.cc:2764] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:38.767094 23670 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.774051 20325 raft_consensus.cc:2410] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:38.768271 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.664161 23709 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:38.783835 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 279449us
I20260709 12:18:38.679116 23795 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.788966 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:38.777549 23601 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:38.782833 20249 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:38.744690 23719 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.786837 21043 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 3.
I20260709 12:18:38.777040 23722 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:38.794193 23627 raft_consensus.cc:2764] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:38.794816 20249 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.767510 23797 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:38.798804 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:38.801824 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:38.804200 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:38.827937 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.835698 20249 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:38.840358 21034 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:38.792865 23689 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:38.844432 23722 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:38.840418 23691 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:38.845460 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:38.845976 23790 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.876230 23782 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.877549 23691 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.878027 23691 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.825665 23648 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:18:38.848692 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:38.851763 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.855752 20250 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:38.856612 23227 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.777494 23713 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.794790 23670 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:18:38.775604 23698 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.872964 23693 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.864135 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.866096 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.860653 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.902345 21036 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:38.825490 23732 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:38.903275 23732 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:38.889173 23722 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:18:38.904237 23732 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.905004 23813 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:38.877701 21042 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:38.884450 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:38.889704 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.795044 23303 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:38.896180 23782 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:38.897385 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48913us
I20260709 12:18:38.899891 23105 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:38.900249 23689 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:38.905403 23813 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:38.910779 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 242448us
I20260709 12:18:38.914815 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:38.916378 20251 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:38.900238 23670 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:38.918275 23627 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:38.915491 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:38.911396 23105 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.928612 20248 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:38.911048 23689 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:38.933367 23689 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:38.934078 20328 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:38.934616 23689 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:38.935045 23714 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:38.919979 23670 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:38.936235 23670 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:38.939752 23665 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.945564 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:38.946964 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 228676us
I20260709 12:18:38.914278 23722 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:18:38.953445 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:38.929840 23731 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:38.954771 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:38.957950 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:38.958762 21041 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:39.003075 20326 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:39.005698 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:39.011183 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:39.011974 20327 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:39.014024 23303 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.015610 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:38.951067 23648 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:39.014045 20323 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:39.020000 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.022432 20248 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:39.024340 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.025771 20327 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:39.025871 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.027838 20251 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:38.958957 23227 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.014892 23303 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.032979 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.031458 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.022069 23648 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.036806 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:39.038089 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.053433 20327 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:39.053841 20327 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:38.985262 23626 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:18:39.066660 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 151925us
I20260709 12:18:39.068120 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:39.063696 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134639us
I20260709 12:18:39.071599 20220 leader_election.cc:400] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:39.086786 20249 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:39.058760 23648 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.957517 23813 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.094743 21036 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:39.096289 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.056568 23748 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:18:39.093369 23698 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.103045 23627 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:39.153120 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 179111us
I20260709 12:18:39.155155 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:39.145035 23748 consensus_queue.cc:1243] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:18:39.152531 23810 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.311s	user 0.003s	sys 0.009s
I20260709 12:18:39.158577 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:39.166064 23772 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:39.154609 23776 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:39.189379 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:39.177386 23557 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:39.178841 23827 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.161083 23819 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:18:39.192866 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:39.187410 23732 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:39.220682 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 124503us
W20260709 12:18:39.211905 23823 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:18:39.214082 23820 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:39.177800 23731 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:39.189446 23812 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:18:39.226075 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:39.215977 23832 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.241302 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:39.252461 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70196.5us
I20260709 12:18:39.220297 23601 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:39.220927 23813 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:39.231530 23748 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:39.237489 23820 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:39.265034 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.236860 23828 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:39.251523 23732 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:39.273233 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.221736 23105 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.257392 23714 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:39.257032 23601 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.282874 20249 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:39.256512 23303 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.235109 23709 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.219166 23827 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:39.291256 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.281203 20178 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:18:39.239226 23670 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.291831 20178 pending_rounds.cc:85] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:39.292286 20178 pending_rounds.cc:107] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:18:39.292654 20178 raft_consensus.cc:2889] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.281965 20247 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:39.273940 20251 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:39.259711 23748 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:39.261494 23557 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:39.296823 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1555) took 1777 ms. Trace:
I20260709 12:18:39.289673 20328 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:39.297245 20255 rpcz_store.cc:276] 0709 12:18:37.519177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.528518 (+  9341us) service_pool.cc:224] Handling call
0709 12:18:37.529667 (+  1149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.434620 (+904953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.434654 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:38.435129 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.868255 (+433126us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:38.868295 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.868365 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.296589 (+428224us) raft_consensus.cc:1685] finished
0709 12:18:39.296611 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.296761 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":850204,"raft.queue_time_us":869269,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":365943,"threads_started":1,"wal-append.queue_time_us":452342}
I20260709 12:18:39.276962 23772 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:39.291342 23814 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 12:18:39.251602 23627 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.257910 23832 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.286923 23601 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.286568 23559 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.316684 23840 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:39.319253 23819 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:39.320205 20254 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:39.325466 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.330428 23833 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:18:39.300117 23557 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:39.331535 23845 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:39.332823 23105 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.275807 23828 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.296296 23714 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:39.336999 23665 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:39.291080 23838 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:18:39.339061 23709 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.314633 23820 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.313122 23731 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.385841 23105 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:39.386276 23105 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:39.387599 23105 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.388973 23105 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.390755 23828 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.357781 23559 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.391675 23714 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.394390 23559 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.363039 23665 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:39.396522 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.397176 20177 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:39.396924 23665 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.340157 23748 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:39.312213 23835 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:18:39.338471 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1945) took 2316 ms. Trace:
W20260709 12:18:39.361935 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.358336 20327 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.402786 23748 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.403658 20327 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:39.402523 20252 rpcz_store.cc:276] 0709 12:18:37.021657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.021815 (+   158us) service_pool.cc:224] Handling call
0709 12:18:37.022199 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:37.483764 (+461565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.483795 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:37.491054 (+  7259us) log.cc:844] Serialized 52 byte log entry
0709 12:18:37.633651 (+142597us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:37.652635 (+ 18984us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.778224 (+1125589us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.778679 (+   455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.338035 (+559356us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002fce54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:39.338088 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.338226 (+   138us) raft_consensus.cc:1685] finished
0709 12:18:39.338241 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.338380 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028602,"prepare.queue_time_us":394152,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":94,"raft.queue_time_us":1908702,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":292,"spinlock_wait_cycles":425244416,"thread_start_us":476935,"threads_started":2,"wal-append.queue_time_us":158001}
W20260709 12:18:39.356774 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 100685us
I20260709 12:18:39.356211 23732 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.408286 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:39.410912 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:39.337157 23827 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.412056 23838 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.412246 23827 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:39.412497 23693 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:39.371171 23772 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.376595 23832 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.378096 23670 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.379388 23820 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:39.384577 23691 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.358439 23557 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.375083 20178 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:39.413071 23693 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.430279 23691 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.432094 20248 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:39.422874 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:39.433578 20327 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:39.367798 23844 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.424474 23814 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:39.437520 23559 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:39.439373 23559 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.439958 23559 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:39.447834 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.452833 23844 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:39.460299 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 239548us
I20260709 12:18:39.459301 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:39.467473 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.467835 23105 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:39.468447 20178 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:39.469839 23105 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:39.455327 23844 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:39.455390 23838 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.475975 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:39.478873 20327 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:39.438272 23819 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:18:39.480762 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:39.495239 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.495296 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:39.499866 21034 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:39.496649 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:39.500056 20177 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:39.497561 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:39.500962 21039 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.503330 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.505134 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.505726 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.509371 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:39.510092 20325 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:39.512334 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.514686 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.515462 20175 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:39.517405 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:39.521962 21039 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:39.524523 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:39.525588 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:39.526407 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.532904 23719 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.533051 23705 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:39.533450 23719 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.502141 23832 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:18:39.520743 23627 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:39.548807 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:39.512884 23827 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:18:39.530496 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:39.557791 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:39.572829 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:39.550827 23627 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.575971 23627 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:39.584075 23713 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:39.585923 23713 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:39.587383 23713 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.523947 23105 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.587967 23713 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.544466 23719 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:39.615680 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.606963 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:39.626957 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:39.628623 23709 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.630148 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:39.631037 23709 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:39.631446 23709 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.631819 23709 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.557214 23838 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.523288 23648 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.574837 23845 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.591187 23772 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.644476 20175 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:39.643318 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.633704 23816 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:39.647481 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.647727 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.648685 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.551028 23693 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.656534 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.660003 20171 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:39.633591 23828 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:39.662357 23557 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.665576 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.672029 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.674458 20175 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:39.653959 23712 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:39.682886 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.715960 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.718561 23838 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:39.719002 23838 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:39.720158 21042 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:39.720001 23838 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.721025 23838 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.675346 23828 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:39.655030 23772 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.735808 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.736721 20174 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:39.740558 23854 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:18:39.741540 23665 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:39.746882 23817 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.581s	user 0.002s	sys 0.000s
W20260709 12:18:39.748163 23855 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:39.748267 23816 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:39.749693 23852 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:18:39.749644 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1554) took 2249 ms. Trace:
I20260709 12:18:39.765659 23828 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.715664 23712 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.756644 20253 rpcz_store.cc:276] 0709 12:18:37.499840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.502590 (+  2750us) service_pool.cc:224] Handling call
0709 12:18:37.515824 (+ 13234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.421561 (+905737us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:38.649329 (+227768us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.966487 (+317158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.024279 (+ 57792us) log.cc:844] Serialized 26 byte log entry
0709 12:18:39.024467 (+   188us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:39.024507 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.024594 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.746326 (+721732us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:39.749293 (+  2967us) raft_consensus.cc:1685] finished
0709 12:18:39.749385 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.749574 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":905269,"prepare.queue_time_us":359224,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":954248,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":156,"spinlock_wait_cycles":12831488,"thread_start_us":502775,"threads_started":2,"wal-append.queue_time_us":435667}
W20260709 12:18:39.793427 23867 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:18:39.793890 23821 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.653s	user 0.005s	sys 0.000s
W20260709 12:18:39.795948 23856 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.204s	user 0.000s	sys 0.003s
I20260709 12:18:39.796439 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 1975) took 1366 ms. Trace:
I20260709 12:18:39.797607 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.798367 20173 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
W20260709 12:18:39.753357 23824 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:39.796917 20256 rpcz_store.cc:276] 0709 12:18:38.430368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.631275 (+200907us) service_pool.cc:224] Handling call
0709 12:18:38.647409 (+ 16134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.649703 (+  2294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.649748 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:38.665159 (+ 15411us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.966063 (+300904us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:39.021039 (+ 54976us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.021260 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.021341 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.793584 (+772243us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b24001422c8. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9 00007f5dd7e4aa55 00007f5dd7e4a09d 00007f5ddaa7c10e 00007f5ddaa9388c 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221
0709 12:18:39.796009 (+  2425us) raft_consensus.cc:1685] finished
0709 12:18:39.796161 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.796362 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15963,"prepare.queue_time_us":57805,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":135744,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":10648,"spinlock_wait_cycles":21599104,"thread_start_us":240992,"threads_started":1,"wal-append.queue_time_us":367941}
I20260709 12:18:39.711586 23713 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:39.806320 23863 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:18:39.807230 23864 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:18:39.824728 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:39.808241 23857 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:18:39.809379 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.810256 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.810509 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:39.828095 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.809068 23860 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:39.828321 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.828994 23813 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:39.829435 23772 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:39.829491 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:39.814373 23866 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:39.831008 20178 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:39.817129 23693 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.817919 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:39.829524 23813 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:39.832842 23826 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:39.833256 23826 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:39.833616 23813 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.836812 23788 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:39.837497 23788 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.841706 23712 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.818228 23601 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:39.819167 20256 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:39.822674 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.823338 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.853101 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.853688 20256 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:39.830204 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:39.824107 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:39.845676 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.846980 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.855062 20255 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:18:39.847343 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.850035 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.853762 20248 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:39.857867 21042 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:39.832386 20178 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:39.859227 21039 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:39.859323 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:39.860087 21037 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:39.860952 21042 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:18:39.802291 23698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.020s
I20260709 12:18:39.863333 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:39.864609 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.865916 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.866884 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.868944 20250 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:39.869379 23648 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.823045 23627 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.869578 20249 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:39.873523 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:39.872211 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.875945 20177 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:39.867475 23698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.009s	sys 0.020s
I20260709 12:18:39.880633 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.888490 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:39.889132 20321 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.892807 20249 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:39.895782 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.834285 23826 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.872962 23691 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.870307 23849 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.895759 20174 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
W20260709 12:18:39.903506 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.878158 23705 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.913601 20321 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:39.922515 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:39.877139 23813 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:39.923708 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:39.923322 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 82274.4us
I20260709 12:18:39.927356 20249 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:39.873337 23105 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:18:39.896797 23648 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.929783 20251 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:39.933543 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:39.896651 23719 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:39.931862 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.878602 23712 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:18:39.908440 23788 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:39.955698 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:39.942010 20174 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:39.930895 23557 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.927543 23826 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.916986 23827 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.916119 23731 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.934815 20179 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:18:39.992519 20179 pending_rounds.cc:85] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:18:39.992816 20179 pending_rounds.cc:107] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:18:39.993069 20179 raft_consensus.cc:2889] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.968708 23705 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.986406 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:39.972566 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:39.969837 23709 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:39.995136 23873 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:40.029166 23732 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.029690 23732 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.030530 23709 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:39.995352 23549 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.031831 23732 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:40.033535 23874 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:18:40.034233 20171 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:40.004288 23601 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.005324 23627 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:40.006274 23748 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.002s
W20260709 12:18:40.008109 23559 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.002s
I20260709 12:18:40.035866 23559 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.012905 20176 raft_consensus.cc:2410] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:40.038357 23559 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:40.039525 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.040351 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.046254 23846 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.049052 20073 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:40.055500 20073 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 5, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:40.017222 23875 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:40.023142 23832 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.989032 23670 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.966084 23700 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:18:39.989517 23828 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:40.021230 23665 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:39.964659 23841 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:40.075168 23665 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:39.968338 23788 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:18:40.077168 23788 consensus_queue.cc:1243] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:40.078339 20321 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:40.027711 23626 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:40.080070 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.080765 20322 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:40.080868 23626 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.027935 23691 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:40.022608 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:39.935542 23722 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:40.017001 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.089756 20180 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:40.059113 20327 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:40.061926 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:40.063872 20324 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:40.091499 20171 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:40.064453 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:40.022774 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50518.2us
I20260709 12:18:40.064905 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.065905 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.065977 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.093616 20323 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:40.069649 20328 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:18:40.061952 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 130154us
I20260709 12:18:40.082991 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:40.083348 20325 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:40.095741 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:40.096457 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 73983.6us
I20260709 12:18:40.098558 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.098858 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:40.109923 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 309) took 10712 ms. Trace:
I20260709 12:18:40.081635 23626 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.110409 20075 rpcz_store.cc:276] 0709 12:18:29.397740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.402749 (+  5009us) service_pool.cc:224] Handling call
0709 12:18:40.109816 (+10707067us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:36.623985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:36.624665 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:36.624723 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:18:36.624743 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:36.626802 (+  2059us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:36.626912 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:36.626940 (+    28us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:18:36.983015 (+356075us) tablet.cc:701] Row locks acquired
0709 12:18:36.983065 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:18:36.983247 (+   182us) write_op.cc:270] Start()
0709 12:18:36.983402 (+   155us) write_op.cc:276] Timestamp: P: 1783599516983181 usec, L: 0
0709 12:18:36.983424 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:37.012611 (+ 29187us) log.cc:844] Serialized 10352 byte log entry
0709 12:18:37.508383 (+495772us) op_driver.cc:464] REPLICATION: finished
0709 12:18:37.635963 (+127580us) write_op.cc:301] APPLY: starting
0709 12:18:37.636063 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:37.636550 (+   487us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:37.652285 (+ 15735us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:37.702531 (+ 50246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:37.702902 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 12:18:37.702947 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:37.703433 (+   486us) log.cc:844] Serialized 176 byte log entry
0709 12:18:37.739978 (+ 36545us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:37.751824 (+ 11846us) write_op.cc:454] Released schema lock
0709 12:18:37.815172 (+ 63348us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:37.854795 (+ 39623us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:37.854854 (+    59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":138654,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":118852,"apply.run_cpu_time_us":10857,"apply.run_wall_time_us":197177,"num_ops":26,"prepare.queue_time_us":427790,"prepare.run_cpu_time_us":60409,"prepare.run_wall_time_us":499963,"raft.queue_time_us":319787,"raft.run_cpu_time_us":15865,"raft.run_wall_time_us":155360,"replication_time_us":493119,"thread_start_us":574243,"threads_started":4,"wal-append.queue_time_us":101754,"wal-append.run_cpu_time_us":30048,"wal-append.run_wall_time_us":1589787}]]}
I20260709 12:18:40.113385 20073 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 6, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.114652 23626 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.116237 20073 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 6, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.077524 23665 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.120388 20180 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:40.121325 20174 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:40.121676 20174 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:40.124464 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:40.124593 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:40.125270 20325 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:40.125497 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:40.125970 20328 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:40.126205 20326 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:40.126338 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:40.125272 20323 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.126933 20324 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:40.129034 23314 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:40.129489 20180 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:40.132794 20330 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:40.132095 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:40.134732 20073 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 5, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:40.134240 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 247782us
I20260709 12:18:40.137135 20175 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:40.138594 23788 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.097110 23733 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.139173 23788 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.139526 23733 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.087404 23828 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.141444 23788 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.141701 23733 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.098341 23832 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:40.142318 23828 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.087373 23691 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:40.135492 23879 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:40.138250 20073 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 10, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 10 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:40.143424 23691 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.144899 20073 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 6, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 6 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:40.122413 20174 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.146940 20174 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.137459 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.132042 23670 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:40.134960 23825 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:18:40.150548 23825 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:40.150906 23825 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:40.148948 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.060248 23846 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.152380 23875 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:40.153568 23846 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.154134 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.154394 20329 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:40.154965 23875 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:40.155853 23705 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:40.156811 23705 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:40.156006 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:40.157171 23705 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:40.148420 23879 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:40.149881 23712 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.158174 23705 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.158439 23712 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.159650 23665 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:40.159688 23841 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:40.160228 23665 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:40.160300 23845 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.160744 23665 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.160879 23845 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.161795 20247 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:40.162360 21034 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:40.164445 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:40.165684 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:40.166415 20247 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.166647 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:40.166425 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:40.166014 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.168392 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.170092 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.174010 20323 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:40.174540 21042 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:40.148550 23700 consensus_queue.cc:1175] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8aef67aa330543a191ab5ab5dc30e84c" responder_term: 3 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:40.175868 23845 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.176038 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:40.177199 23771 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:40.177628 23771 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.177999 23771 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:40.178195 23722 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:40.179353 23722 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:40.179891 23722 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:40.180707 23670 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:40.181170 23670 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:40.180850 23722 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.182143 23670 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.159479 23705 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:40.190402 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.185626 20254 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:40.170326 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:40.184422 23851 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:40.201336 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:40.203787 20324 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:18:40.160773 23712 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:40.210435 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 144625us
I20260709 12:18:40.206055 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:40.206857 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.208410 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.209566 20251 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:40.214998 20174 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:40.183527 23670 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.217901 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:40.218984 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:40.221977 20175 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:40.200596 23816 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:40.200861 23832 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:40.201494 23626 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:40.232928 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.228355 23712 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.203611 23851 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:40.217270 23679 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:40.202471 23627 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:18:40.234133 23712 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.217039 23846 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.248944 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.238531 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.210582 23700 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:18:40.273160 23712 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.273871 23712 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.274358 23712 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.274613 23851 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.275657 23846 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:40.277844 23846 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:40.253331 20175 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:18:40.211722 23828 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:18:40.288059 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49632.5us
I20260709 12:18:40.289242 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.240764 23604 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:40.218909 23559 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:18:40.247840 23549 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:18:40.297233 23712 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.297425 23691 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:40.282047 23788 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.298547 23788 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.299108 23604 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:40.300416 23604 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.301431 23788 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.308347 23665 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.310627 23844 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:40.311679 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.290299 23820 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:40.312588 23665 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.250555 23879 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:40.241178 23732 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:18:40.275707 23851 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.183779 23825 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.315452 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.232070 23832 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:40.316934 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.361579 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46278.8us
I20260709 12:18:40.365408 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:40.334852 20247 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:18:40.338660 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.242347 23882 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:18:40.352926 23879 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:40.316740 23844 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:40.371274 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:40.355437 23732 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:40.363142 23832 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.391511 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.366990 23559 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:40.391870 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:40.402379 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:40.403419 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.403512 21042 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:40.408540 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.409546 20254 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:40.412850 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:40.413743 20254 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.414770 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:40.415634 21042 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.417946 20253 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:40.419716 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:40.422590 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:40.384238 23722 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.384174 23748 raft_consensus.cc:2764] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:40.443248 20174 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:40.390627 23732 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:40.389014 23700 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:40.419435 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 209268us
I20260709 12:18:40.438629 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:40.453305 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 252037us
W20260709 12:18:40.478732 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.394724 23665 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:18:40.526904 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 88490.2us
I20260709 12:18:40.534678 20252 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:40.535131 20252 pending_rounds.cc:85] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 4
I20260709 12:18:40.535400 20252 pending_rounds.cc:107] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:40.535681 20252 raft_consensus.cc:2889] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:40.449487 23819 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:40.441682 23627 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:40.541121 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.449247 23772 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:40.505894 23169 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:40.505977 23626 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:40.449831 23733 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:18:40.551769 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:40.552381 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.556545 20252 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:40.536540 23314 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:40.433177 23549 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:18:40.552459 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:40.568326 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:40.560592 20174 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:18:40.533993 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 297503us
I20260709 12:18:40.561120 20175 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:40.444550 23841 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.541667 23887 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:18:40.579613 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.588673 20180 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:40.586205 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:40.543526 23819 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:40.591164 20324 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:40.593595 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:40.591821 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.547374 23772 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:40.592008 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.548979 23788 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.591787 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:40.540046 23748 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:18:40.596750 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.597641 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.598654 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:40.598930 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.597590 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.537379 23846 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:18:40.608669 20322 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:40.626160 23772 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.643599 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.569165 23627 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:40.444633 23722 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.608050 21042 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:40.649760 23884 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:18:40.650647 23894 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:40.621460 23788 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.611219 20330 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:40.613624 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45393.2us
I20260709 12:18:40.592521 23886 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.553543 23169 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.608072 23819 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.592274 23887 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:40.604069 23849 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:40.624284 23826 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:40.537137 23879 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.567466 23626 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:40.657063 23878 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:40.702437 23788 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.710443 23724 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:40.595202 23838 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
W20260709 12:18:40.713611 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.656885 23601 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:40.724020 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 130553us
I20260709 12:18:40.616262 23559 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:18:40.603832 23841 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.740217 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:40.725884 20254 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:40.721588 23856 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:18:40.761950 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.606675 23732 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.768927 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:40.774725 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 169339us
I20260709 12:18:40.775848 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:40.733085 23826 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:40.765476 23601 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:40.713985 23886 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:40.835863 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60138.4us
I20260709 12:18:40.762265 23724 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:18:40.860399 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:40.867529 20330 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:40.784518 23705 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:40.770639 23665 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:18:40.892823 23665 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:40.724718 23849 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:40.894399 23771 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.003s
I20260709 12:18:40.895115 23849 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.773092 23844 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:18:40.881194 23886 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:40.882299 23722 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.786131 23887 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.897653 23887 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.781702 23851 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:18:40.773453 23627 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:40.884202 23826 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:40.844568 23845 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:40.888545 23841 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:40.890538 23604 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:40.894822 23771 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:40.878878 23895 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:18:40.912004 23886 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:40.915285 23604 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:40.969496 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.960646 23880 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.970786 23604 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.960398 23886 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:41.005589 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 498102us
I20260709 12:18:41.009202 23841 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.015266 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:41.021512 23832 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.002s
I20260709 12:18:41.022025 23832 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.001145 23880 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.023172 23825 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.008838 23851 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.023998 23851 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.025084 23880 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.027832 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:41.002274 23314 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:41.033798 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 324979us
W20260709 12:18:41.034008 23691 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.736s	user 0.015s	sys 0.000s
I20260709 12:18:41.032280 23832 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.008945 23705 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.026100 23851 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.040212 20249 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:41.012383 23906 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:41.039363 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.027633 23626 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:41.053689 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.033901 23880 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:41.087215 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.076592 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:41.096228 20250 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:41.097330 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:40.979048 23601 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.099007 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.102329 20326 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:41.108331 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.073920 23903 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.041749 23670 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.026643 23841 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.038218 23901 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:41.109022 20177 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:41.086753 23549 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.113497 20328 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:41.089466 23559 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.114396 23846 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.087697 23705 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.117550 23902 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.074658 23691 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.092574 23849 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.074043 23788 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:18:41.036362 23314 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.094769 23626 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.075364 23889 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:18:41.084450 23906 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.152758 23169 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.153069 23841 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.154317 23906 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.129307 23549 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.134635 23849 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.157646 23549 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.121721 23838 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:41.158202 23849 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.158330 23838 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.125352 23903 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.130661 23559 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.160638 20330 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:41.125204 23670 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.161489 23903 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.161604 23559 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.162454 23670 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.130796 23846 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.135872 23901 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:41.166126 23626 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.167119 23846 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.146981 23905 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.167994 23905 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.168432 23626 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.138753 23907 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.169483 23907 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.170193 23905 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:41.148001 23900 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:18:41.132750 23691 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.171993 23771 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.172587 23691 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.173913 23314 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.150520 23732 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.180154 23907 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.180990 23885 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:41.157826 20255 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:18:41.181197 23772 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.001s
I20260709 12:18:41.152311 23886 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:41.185886 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 410957us
I20260709 12:18:41.195755 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:41.195889 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:41.189739 23897 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 12:18:41.160638 23838 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.204392 21036 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:41.200769 23913 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.214221 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.214973 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.215894 21043 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:41.183085 23885 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:41.201315 23886 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.226967 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.131116 23902 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.239099 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.251672 21043 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:41.240613 21039 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
W20260709 12:18:41.247874 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.189720 23772 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.268496 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.209295 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:41.273875 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64702.4us
I20260709 12:18:41.274832 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:41.239928 23838 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.284489 23885 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.286296 23885 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.289819 23902 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.290586 23705 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.251510 23915 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:41.276796 23819 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.007s
I20260709 12:18:41.275637 23906 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:41.277936 23713 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:41.228405 23911 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:18:41.276141 23691 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:18:41.302812 23902 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.254143 23886 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.329366 23911 consensus_queue.cc:1243] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:41.228499 23913 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.340862 23748 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:41.348973 23845 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.317379 23819 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.362589 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.362946 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.363993 20250 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:41.385038 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.363973 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.386125 20251 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:41.302744 23838 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.373485 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.388401 20255 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:41.375506 23679 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.334820 23626 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:41.379633 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:41.380426 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.354408 23899 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 12:18:41.386188 20248 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:18:41.324534 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47419.6us
I20260709 12:18:41.399478 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:41.400962 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:41.391312 20247 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:41.401028 23905 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:41.381443 23733 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.382135 23907 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.387468 23722 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.342180 23902 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.310564 23915 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.397199 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.418179 23846 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:41.476423 23819 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.429126 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.480276 23907 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.464488 23772 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.482679 23907 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.483032 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 511) took 1275 ms. Trace:
I20260709 12:18:41.383320 23845 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.483673 21034 rpcz_store.cc:276] 0709 12:18:40.207304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.207470 (+   166us) service_pool.cc:224] Handling call
0709 12:18:40.219058 (+ 11588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:40.424273 (+205215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.424337 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:40.764235 (+339898us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b2c000bb028. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:18:40.774195 (+  9960us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.205900 (+431705us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:41.205951 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.206014 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:41.482716 (+276702us) raft_consensus.cc:1685] finished
0709 12:18:41.482740 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:41.482969 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4393,"raft.queue_time_us":61218,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":12349184,"thread_start_us":534478,"threads_started":2,"wal-append.queue_time_us":554743}
I20260709 12:18:41.479462 23846 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:41.395442 23679 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.488440 23846 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.490078 23846 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.443078 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.490809 20250 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:41.392509 23771 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.442735 23906 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:18:41.492157 23691 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:41.418299 23712 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:18:41.493636 23886 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.446704 23549 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.507038 23549 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.509114 23549 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.494760 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.492269 23771 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.511790 23771 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.462327 23820 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:18:41.420770 23713 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:41.434041 23733 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.517230 23733 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.492380 23906 consensus_queue.cc:1243] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:41.519044 23917 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:41.519436 23917 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:41.520479 23917 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.521981 23917 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.523221 23845 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.525365 23845 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:41.494769 23679 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:41.496865 23880 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:41.497149 23838 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:41.498502 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 422097us
I20260709 12:18:41.492751 23691 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.529656 23880 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.530360 23691 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.531493 23886 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:41.532596 23939 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:41.532965 23939 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:41.533174 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:41.533833 23939 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.535200 23939 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.536931 23886 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:41.538106 23885 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:41.538544 23885 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:41.539505 23885 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.423619 20179 pending_rounds.cc:85] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:41.443663 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:41.541604 20255 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.499188 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.422961 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:41.472182 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 75087.7us
W20260709 12:18:41.457515 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.501834 23722 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.456846 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.391040 23314 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.503206 23902 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.391701 23604 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.505057 23915 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.559408 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.434392 23826 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:41.560317 23826 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:41.561445 23826 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.562819 20255 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:41.467607 23626 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.506215 23913 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.506448 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.563586 23626 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.422264 23665 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:41.564402 23665 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.564802 23665 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.559616 23604 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.495855 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:41.571822 23911 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:41.572208 23911 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.572541 23911 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.540407 23906 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.474231 23928 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:18:41.546680 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.576346 21042 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:41.548077 20176 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:41.548267 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.577808 21041 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 2.
I20260709 12:18:41.549827 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.578687 21037 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:41.582759 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.583416 21039 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:41.584249 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.583683 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:41.584890 21041 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.550304 20179 pending_rounds.cc:107] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:41.551683 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.585440 20179 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.585632 21043 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:41.554314 23691 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.555696 23314 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.557575 23722 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.586709 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.588744 21042 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:18:41.586102 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 90346.6us
W20260709 12:18:41.579838 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45108.5us
I20260709 12:18:41.580413 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:41.596019 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 139240us
I20260709 12:18:41.596740 21035 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:41.596869 23604 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:41.597133 21035 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:41.597051 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.597579 23604 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.598059 23604 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.598230 21035 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.598785 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.600138 23937 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:41.603955 21040 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:41.600217 21038 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:41.599342 21035 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.587643 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.609720 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:41.611469 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.612498 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:41.612816 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:41.614581 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:41.614835 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.615339 20252 raft_consensus.cc:2368] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:41.615978 20254 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
W20260709 12:18:41.622818 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.624797 20175 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:41.625907 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.626528 20247 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:41.626650 21042 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:18:41.627044 21042 pending_rounds.cc:85] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 8
I20260709 12:18:41.627279 21042 pending_rounds.cc:107] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:18:41.627511 21042 raft_consensus.cc:2889] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.628508 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.629175 20247 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:41.611301 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.630028 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.630965 20254 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:41.632366 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:41.633199 20247 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.628533 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.634130 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.636384 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:41.589920 23903 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:41.594521 23915 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:41.639354 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:41.647542 20327 pending_rounds.cc:85] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 4
I20260709 12:18:41.639994 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.648450 20327 pending_rounds.cc:107] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:18:41.649164 20327 raft_consensus.cc:2889] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.640681 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.641479 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.650983 20325 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:41.652163 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:41.642728 20330 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:41.643515 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.619777 23732 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.646340 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.664667 20250 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:41.656039 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.665302 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.648293 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.666383 20249 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:41.666183 21043 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:41.645430 20323 raft_consensus.cc:2410] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:18:41.648101 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.657186 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.667886 20251 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:41.670619 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.663861 21042 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:41.671245 21036 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:41.625260 23772 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:41.672838 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:41.675459 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.676412 21040 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:41.607859 23937 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.679883 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.681296 21042 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:41.639514 23627 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.683888 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.685007 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:41.684943 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.645905 23838 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:41.605468 23906 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.664219 23732 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:41.655750 23915 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.677444 20253 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 2.
I20260709 12:18:41.671609 23679 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:41.694828 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.695511 21041 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:41.698522 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.692274 23693 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.718977 20172 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:41.720527 20172 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:41.721024 20247 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:41.699281 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.700426 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.700490 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:41.646719 23918 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.701617 21035 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:41.702322 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.717085 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:41.722658 21037 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:41.728509 21038 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:41.726459 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.730044 20178 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:41.727154 21035 pending_rounds.cc:85] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 7
I20260709 12:18:41.731539 21035 pending_rounds.cc:107] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:41.731928 21035 raft_consensus.cc:2889] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.726732 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.734045 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:41.681228 23937 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.694945 23838 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.739702 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.741725 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.718791 23732 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.722220 23915 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.726032 23722 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:41.749289 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.774252 20323 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:41.775490 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.751515 20325 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:41.753458 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.777181 20247 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:41.695959 23627 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.778314 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:41.757661 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.783655 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:41.696118 23772 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:41.760183 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.745769 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.786228 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.756146 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.787271 20252 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:41.733247 23712 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:41.727461 23679 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:41.753641 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.793777 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.781735 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:41.736549 23928 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:41.794603 20330 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:41.784648 21042 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 2: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:41.784281 21038 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.743044 23700 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:41.788542 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.786198 20250 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:41.746048 23838 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.804405 20325 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:41.736833 23693 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.740144 23913 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:18:41.804747 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.815512 20330 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 2.
I20260709 12:18:41.802634 23700 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:41.796630 23928 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:41.806576 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:41.817337 21038 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:41.738704 23918 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:41.818950 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 170924us
I20260709 12:18:41.797061 23679 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.821051 23665 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.839473 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.801189 23712 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:41.844558 20325 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:41.823285 23700 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.847200 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.838866 23928 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:41.843006 23691 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.854271 20180 raft_consensus.cc:2368] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:18:41.850693 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:41.860414 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:41.861137 20294 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.761s (SENT) [suppressed 36 similar messages]
I20260709 12:18:41.848709 23890 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:41.850849 23314 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:41.900998 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.903126 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:41.924389 23944 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:18:41.926522 23918 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.927127 23918 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.927454 20251 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:18:41.927686 23942 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:18:41.927554 23918 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.929723 23748 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:41.930330 23748 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:41.888861 23885 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.946183 23914 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:41.946620 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43612.8us
I20260709 12:18:41.974704 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:41.976747 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:41.950338 23918 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.931293 23748 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.883956 23948 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:41.900434 23913 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.892076 23890 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.978132 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:41.988446 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:41.990316 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:41.991146 21039 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.994876 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:41.993404 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 319127us
I20260709 12:18:41.852001 23772 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:41.943343 23906 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:41.998785 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:42.003264 21036 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:41.973918 23914 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:42.034832 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:42.045272 20177 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:42.035789 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:42.037473 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:42.038533 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:42.059859 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:42.060662 20180 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.990188 23875 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.067843 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.993238 23887 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:41.991103 23890 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:42.075959 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:41.995780 23948 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:42.069912 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:42.069180 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:42.003672 23691 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:42.001968 23879 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:42.089843 20178 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:42.070708 21039 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:42.059684 23914 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.030350 23898 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.094628 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:42.078894 23887 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.999477 23604 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:41.993788 23913 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.080700 23627 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:42.130906 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.132004 20325 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:41.990584 23712 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.128118 20180 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:42.102921 23879 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:42.130165 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 269034us
I20260709 12:18:42.149307 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:42.123339 23943 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:18:42.115998 23846 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.625s	user 0.013s	sys 0.001s
I20260709 12:18:42.083812 23826 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:18:42.186868 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:42.115849 23949 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.189173 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.127173 23887 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:42.190117 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 426357us
I20260709 12:18:42.202049 20144 leader_election.cc:400] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:42.202458 20144 leader_election.cc:403] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:18:42.195856 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.205268 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.103991 23691 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:42.212575 23951 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:18:42.213654 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.214540 23958 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:42.215363 23948 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.183900 23879 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.188555 23693 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:42.226948 20321 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:42.238718 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 234028us
I20260709 12:18:42.228157 20325 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:42.144683 23956 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:18:42.193096 23665 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:42.198892 23963 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.259470 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.242525 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:42.260275 20325 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:42.231704 23705 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.319450 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 77020.5us
I20260709 12:18:42.231928 23967 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.201428 23949 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.374898 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.378624 23957 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.323074 23820 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.326725 23898 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:42.382680 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.364127 23846 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:42.383605 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 181743us
I20260709 12:18:42.450192 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:42.454442 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:42.319666 23880 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:18:42.390133 23917 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.378182 23665 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.378360 23693 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.521324 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 200669us
I20260709 12:18:42.599815 23956 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:42.616093 23956 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:42.616565 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:42.618080 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:42.378719 23969 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.325068 23705 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.401671 23898 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.382172 23713 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:42.564224 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:42.616809 23549 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.392282 23601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.005s	sys 0.005s
I20260709 12:18:42.326310 23963 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.676779 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:42.686163 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 231831us
I20260709 12:18:42.526995 23939 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:42.707217 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 97796.9us
W20260709 12:18:42.668380 23601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.006s	sys 0.006s
I20260709 12:18:42.390204 23957 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.666684 23888 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.498973 23820 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.567739 23917 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:42.740700 20324 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:42.676764 23665 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:42.664088 23898 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:42.748845 20322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.007s	sys 0.037s
I20260709 12:18:42.676201 23713 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:42.686365 23991 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:18:42.659219 23693 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:42.752362 20322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.007s	sys 0.037s
I20260709 12:18:42.765084 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:42.765935 20324 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:42.675866 23549 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:42.757169 23880 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:42.520056 23967 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.912117 23888 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.668064 23969 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.827955 23604 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:42.926733 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:42.758260 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 140260us
I20260709 12:18:42.720741 23939 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:42.903923 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.909493 23549 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:42.912752 23888 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.957119 23996 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:42.957839 23626 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.394s	user 0.013s	sys 0.007s
I20260709 12:18:42.958051 23665 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:42.878808 23947 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.966503 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:43.073639 20321 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:42.979051 23970 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:42.980722 20248 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:42.984447 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56794.4us
I20260709 12:18:43.079123 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.061902 23626 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.063211 23996 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:42.913190 23967 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:42.958976 23975 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.359s	user 0.000s	sys 0.000s
I20260709 12:18:42.894639 23958 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:42.903898 23956 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.148734 20321 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:18:43.154915 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75906.6us
I20260709 12:18:43.161487 20254 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:43.141808 23972 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.579s	user 0.000s	sys 0.001s
I20260709 12:18:43.162173 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.165764 23961 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:43.176877 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.167047 23693 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.091703 23947 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.183068 23549 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.183713 23604 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:43.184273 23626 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.184924 23947 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.184295 23604 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:43.078255 23970 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.186617 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2820) took 1489 ms. Trace:
I20260709 12:18:43.187753 23604 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:43.186975 20171 rpcz_store.cc:276] 0709 12:18:41.697634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.697742 (+   108us) service_pool.cc:224] Handling call
0709 12:18:41.698069 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.698405 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.698432 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.698881 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.154089 (+455208us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:42.154871 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.154963 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.186370 (+1031407us) raft_consensus.cc:1685] finished
0709 12:18:43.186395 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.186547 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1417,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":19173,"thread_start_us":393085,"threads_started":1,"wal-append.queue_time_us":632552}
I20260709 12:18:43.188135 23820 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.150303 23665 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:43.189019 23665 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.189137 23888 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.189436 23665 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:43.189937 23888 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.191828 23970 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:43.192077 23969 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.162323 23772 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:43.199355 20324 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:43.176178 23958 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:18:43.205369 23879 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.897s	user 0.012s	sys 0.000s
I20260709 12:18:43.205855 23879 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:43.204226 23885 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.235s	user 0.013s	sys 0.000s
I20260709 12:18:43.171031 23949 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.190536 23888 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.181949 23846 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.207466 23957 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.176415 23961 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:43.170161 23996 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.206467 23958 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:43.223881 23722 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:43.224972 23915 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.439s	user 0.011s	sys 0.002s
I20260709 12:18:43.220492 23705 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.212548 23819 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.180229 23998 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:43.227686 23939 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.272610 23722 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:43.277053 23911 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.704s	user 0.017s	sys 0.000s
I20260709 12:18:43.241603 23981 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:43.325621 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.003s	sys 0.027s
I20260709 12:18:43.237208 23885 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:43.280306 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.012s	sys 0.017s
I20260709 12:18:43.251770 23961 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:43.348430 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:43.354635 20176 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:18:43.342468 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.153s	user 0.021s	sys 0.064s
W20260709 12:18:43.343057 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.004s	sys 0.028s
W20260709 12:18:43.355664 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.021s	sys 0.064s
W20260709 12:18:43.356842 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 1.26223e+06us
W20260709 12:18:43.357551 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 1.1707e+06us
W20260709 12:18:43.344039 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.013s	sys 0.017s
W20260709 12:18:43.359831 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 672060us
W20260709 12:18:43.376185 21006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.020s	sys 0.039s
W20260709 12:18:43.377677 21006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.020s	sys 0.039s
W20260709 12:18:43.331468 23601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.030s	sys 0.078s
I20260709 12:18:43.282598 23705 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:43.383719 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:43.384725 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.293424 23963 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.282375 23844 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:43.388428 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.403461 21043 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:43.420279 21043 pending_rounds.cc:85] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 7
I20260709 12:18:43.420567 21043 pending_rounds.cc:107] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 12:18:43.364419 23928 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.507s	user 0.014s	sys 0.000s
I20260709 12:18:43.420801 21043 raft_consensus.cc:2889] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:43.333892 23879 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.404013 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:43.422420 20247 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.423539 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:43.406065 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:43.425493 20249 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:43.426893 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:43.406112 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:43.408610 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 49227.6us
W20260709 12:18:43.411955 23601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.031s	sys 0.079s
I20260709 12:18:43.439066 20248 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:43.402964 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:43.442541 20251 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:43.414213 20173 raft_consensus.cc:2410] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:43.418658 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.277527 23915 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.445971 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:43.430953 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:43.407168 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:43.447319 21038 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:18:43.435788 23963 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:43.437402 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:43.424386 21036 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:43.452265 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:43.446641 21035 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:43.330462 23911 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.460414 23888 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:43.466629 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.286391 23819 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:43.449671 23732 consensus_meta.cc:287] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.663s	user 0.009s	sys 0.005s
I20260709 12:18:43.440660 23956 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:43.354110 23885 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:43.469614 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 462449us
I20260709 12:18:43.417374 23693 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:18:43.414760 23627 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:18:43.293124 23998 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.347312 23981 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.439877 23844 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:18:43.469259 23991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.021s
I20260709 12:18:43.487614 23973 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:43.805320 23838 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.939s	user 0.014s	sys 0.009s
I20260709 12:18:43.805737 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:43.805934 23990 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:43.806037 23838 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.646194 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:43.806882 23990 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:43.444149 20174 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:18:43.648018 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:43.660285 20256 raft_consensus.cc:2368] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7.
I20260709 12:18:43.492004 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:43.481498 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:43.828814 20324 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:18:43.500919 21008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.013s
W20260709 12:18:43.835711 21008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.011s	sys 0.013s
W20260709 12:18:43.836663 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 417926us
I20260709 12:18:43.494088 23601 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:43.499017 21037 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:43.843832 23601 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:43.844707 23700 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.990s	user 0.013s	sys 0.013s
I20260709 12:18:43.845283 23700 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:43.846702 20177 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:43.846890 23601 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:43.495759 23679 consensus_meta.cc:287] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.648s	user 0.012s	sys 0.002s
W20260709 12:18:43.845719 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 414641us
I20260709 12:18:43.713516 23691 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.713995 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:43.849184 23679 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:43.850620 20251 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:43.852357 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:43.853245 20251 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:43.716100 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:43.724968 20329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1658) took 2087 ms (client timeout 1835 ms). Trace:
I20260709 12:18:43.854782 20248 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:43.854636 20329 rpcz_store.cc:269] 0709 12:18:41.637670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.639072 (+  1402us) service_pool.cc:224] Handling call
0709 12:18:43.724102 (+2085030us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002daad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:43.724516 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3276987648}
I20260709 12:18:43.855253 24018 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.856220 24018 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.856884 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:43.857937 20329 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:43.417564 23705 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.858937 24018 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.860564 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:43.861742 23705 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.728175 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1590) took 2119 ms. Trace:
I20260709 12:18:43.862459 20255 rpcz_store.cc:276] 0709 12:18:41.608521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.608704 (+   183us) service_pool.cc:224] Handling call
0709 12:18:41.608998 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.609238 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:41.644447 (+ 35209us) log.cc:844] Serialized 14 byte log entry
0709 12:18:41.967430 (+322983us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b1800042340. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:43.726403 (+1758973us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b1800042340. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287
0709 12:18:43.726934 (+   531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.727082 (+   148us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:43.727260 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.727486 (+   226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.727822 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63462,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":136556,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9524,"spinlock_wait_cycles":92271872,"thread_start_us":265124,"threads_started":2,"wal-append.queue_time_us":279291,"wal-append.run_cpu_time_us":1292,"wal-append.run_wall_time_us":1050972}
I20260709 12:18:43.865236 23981 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.478827 23732 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:43.868562 23998 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.868983 23732 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:43.870044 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.870205 23732 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:43.871016 23732 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:43.470628 23733 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:43.731348 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2026) took 2098 ms. Trace:
I20260709 12:18:43.873152 20254 rpcz_store.cc:276] 0709 12:18:41.632357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.632528 (+   171us) service_pool.cc:224] Handling call
0709 12:18:41.632784 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.161957 (+1529173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.730563 (+568606us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540024f9d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:43.731041 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3515267328}
I20260709 12:18:43.719820 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:43.744535 23819 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:43.499895 23887 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.292s	user 0.002s	sys 0.011s
I20260709 12:18:43.446437 23928 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:43.553036 23937 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.775s	user 0.011s	sys 0.004s
I20260709 12:18:43.877483 23937 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.446859 23949 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:43.496421 23956 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.880141 20330 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:43.495201 23957 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:43.876747 23887 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:43.479984 23968 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.046s	sys 0.079s
W20260709 12:18:43.497633 23979 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 12:18:43.933182 23968 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.046s	sys 0.081s
I20260709 12:18:43.479382 23980 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:43.479395 23997 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 12:18:43.936311 23980 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:43.525086 23991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.022s
I20260709 12:18:43.938269 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 582) took 2137 ms. Trace:
I20260709 12:18:43.487421 23992 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:43.941435 23992 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.943984 23967 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:43.479434 24000 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:18:43.945895 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:43.577044 24001 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 12:18:43.962183 23898 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.199s	user 0.014s	sys 0.006s
I20260709 12:18:43.963747 24009 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:43.573848 24002 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:43.576110 24007 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:43.568135 24008 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.490624 24012 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:43.496800 24015 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.479445 24014 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.563380 24017 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:43.749817 23844 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:43.753026 23885 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:43.746444 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 103427us
I20260709 12:18:43.804603 23973 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.806802 20180 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:43.645819 20178 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.564675 23911 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.812103 20174 pending_rounds.cc:85] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:43.849129 23915 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.471462 23626 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:44.070122 24015 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.876070 24026 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.879189 23928 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.853375 23679 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.089920 24026 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.884207 23700 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:43.885799 23914 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.747s	user 0.016s	sys 0.011s
I20260709 12:18:43.886057 20325 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
W20260709 12:18:43.865252 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 373200us
W20260709 12:18:43.894237 23712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.012s
W20260709 12:18:43.894114 23722 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.010s
I20260709 12:18:44.094973 24008 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.096252 23885 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.096503 23722 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.096944 23885 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.098232 24008 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.896209 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:44.100169 20249 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 3: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:43.898332 23983 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.229s	user 0.003s	sys 0.000s
I20260709 12:18:43.899115 24003 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.900853 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:43.898239 23732 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.903878 23691 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.908779 24027 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:43.909705 23937 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.909790 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:43.910923 23879 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:43.912349 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:43.880947 23956 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.912909 20247 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:43.916519 23939 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.917714 23890 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.814s	user 0.009s	sys 0.013s
I20260709 12:18:43.896071 23838 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:43.920275 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 578) took 2132 ms. Trace:
W20260709 12:18:43.920610 23961 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.010s
I20260709 12:18:43.931421 23977 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:43.938711 20330 rpcz_store.cc:276] 0709 12:18:41.800693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.816311 (+ 15618us) service_pool.cc:224] Handling call
0709 12:18:41.816619 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.880731 (+2064112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.937877 (+ 57146us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540040a1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:43.938201 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4744336256}
W20260709 12:18:44.119048 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 218585us
I20260709 12:18:43.939344 23980 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:43.962795 23898 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:43.955996 23981 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:43.964570 24009 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.000967 23887 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.024197 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:44.049696 23970 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.857s	user 0.017s	sys 0.001s
I20260709 12:18:44.004140 23990 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.062709 23820 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.062487 24012 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:44.076241 23665 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.869s	user 0.010s	sys 0.018s
I20260709 12:18:44.077031 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2027) took 2217 ms. Trace:
I20260709 12:18:44.070439 23992 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:44.072989 20256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2018) took 2459 ms (client timeout 1557 ms). Trace:
I20260709 12:18:44.080941 24002 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.082784 24017 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.070183 24014 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.087210 20174 pending_rounds.cc:107] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:44.146371 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.102998 24003 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:44.103538 23712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.015s	sys 0.012s
I20260709 12:18:44.109071 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1662) took 2462 ms. Trace:
I20260709 12:18:44.111311 20171 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:44.110566 24007 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:18:44.113648 23691 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.099025 23722 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.099467 23885 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.114679 24027 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.093417 23914 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.159898 20254 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:44.156597 20256 rpcz_store.cc:269] 0709 12:18:41.612000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.612171 (+   171us) service_pool.cc:224] Handling call
0709 12:18:44.060934 (+2448763us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54003cafd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:44.071533 (+ 10599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4705760128}
W20260709 12:18:44.176874 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 156433us
I20260709 12:18:44.163913 20327 rpcz_store.cc:276] 0709 12:18:41.646677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.646961 (+   284us) service_pool.cc:224] Handling call
0709 12:18:41.647294 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:42.085645 (+438351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.085680 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:42.086316 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:18:42.261690 (+175374us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:42.261744 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.261842 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.897181 (+1635339us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:44.103546 (+206365us) raft_consensus.cc:1685] finished
0709 12:18:44.103586 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.108847 (+  5261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13729,"raft.queue_time_us":18824,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10286,"spinlock_wait_cycles":451244416,"thread_start_us":590514,"threads_started":2,"wal-append.queue_time_us":434692}
I20260709 12:18:44.180845 23820 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.181716 23956 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.182893 23918 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:44.158635 20174 raft_consensus.cc:2889] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:44.184239 23937 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:44.185299 20175 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:44.116901 20323 rpcz_store.cc:276] 0709 12:18:41.787378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.792100 (+  4722us) service_pool.cc:224] Handling call
0709 12:18:41.792503 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.792721 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:41.989850 (+197129us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.398781 (+408931us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.460568 (+1061787us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18000697c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:18:43.833303 (+372735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.890223 (+ 56920us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:43.919699 (+ 29476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.919834 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.920019 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102370,"prepare.queue_time_us":136320,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":593564,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":15456,"spinlock_wait_cycles":49147520,"thread_start_us":833213,"threads_started":3,"wal-append.queue_time_us":1490118}
I20260709 12:18:44.147023 23961 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.219617 23961 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.140269 23890 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.207592 23918 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:44.210265 23937 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.212098 24014 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.223873 24026 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.158574 23970 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.231658 23820 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.153281 20250 rpcz_store.cc:276] 0709 12:18:41.859523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.859707 (+   184us) service_pool.cc:224] Handling call
0709 12:18:41.884656 (+ 24949us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:41.885201 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.885243 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:41.886183 (+   940us) log.cc:844] Serialized 78 byte log entry
0709 12:18:42.187898 (+301715us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:42.217682 (+ 29784us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.218526 (+   844us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.599744 (+381218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.599841 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.225691 (+625850us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b18003f1de0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:44.024964 (+799273us) raft_consensus.cc:1685] finished
0709 12:18:44.042485 (+ 17521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.076722 (+ 34237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3931,"prepare.queue_time_us":28708,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":4260,"raft.queue_time_us":91543,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":36498,"spinlock_wait_cycles":174875648,"thread_start_us":593853,"threads_started":2,"wal-append.queue_time_us":1299188}
I20260709 12:18:44.228295 24042 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:44.228929 23992 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:44.175554 23665 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.238639 24012 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.239437 23665 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.239555 23914 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.210172 23981 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.184376 24002 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.216197 23887 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.242095 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 135983us
I20260709 12:18:44.242738 23898 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.244773 23890 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.177260 23939 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.224172 24003 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.251448 20321 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:44.251973 23973 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.252450 23918 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.253212 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.253604 23887 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.254627 24019 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:44.230446 23937 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.235378 24042 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.229688 24015 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.236991 23992 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:44.269435 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:44.270517 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 148094us
W20260709 12:18:44.268846 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 265795us
W20260709 12:18:44.271550 24037 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:18:44.274724 24009 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.264264 23970 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.265175 23992 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.263947 24017 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.255427 24019 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:44.299491 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.305543 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:44.300879 23973 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:44.312059 23973 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:44.312667 23973 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.315661 24002 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.321345 23956 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.329325 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:44.331450 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74252us
I20260709 12:18:44.333776 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:44.334453 23679 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:44.334990 23679 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.335412 23679 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:44.336625 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47583.7us
I20260709 12:18:44.338804 23913 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.339910 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 999) took 2352 ms. Trace:
I20260709 12:18:44.366115 23691 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:44.367720 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 142648us
I20260709 12:18:44.369060 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:44.370814 23875 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:44.371414 23875 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.370855 24049 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:44.371902 23875 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:44.372013 24049 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:44.372563 24049 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:44.424453 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:44.395432 23977 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:44.374303 23913 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:44.435297 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 182283us
I20260709 12:18:44.438199 23939 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.345328 21034 rpcz_store.cc:276] 0709 12:18:41.987674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.989042 (+  1368us) service_pool.cc:224] Handling call
0709 12:18:42.000250 (+ 11208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.004346 (+  4096us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:42.078535 (+ 74189us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.686585 (+1608050us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b1800469420. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa9823a 00007f5ddaf02a2a
0709 12:18:43.977357 (+290772us) log.cc:844] Serialized 14 byte log entry
0709 12:18:44.147843 (+170486us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.228397 (+ 80554us) log.cc:844] Serialized 26 byte log entry
0709 12:18:44.228628 (+   231us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:44.228678 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.228798 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.339390 (+110592us) raft_consensus.cc:1685] finished
0709 12:18:44.339420 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.339645 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15874,"prepare.queue_time_us":199803,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":6517,"raft.queue_time_us":187257,"raft.run_cpu_time_us":714,"raft.run_wall_time_us":72682,"spinlock_wait_cycles":11910016,"thread_start_us":313441,"threads_started":3,"wal-append.queue_time_us":1803520}
W20260709 12:18:44.430766 23906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.227s	user 0.026s	sys 0.027s
I20260709 12:18:44.451004 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:44.457279 20173 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:18:44.458001 23962 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 2.079s	user 0.002s	sys 0.002s
I20260709 12:18:44.460107 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:44.460479 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:44.454144 23906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.298s	user 0.027s	sys 0.029s
I20260709 12:18:44.448204 23913 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:44.471495 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 546) took 3045 ms. Trace:
I20260709 12:18:44.474082 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:44.480820 20171 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.481863 20175 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:44.463936 23977 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:44.486795 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.487072 20327 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:44.487618 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.493988 23952 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.494771 23952 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.496909 23949 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:44.497614 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:44.498519 20171 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:44.499516 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.499958 24012 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:44.500301 20254 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:44.500414 24012 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:44.500881 24012 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.497247 23952 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.499228 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:44.494796 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.494204 23665 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:44.476539 24017 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:44.477159 20179 rpcz_store.cc:276] 0709 12:18:41.422859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.422989 (+   130us) service_pool.cc:224] Handling call
0709 12:18:41.423354 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:41.588739 (+165385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.588772 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:41.589339 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 12:18:41.996372 (+407033us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:41.996418 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.996501 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.436560 (+2440059us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:44.461108 (+ 24548us) raft_consensus.cc:1685] finished
0709 12:18:44.461130 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.467709 (+  6579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18924,"raft.queue_time_us":2617,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9704,"spinlock_wait_cycles":7578368,"thread_start_us":376376,"threads_started":1,"wal-append.queue_time_us":614234}
W20260709 12:18:44.526046 23982 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.693s	user 0.000s	sys 0.003s
I20260709 12:18:44.527084 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:44.527624 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 83207us
I20260709 12:18:44.529237 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:44.531985 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2410) took 1194 ms. Trace:
I20260709 12:18:44.533037 20248 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:44.532495 23977 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.533339 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1602) took 1129 ms. Trace:
I20260709 12:18:44.534291 20255 raft_consensus.cc:2410] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:18:44.527366 24045 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:18:44.535852 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:44.532449 20178 rpcz_store.cc:276] 0709 12:18:43.337662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.338249 (+   587us) service_pool.cc:224] Handling call
0709 12:18:43.407963 (+ 69714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.083222 (+675259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.531681 (+448459us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001d1ad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:44.531901 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545229568}
I20260709 12:18:44.522725 24017 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:44.539427 20327 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:44.504400 24027 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.542315 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:44.544548 23959 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.904s	user 0.003s	sys 0.001s
I20260709 12:18:44.544970 23984 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:44.494016 23996 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:18:44.531929 23907 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:44.550151 23995 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 1.642s	user 0.000s	sys 0.011s
I20260709 12:18:44.553931 24042 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.554888 23887 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.556241 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.557405 23886 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.559259 23880 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.652148 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:44.561407 24019 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.562528 23713 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.563660 24017 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.564312 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.566540 23917 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.568444 23888 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:44.572012 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.572431 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.573894 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:44.574942 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 521) took 1172 ms. Trace:
I20260709 12:18:44.574857 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.577200 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 557) took 1149 ms. Trace:
I20260709 12:18:44.521322 23665 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:44.681181 20174 rpcz_store.cc:276] 0709 12:18:43.427826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.432383 (+  4557us) service_pool.cc:224] Handling call
0709 12:18:43.443696 (+ 11313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.248008 (+804312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.576926 (+328918us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54000a6750. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:44.577128 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24988032}
I20260709 12:18:44.684041 20176 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:44.580020 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:44.534142 20252 rpcz_store.cc:276] 0709 12:18:43.403922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.404451 (+   529us) service_pool.cc:224] Handling call
0709 12:18:43.438551 (+ 34100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.438808 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:43.879847 (+441039us) log.cc:844] Serialized 14 byte log entry
0709 12:18:44.072621 (+192774us) log.cc:844] Serialized 14 byte log entry
0709 12:18:44.334141 (+261520us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b1800244a80. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:18:44.461841 (+127700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.467173 (+  5332us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:44.477216 (+ 10043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.489633 (+ 12417us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.524683 (+ 35050us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":514350,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":109,"raft.queue_time_us":182478,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":14492,"spinlock_wait_cycles":14510848,"thread_start_us":644344,"threads_started":4,"wal-append.queue_time_us":221854}
I20260709 12:18:44.663532 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:44.664381 20327 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:18:44.541488 23981 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.647207 23984 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.677919 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 586) took 1683 ms. Trace:
I20260709 12:18:44.678690 20255 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:44.691263 20321 rpcz_store.cc:276] 0709 12:18:42.986285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.186553 (+200268us) service_pool.cc:224] Handling call
0709 12:18:43.186955 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.252018 (+1065063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.652901 (+400883us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400409cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:44.669851 (+ 16950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436945280}
I20260709 12:18:44.697072 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.698163 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:44.700628 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 120857us
I20260709 12:18:44.685786 23665 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.688552 23887 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:44.706121 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 125303us
I20260709 12:18:44.680862 21039 rpcz_store.cc:276] 0709 12:18:43.402200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.403887 (+  1687us) service_pool.cc:224] Handling call
0709 12:18:43.404172 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.939740 (+535568us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:44.007729 (+ 67989us) log.cc:844] Serialized 14 byte log entry
0709 12:18:44.283297 (+275568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:44.283351 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:44.283397 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.574527 (+291130us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540056bb54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:44.574585 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.574722 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18884,"prepare.queue_time_us":106689,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":19371,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":54187,"spinlock_wait_cycles":1230662912,"thread_start_us":255992,"threads_started":2,"wal-append.queue_time_us":505339}
I20260709 12:18:44.703001 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.695658 23984 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.719512 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.718674 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:44.718012 20250 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:44.686277 23937 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.680809 23880 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.706328 23887 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.727770 20327 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:44.717880 23907 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:44.735970 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:44.736662 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:44.686024 23886 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.742321 24050 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.746690 24049 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.747874 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.752482 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1661) took 3110 ms. Trace:
I20260709 12:18:44.753743 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.747880 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.755841 23880 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.755797 23917 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:44.734658 23887 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.788837 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.806682 20327 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:44.807699 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:44.808844 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:44.809545 20327 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.791370 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.792471 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.793097 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.811905 21042 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:44.794296 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.812529 21038 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:44.795344 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.796191 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.792491 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:44.797601 23955 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 2.615s	user 0.013s	sys 0.009s
W20260709 12:18:44.798678 23978 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 2.046s	user 0.004s	sys 0.005s
W20260709 12:18:44.799757 24006 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.377s	user 0.010s	sys 0.003s
I20260709 12:18:44.800736 23886 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.731753 23913 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.802243 23918 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.734643 23713 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:44.827383 21035 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:44.759430 23679 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.788264 23907 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:44.811996 21036 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.795832 24012 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.815654 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.819721 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:44.830822 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.833453 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:44.841939 21043 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 3: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:44.830310 23713 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.789870 20328 rpcz_store.cc:276] 0709 12:18:41.642343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.654561 (+ 12218us) service_pool.cc:224] Handling call
0709 12:18:41.683331 (+ 28770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.693754 (+ 10423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.693784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.702821 (+  9037us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.108320 (+405499us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:42.108363 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.108525 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.172081 (+1063556us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4800160158. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:18:44.543502 (+1371421us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:44.751992 (+208490us) raft_consensus.cc:1685] finished
0709 12:18:44.752021 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.752205 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10018,"raft.queue_time_us":53467,"raft.run_cpu_time_us":10471,"raft.run_wall_time_us":1442731,"spinlock_wait_cycles":23480448,"thread_start_us":366788,"threads_started":1,"wal-append.queue_time_us":659509}
I20260709 12:18:44.846495 24013 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.839324 24057 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:44.844772 23886 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:44.856631 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.868455 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.869802 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.871296 20328 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:44.854846 23713 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:44.872367 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 118740us
I20260709 12:18:44.864517 23886 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.876289 23626 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:44.876559 23886 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.877131 23626 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:44.878270 24012 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.879966 23665 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.880718 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1657) took 3243 ms. Trace:
I20260709 12:18:44.882404 23665 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.881186 20326 rpcz_store.cc:276] 0709 12:18:41.637217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.637382 (+   165us) service_pool.cc:224] Handling call
0709 12:18:41.637687 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.779473 (+141786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.779510 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.789665 (+ 10155us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.957068 (+167403us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4800160158. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:18:42.202967 (+245899us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:42.203026 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.751157 (+1548131us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54001419d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:43.751282 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.701213 (+949931us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:44.880201 (+178988us) raft_consensus.cc:1685] finished
0709 12:18:44.880228 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.880485 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46706,"raft.run_cpu_time_us":2988,"raft.run_wall_time_us":224472,"spinlock_wait_cycles":513274880,"thread_start_us":479717,"threads_started":2,"wal-append.queue_time_us":813858}
I20260709 12:18:44.883764 20330 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:44.884269 23973 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.571s	user 0.014s	sys 0.000s
I20260709 12:18:44.884701 23973 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.884967 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.886430 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.886870 23973 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.887269 20330 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:44.888386 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:44.865182 20219 connection.cc:256] RPC call timeout handler was delayed by -1.3366214659999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:18:44.894850 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:44.898422 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.864351 24007 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.888032 23875 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.002s
I20260709 12:18:44.863740 24027 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:44.903982 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:44.905198 24030 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:44.906050 23888 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:44.906252 24042 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:44.907027 24042 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:44.907464 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.908155 21035 raft_consensus.cc:2376] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10. Re-sending same reply.
I20260709 12:18:44.908134 24042 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.909581 24042 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.910045 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.910815 21035 raft_consensus.cc:2368] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:18:44.910626 20327 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:44.906198 24054 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:44.912123 24054 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:44.912529 24054 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:44.913200 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.914654 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.915936 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.916731 21034 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:44.917447 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.918028 21034 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:44.918545 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:44.919134 21035 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:44.920325 21035 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:44.920599 21034 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:44.926514 23887 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.942250 20326 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:44.957134 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.958611 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.942461 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.948428 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.896095 24009 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:44.850449 24050 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.969158 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:44.959462 21035 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:18:44.966919 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 72196.5us
I20260709 12:18:44.971453 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.971843 20327 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:44.972321 20328 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:44.977895 21037 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:44.980626 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:44.981264 21035 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.962150 23973 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:44.978658 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:44.879966 24057 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.948673 23875 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:44.997781 23875 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:44.973832 23626 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:44.999763 23722 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:45.000241 23722 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.000897 23722 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.965965 23907 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.003549 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:45.003985 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:44.991448 24050 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:44.975327 24009 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:45.004259 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:44.977263 23958 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:45.004314 20174 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:45.009049 21041 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:45.000140 23679 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:45.010432 21038 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:18:44.984582 23992 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.008s
I20260709 12:18:45.016072 21042 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:44.970352 24027 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:45.006453 23887 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:45.025027 20176 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:45.025568 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.026173 23693 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:45.026933 23693 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:45.029345 21034 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:45.029075 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 737) took 1303 ms. Trace:
I20260709 12:18:45.031039 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:45.031065 20249 rpcz_store.cc:276] 0709 12:18:43.717668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.719086 (+  1418us) service_pool.cc:224] Handling call
0709 12:18:45.020735 (+1301649us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002fc954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:45.020915 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517290368}
I20260709 12:18:45.033401 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:45.020109 23993 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 2.315s	user 0.000s	sys 0.006s
I20260709 12:18:44.987234 24007 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:45.022747 23937 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:45.039944 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1656) took 3401 ms. Trace:
I20260709 12:18:45.047988 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:45.048785 20176 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:45.035187 24019 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.034487 23875 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:45.091640 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:45.090349 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74343.4us
I20260709 12:18:45.040346 24017 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.024302 23992 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.102115 21036 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:45.118393 20325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2818) took 2461 ms (client timeout 1618 ms). Trace:
I20260709 12:18:45.123116 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:45.121757 20325 rpcz_store.cc:269] 0709 12:18:42.664139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.676371 (+ 12232us) service_pool.cc:224] Handling call
0709 12:18:45.047536 (+2371165us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002b5f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:45.103026 (+ 55490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763710336}
I20260709 12:18:45.034725 23958 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:45.132002 20176 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:45.133579 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:45.134586 20172 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:45.141427 20248 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:45.042665 20322 rpcz_store.cc:276] 0709 12:18:41.634036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.636654 (+  2618us) service_pool.cc:224] Handling call
0709 12:18:41.640680 (+  4026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:41.666816 (+ 26136us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:41.692429 (+ 25613us) log.cc:844] Serialized 14 byte log entry
0709 12:18:41.961025 (+268596us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b180037c240. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:42.763571 (+802546us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:43.229136 (+465565us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b2c0001ba38. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:18:43.229815 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 12:18:43.229977 (+   162us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:43.674528 (+444551us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.675781 (+  1253us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.676101 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.676271 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.796706 (+1120435us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:45.028305 (+231599us) raft_consensus.cc:1685] finished
0709 12:18:45.028332 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.035783 (+  7451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48428,"prepare.queue_time_us":477009,"prepare.run_cpu_time_us":175,"prepare.run_wall_time_us":5137,"raft.queue_time_us":145805,"raft.run_cpu_time_us":794,"raft.run_wall_time_us":14658,"spinlock_wait_cycles":45110656,"thread_start_us":1462320,"threads_started":3,"wal-append.queue_time_us":366206}
I20260709 12:18:45.115295 23875 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.151028 21036 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:45.309551 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2402) took 3242 ms. Trace:
W20260709 12:18:45.308147 20247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.031s	sys 0.037s
I20260709 12:18:45.596747 23693 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:45.151649 20329 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.005s	sys 0.025s
W20260709 12:18:45.597777 20329 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.008s	sys 0.031s
I20260709 12:18:45.219659 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:45.122107 24049 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.598958 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2823) took 1088 ms. Trace:
I20260709 12:18:45.599103 24019 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.202623 23886 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:45.600685 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 385205us
I20260709 12:18:45.601723 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:45.194949 21035 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:45.211115 24057 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:45.162535 24027 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:45.603628 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.317585 23992 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:45.597157 20247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.037s	sys 0.038s
W20260709 12:18:45.221936 20220 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.016s	sys 0.014s
W20260709 12:18:45.610948 20220 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.024s	sys 0.014s
W20260709 12:18:45.611356 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.15791e+06us
W20260709 12:18:45.608970 20326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.005s
W20260709 12:18:45.612046 20326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.007s	sys 0.006s
W20260709 12:18:45.458684 20180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.002s	sys 0.010s
W20260709 12:18:45.612751 20180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.002s	sys 0.010s
I20260709 12:18:45.614866 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:45.616046 20330 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:45.222127 23906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.012s	sys 0.018s
W20260709 12:18:45.157910 20324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.022s	sys 0.043s
W20260709 12:18:45.634543 20324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.023s	sys 0.048s
I20260709 12:18:45.613463 20329 rpcz_store.cc:276] 0709 12:18:44.514544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.522373 (+  7829us) service_pool.cc:224] Handling call
0709 12:18:44.525179 (+  2806us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:44.525864 (+   685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.525901 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:44.526610 (+   709us) log.cc:844] Serialized 52 byte log entry
0709 12:18:45.598523 (+1071913us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:45.598571 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.598646 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.598690 (+    44us) raft_consensus.cc:1685] finished
0709 12:18:45.598704 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.598898 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2598,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":1071447,"threads_started":1,"wal-append.queue_time_us":1069011}
I20260709 12:18:45.596282 20177 rpcz_store.cc:276] 0709 12:18:42.067348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.070339 (+  2991us) service_pool.cc:224] Handling call
0709 12:18:42.070644 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.847205 (+1776561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.124330 (+1277125us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b540031a1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:45.309469 (+185139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4083608320}
W20260709 12:18:45.209012 23748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.416s	user 0.015s	sys 0.013s
W20260709 12:18:45.350132 23977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.005s	sys 0.009s
I20260709 12:18:45.166734 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:45.633103 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:45.631210 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:45.645709 20255 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.627933 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:45.615511 24019 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:45.157727 23626 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:45.645761 20248 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:45.414507 24012 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:45.646507 20249 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.560287 23958 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.650313 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:45.651866 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:45.642948 23748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.928s	user 0.017s	sys 0.024s
W20260709 12:18:45.638494 23906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.022s	sys 0.022s
W20260709 12:18:45.652231 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 485570us
W20260709 12:18:45.647311 23977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.009s	sys 0.017s
I20260709 12:18:45.656317 23880 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:45.726725 24012 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:45.654275 24017 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:45.639014 23929 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:45.747826 20255 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:45.133746 24009 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:45.739392 23984 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.004s
I20260709 12:18:45.756560 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.758584 20326 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:45.752179 23713 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.004s
I20260709 12:18:45.762373 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.699180 23626 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:45.758054 23958 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:45.776997 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.759681 23886 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:45.781891 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0807891790000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 12:18:45.766420 24007 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.760100 23929 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:45.790817 24063 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:18:45.798254 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.780058 23958 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.788763 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2434) took 1215 ms. Trace:
I20260709 12:18:45.799643 23958 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:45.799818 20180 rpcz_store.cc:276] 0709 12:18:44.573353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.574265 (+   912us) service_pool.cc:224] Handling call
0709 12:18:44.574621 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.575069 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.575106 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.575774 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 12:18:45.613075 (+1037301us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:45.613103 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.613148 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.788514 (+175366us) raft_consensus.cc:1685] finished
0709 12:18:45.788544 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.788694 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1615,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":1036899,"threads_started":1,"wal-append.queue_time_us":1182336}
I20260709 12:18:45.794657 23885 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:45.801855 23885 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:45.802832 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2824) took 1263 ms. Trace:
I20260709 12:18:45.796132 23929 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:45.796762 23918 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.958s	user 0.009s	sys 0.004s
W20260709 12:18:45.797374 23722 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
I20260709 12:18:45.803282 20324 rpcz_store.cc:276] 0709 12:18:44.549956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.550507 (+   551us) service_pool.cc:224] Handling call
0709 12:18:44.550884 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.551413 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.551441 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.552014 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:18:45.635003 (+1082989us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:45.635057 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.635147 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.802572 (+167425us) raft_consensus.cc:1685] finished
0709 12:18:45.802593 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.802767 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4758,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":141,"thread_start_us":1082495,"threads_started":1,"wal-append.queue_time_us":1187489}
I20260709 12:18:45.805007 24012 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.804710 23722 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:45.797461 24054 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.884s	user 0.009s	sys 0.005s
I20260709 12:18:45.805608 20324 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:45.805928 24054 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.771788 23713 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.807425 20179 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:45.802927 23885 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:45.807337 23722 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:45.808691 21040 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:45.808054 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.823267 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.823850 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.839983 20330 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
W20260709 12:18:45.843596 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54181.1us
I20260709 12:18:45.811261 23713 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:45.762207 23984 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:45.851742 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.570s (SENT)
I20260709 12:18:45.808106 24054 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.825085 23875 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.820205 23626 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:45.855937 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:45.859885 20249 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:45.863651 20248 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:45.848954 24050 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:18:45.872639 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:45.874511 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.870348 23722 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:45.878039 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:45.884822 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 43807.4us
I20260709 12:18:45.886477 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 744) took 1424 ms. Trace:
I20260709 12:18:45.876065 23885 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:45.878820 23626 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:45.890573 23918 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:45.891163 23918 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:45.891642 23918 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.893322 23626 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:45.886881 20247 rpcz_store.cc:276] 0709 12:18:44.462425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.466046 (+  3621us) service_pool.cc:224] Handling call
0709 12:18:44.476102 (+ 10056us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:44.523022 (+ 46920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.523055 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:44.539600 (+ 16545us) log.cc:844] Serialized 52 byte log entry
0709 12:18:45.611023 (+1071423us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:45.611072 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.611153 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.886252 (+275099us) raft_consensus.cc:1685] finished
0709 12:18:45.886275 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.886418 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7995,"raft.queue_time_us":16681,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":23112,"thread_start_us":1061194,"threads_started":1,"wal-append.queue_time_us":1277115}
I20260709 12:18:45.893821 23626 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:45.920210 20294 connection.cc:256] RPC call timeout handler was delayed by -1.5272074310000789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 12:18:45.917881 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:45.922547 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 303862us
W20260709 12:18:45.922811 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 269980us
I20260709 12:18:45.925855 24007 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:45.926436 24007 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:45.930033 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:45.931137 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:45.932385 20321 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:45.935479 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.914286 23722 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:45.937522 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.932014 23887 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.949388 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:45.950568 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.957365 20327 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:45.960475 24072 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:18:45.962638 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:45.965772 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:45.967936 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:45.968497 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:45.968791 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:45.971129 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:45.976913 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:45.981067 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 596) took 1320 ms. Trace:
I20260709 12:18:45.981621 20323 rpcz_store.cc:276] 0709 12:18:44.660675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.724652 (+ 63977us) service_pool.cc:224] Handling call
0709 12:18:45.980844 (+1256192us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54002b6954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:45.980982 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694181760}
I20260709 12:18:45.947366 24050 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:46.015057 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.016222 20252 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:46.017707 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:46.019001 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:46.019799 20253 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:46.039371 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.044081 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:45.966130 23984 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:46.043110 20255 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:46.060637 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.062167 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:46.062624 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 113360us
I20260709 12:18:46.073652 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.085665 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.069275 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.149240 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 987) took 1227 ms. Trace:
I20260709 12:18:46.073990 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.084378 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.085208 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.150739 20171 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:46.076730 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:46.086231 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.075285 20249 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:46.152973 20175 raft_consensus.cc:2368] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:18:46.031064 24057 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:46.037268 24043 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.108032 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:46.107005 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:46.149684 21040 rpcz_store.cc:276] 0709 12:18:44.912747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.914250 (+  1503us) service_pool.cc:224] Handling call
0709 12:18:45.989462 (+1075212us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400665654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:46.140455 (+150993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054372224}
I20260709 12:18:46.109042 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:45.956576 24007 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.084683 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.100447 23748 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:46.014796 24050 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.145205 20173 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:46.158030 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:46.156170 20252 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:46.158943 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:46.159271 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:46.160076 20175 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:46.148232 21038 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:46.106199 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.151255 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:45.991667 23722 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:46.162776 20172 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:46.152485 20174 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:46.154712 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.159957 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:46.164057 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:45.963820 23913 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:18:46.156847 20177 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:46.154140 20251 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:46.165714 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:46.165747 20255 raft_consensus.cc:2368] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:18:46.170111 21039 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:46.162946 20179 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:46.164801 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:46.176342 20250 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:46.176887 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.179674 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.148888 23977 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:46.153537 23713 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:46.162642 24050 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:46.188108 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:46.190999 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:46.191910 20249 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:46.175033 24054 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:46.175375 24076 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:46.155910 23918 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:46.182626 23748 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.205159 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:46.204882 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 103442us
I20260709 12:18:46.185003 23929 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:46.191430 20255 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:46.208118 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87828.6us
I20260709 12:18:46.175498 24057 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.193856 20321 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:46.220125 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:46.206766 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 240229us
I20260709 12:18:46.211411 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:46.224368 20172 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:46.182735 23958 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.227171 20253 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:46.227757 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.223213 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:46.216281 24076 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:46.189488 23977 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:46.207773 24054 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:46.221484 23875 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:46.241858 20220 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.523s (SENT)
I20260709 12:18:46.238924 23626 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:46.221604 23929 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:46.243881 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:46.236989 20254 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:46.219312 23844 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:46.229864 24009 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.252472 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:46.216516 23713 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.260685 24054 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.263141 23713 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:46.247746 24017 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.257164 23875 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:46.274945 20220 leader_election.cc:336] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.690s (SENT)
I20260709 12:18:46.276957 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:46.275295 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52199.4us
I20260709 12:18:46.264411 23913 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:46.278718 23913 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:46.280400 23626 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.281270 23626 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:46.281641 23626 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.281978 23626 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:46.283142 24088 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:46.284094 23722 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.285622 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.286456 20173 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:46.288277 23929 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.287482 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.297415 20254 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:46.315965 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.320659 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.321573 20178 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:46.321487 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:46.312636 24067 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:46.329571 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.335912 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.337339 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.337935 20175 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:46.340935 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:46.350544 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.351855 20180 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:46.327277 24027 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:46.277760 24017 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.355113 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.314188 23722 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:18:46.310563 23913 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:46.358520 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83641.8us
I20260709 12:18:46.576882 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.577481 20178 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 4.
I20260709 12:18:46.370050 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.560534 20325 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:46.367367 20175 raft_consensus.cc:2410] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:18:46.412508 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 180297us
I20260709 12:18:46.377408 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:46.579183 20180 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:46.596447 24091 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:46.395485 23875 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.367342 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.609772 20173 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:46.613194 20176 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:46.491566 24057 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:46.578552 23958 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:46.461376 23887 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:46.621767 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 369884us
I20260709 12:18:46.465833 23918 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.600518 24042 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:18:46.654165 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.656677 20294 leader_election.cc:400] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7.
I20260709 12:18:46.657169 20294 leader_election.cc:403] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:18:46.648365 24079 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.397s	user 0.000s	sys 0.002s
I20260709 12:18:46.648334 23977 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:46.622200 24094 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:18:46.677390 23844 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:46.694483 23844 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.395994 24076 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.647847 23887 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.711639 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:46.712517 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.713214 21035 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:46.709861 24094 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7.
I20260709 12:18:46.717355 23977 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:46.719102 23977 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:46.668826 24050 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:46.733703 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 392307us
I20260709 12:18:46.734822 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:46.744706 23907 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:46.745311 23907 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:46.746356 23907 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.747413 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.751439 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.752388 21038 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:46.752318 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2838) took 1001 ms. Trace:
I20260709 12:18:46.760123 20322 rpcz_store.cc:276] 0709 12:18:45.750464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.750672 (+   208us) service_pool.cc:224] Handling call
0709 12:18:45.760417 (+  9745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:45.774653 (+ 14236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:45.774694 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:45.785676 (+ 10982us) log.cc:844] Serialized 26 byte log entry
0709 12:18:46.003220 (+217544us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:46.003287 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.003424 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:46.752081 (+748657us) raft_consensus.cc:1685] finished
0709 12:18:46.752107 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.752256 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16162,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":1782,"thread_start_us":180091,"threads_started":1,"wal-append.queue_time_us":384731}
W20260709 12:18:46.761960 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 163836us
I20260709 12:18:46.762171 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.764544 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.767179 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:46.768210 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 129288us
I20260709 12:18:46.765573 21039 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:46.751729 23885 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.842s	user 0.007s	sys 0.007s
I20260709 12:18:46.771867 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.772459 20247 raft_consensus.cc:2368] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7.
I20260709 12:18:46.772457 24112 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:46.772850 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.775323 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.785676 21036 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:46.777647 24050 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.777595 23626 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:46.778806 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:46.779420 23887 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:46.759933 24066 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:46.719508 23977 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:46.787617 21035 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:46.792884 20220 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.993s (SENT)
I20260709 12:18:46.796283 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:46.775550 23907 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:46.804531 21040 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:46.775344 24017 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.802579 24112 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:46.805456 23977 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.806757 24112 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.793378 23722 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:46.818332 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 98398.2us
I20260709 12:18:46.817010 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:46.807479 23977 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.843756 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:46.846799 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:46.849220 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56567.8us
I20260709 12:18:46.853389 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:46.818568 23722 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:46.818017 23918 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:46.864838 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:46.866339 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.068s (SENT)
I20260709 12:18:46.866989 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:46.871667 20172 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:46.856140 24057 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:46.855867 24088 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.850435 24115 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:46.860225 23844 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:46.893793 21034 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:46.894104 21037 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:18:46.864737 24089 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.369s	user 0.003s	sys 0.001s
I20260709 12:18:46.862684 24050 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:46.900357 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.901116 21036 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:46.898000 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.901733 21038 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.858187 24091 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:46.858143 23885 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:46.891039 24057 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.906103 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.912673 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.915894 21043 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:46.903678 23918 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.918459 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.919227 21036 raft_consensus.cc:2368] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:46.920161 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.915689 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:46.920830 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60967.8us
W20260709 12:18:46.933247 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68194.7us
I20260709 12:18:46.901526 24115 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:46.948390 24114 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:46.949734 23626 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.953727 24115 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:46.911480 24057 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:46.957320 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:46.958021 21043 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:46.959735 23984 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:46.960251 23984 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.961108 21038 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:18:46.962419 23984 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:46.964277 23885 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.964795 23885 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:46.966842 23885 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:46.971941 23913 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:46.974861 24120 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:18:46.997608 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:46.998435 20323 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:47.000875 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.097s (SENT) [suppressed 23 similar messages]
W20260709 12:18:47.002138 20220 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.131s (SENT)
I20260709 12:18:47.002676 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:46.914238 24091 consensus_queue.cc:1243] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:18:47.016247 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.027362 24095 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:47.027601 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.028039 24095 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:47.029094 24095 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.030392 24095 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:47.030608 24119 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:18:47.032553 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.033679 24085 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:47.034122 24085 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:47.035076 24085 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.036463 24085 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.048053 24088 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:47.048543 24088 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:47.049492 24088 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.050786 24088 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.056183 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:47.057216 24076 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:47.057777 24076 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.058275 24076 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.036058 23722 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.064536 21039 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
W20260709 12:18:47.099193 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 233943us
W20260709 12:18:47.106093 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.109963 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:47.110690 23713 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.111470 23713 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.110772 21039 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:47.113780 23713 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:47.098799 24050 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:47.116976 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 199842us
I20260709 12:18:47.118279 24092 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:47.120067 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 117986us
I20260709 12:18:47.121369 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.122089 20247 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:47.101183 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 167028us
I20260709 12:18:47.124522 21043 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:47.128511 21039 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:47.115110 24050 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.140868 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.142789 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.144443 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.149969 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.152081 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:47.153198 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.154434 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.156016 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.156371 20248 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:47.157143 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.157230 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.157881 20251 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:47.158260 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.158601 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.159832 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.160409 20322 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:47.160997 24057 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.161437 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.162140 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.162782 20250 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.155474 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.163993 20252 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:47.159271 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.159281 20251 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:47.167963 20253 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:47.170732 20294 leader_election.cc:400] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:18:47.171111 20294 leader_election.cc:403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.129091 23913 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:18:47.173810 23913 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:47.174211 23913 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:47.175063 23913 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.176384 23913 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.176688 23772 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.177425 23772 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.177382 24094 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:18:47.179898 24104 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:18:47.181861 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.184963 24104 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.185487 24104 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.186985 23772 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:18:47.187798 24104 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:47.189102 20247 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:18:47.189456 20247 pending_rounds.cc:85] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 8
I20260709 12:18:47.189685 20247 pending_rounds.cc:107] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:18:47.189903 20247 raft_consensus.cc:2889] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:47.193818 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.197091 20076 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 5 to 9, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:47.201268 20073 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 306) took 17031 ms (client timeout 15000 ms). Trace:
I20260709 12:18:47.203321 24057 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:47.204429 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.209426 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:47.204438 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.210536 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.139066 23880 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:47.212098 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6505975109998872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:18:47.216714 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6505975109998872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:18:47.217100 20322 raft_consensus.cc:1217] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.7->[9.8-10.9]   Dedup: 9.8->[10.9-10.9]
I20260709 12:18:47.217693 20322 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 12:18:47.213661 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.199370 20076 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.221282 23772 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.215960 24112 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.131913 23918 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:18:47.221288 20076 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 5, leader changed from <none> to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:47.207916 24104 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.224205 23984 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.232537 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:47.219732 23880 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.211376 23977 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:47.218040 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:47.201664 20073 rpcz_store.cc:269] 0709 12:18:30.169767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.170027 (+   260us) service_pool.cc:224] Handling call
0709 12:18:47.200967 (+17030940us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:40.657157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:40.863514 (+206357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:40.872101 (+  8587us) write_op.cc:435] Acquired schema lock
0709 12:18:40.874724 (+  2623us) tablet.cc:662] Decoding operations
0709 12:18:40.889776 (+ 15052us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:40.889847 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:40.889872 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:18:41.007026 (+117154us) tablet.cc:701] Row locks acquired
0709 12:18:41.009877 (+  2851us) write_op.cc:260] PREPARE: finished
0709 12:18:41.019751 (+  9874us) write_op.cc:270] Start()
0709 12:18:41.033208 (+ 13457us) write_op.cc:276] Timestamp: P: 1783599521018041 usec, L: 0
0709 12:18:41.034363 (+  1155us) op_driver.cc:348] REPLICATION: starting
0709 12:18:41.134755 (+100392us) log.cc:844] Serialized 2850 byte log entry
0709 12:18:41.666088 (+531333us) op_driver.cc:464] REPLICATION: finished
0709 12:18:42.231838 (+565750us) write_op.cc:301] APPLY: starting
0709 12:18:42.234083 (+  2245us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:42.365935 (+131852us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:42.394804 (+ 28869us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:42.859164 (+464360us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:43.017551 (+158387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:18:43.065640 (+ 48089us) write_op.cc:312] APPLY: finished
0709 12:18:43.149499 (+ 83859us) log.cc:844] Serialized 59 byte log entry
0709 12:18:43.574902 (+425403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:43.575099 (+   197us) write_op.cc:454] Released schema lock
0709 12:18:43.575154 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:43.575636 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:43.575664 (+    28us) write_op.cc:454] Released schema lock
0709 12:18:44.567317 (+991653us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef532a 00007f5ddae7af14 00007f5ddae7aec3 00007f5ddae7ae38 00007f5ddae7adf3 00007f5ddae7a0dc 00007f5ddaea3e16 00007f5ddae8bcbb 00007f5ddae7639d 00007f5ddae79d75
Metrics: {"mutex_wait_us":87015,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":518943,"apply.run_cpu_time_us":44636,"apply.run_wall_time_us":1355455,"num_ops":7,"prepare.queue_time_us":358588,"prepare.run_cpu_time_us":30624,"prepare.run_wall_time_us":891427,"raft.queue_time_us":89393,"raft.run_cpu_time_us":26208,"raft.run_wall_time_us":2999361,"replication_time_us":586993,"spinlock_wait_cycles":63782144,"thread_start_us":1221425,"threads_started":5,"wal-append.queue_time_us":779162,"wal-append.run_cpu_time_us":7050,"wal-append.run_wall_time_us":2191873}]]}
I20260709 12:18:47.219512 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.276731 20323 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:47.220852 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.219949 24057 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.267663 20326 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.215909 23713 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:47.268131 20250 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:18:47.131916 24076 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.271878 20076 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.274875 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.275079 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.285874 20325 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:18:47.217075 20144 connection.cc:256] RPC call timeout handler was delayed by -1.185297510999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 12:18:47.287189 20144 connection.cc:256] RPC call timeout handler was delayed by -1.185297510999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 12:18:47.287189 20248 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:18:47.287612 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1582975109997733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 12:18:47.287952 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1330975109997325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 12:18:47.288226 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0385975109998071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
W20260709 12:18:47.278302 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57546.5us
I20260709 12:18:47.288956 24088 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.295749 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:47.296368 20325 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.295749 20076 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.277807 23977 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:47.298319 20248 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:18:47.292004 23713 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.299836 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:47.300568 20322 raft_consensus.cc:606] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.300884 20322 raft_consensus.cc:614] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:47.288998 23929 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:47.300868 20076 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:47.286450 24090 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:47.304064 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:47.304675 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85245.7us
I20260709 12:18:47.289943 23722 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.306416 21041 raft_consensus.cc:2368] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:47.306216 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:47.307955 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.311764 20322 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:47.275247 23984 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.313220 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.303009 23977 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:47.318998 20219 leader_election.cc:400] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:47.323625 20219 leader_election.cc:403] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.322738 20255 raft_consensus.cc:2368] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
W20260709 12:18:47.313692 24129 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:18:47.329493 20325 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:47.305734 24090 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.341722 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.341964 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:47.342687 20322 raft_consensus.cc:606] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.342967 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:47.345868 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48201.7us
I20260709 12:18:47.345891 20076 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.340097 24088 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:47.351125 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.352520 20255 raft_consensus.cc:2368] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:47.332746 23772 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.341619 23913 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.345578 24090 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:47.360033 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:47.360674 20325 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:47.361289 20294 leader_election.cc:400] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7.
I20260709 12:18:47.361614 20294 leader_election.cc:403] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.345499 24112 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:47.363689 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.364327 20076 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 7, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 7 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:47.347479 23918 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.365938 20255 raft_consensus.cc:2368] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:47.374608 20076 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 5 to 6, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.351889 24088 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:47.377583 20325 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:47.384145 24050 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:47.384902 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:47.385360 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.386195 23880 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:47.413697 20330 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:47.386612 20324 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:47.414415 20322 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:47.416399 24111 raft_consensus.cc:993] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:47.416934 23907 raft_consensus.cc:1081] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
W20260709 12:18:47.379379 24124 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:18:47.390604 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.426848 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.366762 23918 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:47.391943 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:47.392594 23984 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:47.392637 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.419588 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.395737 23885 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:47.396193 23713 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:47.396673 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.432863 20255 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:47.404091 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:47.405090 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.407486 20076 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.434075 20249 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:47.412012 24115 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7.
I20260709 12:18:47.412366 20256 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:47.389494 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.428006 21041 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:47.430687 20253 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:18:47.433087 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 77205.4us
I20260709 12:18:47.403844 24088 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.404587 24076 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:47.452121 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.447512 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64230d63b49741d69bace479cb6508f1"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:47.459322 20326 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:47.467643 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:47.468019 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 67583.1us
W20260709 12:18:47.463459 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.526s (SENT)
I20260709 12:18:47.429174 23918 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.446727 20076 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:18:47.481962 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.482506 20294 connection.cc:256] RPC call timeout handler was delayed by -1.4949199029999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:18:47.482853 20294 connection.cc:256] RPC call timeout handler was delayed by -1.4535199029999148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:18:47.483152 20294 connection.cc:256] RPC call timeout handler was delayed by -1.4481199029999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 12:18:47.483417 20294 connection.cc:256] RPC call timeout handler was delayed by -1.4445199029999003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:18:47.484728 20294 connection.cc:256] RPC call timeout handler was delayed by -1.2798199029998614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:18:47.485080 20294 connection.cc:256] RPC call timeout handler was delayed by -1.2735199029998512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:18:47.485342 20294 connection.cc:256] RPC call timeout handler was delayed by -1.2042199029999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 12:18:47.485587 20294 connection.cc:256] RPC call timeout handler was delayed by -1.1376199029998588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:18:47.485847 20294 connection.cc:256] RPC call timeout handler was delayed by -1.1250199029998385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 12:18:47.486109 20294 connection.cc:256] RPC call timeout handler was delayed by -1.0773199029999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 12:18:47.487737 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.487519 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.488431 20252 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:47.481746 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:47.494834 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:47.501578 20251 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:47.502578 20076 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:47.500363 24050 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:47.445749 23984 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:18:47.504004 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:47.514132 20294 leader_election.cc:400] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:18:47.514575 20294 leader_election.cc:403] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.518684 20076 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 6, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.501395 24057 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.524403 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:47.510982 24050 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:47.531925 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:47.533687 20076 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:47.538021 20076 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 5 to 6, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:47.576776 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44917.2us
I20260709 12:18:47.578846 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:47.588507 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.523622 24057 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:18:47.598352 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62479.4us
I20260709 12:18:47.600545 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:47.531051 24112 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:47.595528 20076 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:47.534883 24104 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:47.537146 24118 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
W20260709 12:18:47.628746 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 114782us
I20260709 12:18:47.630229 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.594986 24076 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.535162 24086 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:18:47.621809 24092 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:47.621578 24057 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.534750 23958 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:18:47.621680 23713 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:47.622133 23626 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:47.624292 24104 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.648612 20180 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:47.651067 23713 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:47.645574 24130 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:18:47.671789 24137 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.199s	user 0.004s	sys 0.000s
I20260709 12:18:47.679080 23913 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:18:47.656906 24104 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.686044 24092 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:47.659299 24085 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:47.701718 24092 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.630182 24050 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.707360 23713 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.709380 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:47.698417 24090 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:47.711434 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:47.714010 20323 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.644038 24076 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.726176 20255 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:18:47.710947 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61452.5us
I20260709 12:18:47.738344 20327 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:47.656548 23626 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.738934 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.742204 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.744702 20325 raft_consensus.cc:606] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.745131 20325 raft_consensus.cc:614] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:47.752548 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:47.753252 21040 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:47.753226 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.754172 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:47.756727 21043 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:47.767055 24076 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:47.768034 21041 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:47.768988 23626 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:47.754635 23929 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:47.758956 24017 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:18:47.767071 24085 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.775487 24085 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.775904 24085 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.733999 24112 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:47.789206 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 188793us
I20260709 12:18:47.790999 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.756026 24100 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:47.794207 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 169371us
I20260709 12:18:47.799088 20329 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:47.800253 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.800987 20330 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:47.781523 23929 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.801981 21039 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:47.816569 20249 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:47.745648 23772 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:18:47.854185 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53499.1us
W20260709 12:18:47.832736 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.855705 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:47.760527 23875 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:47.794703 23958 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.864912 21039 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:47.867036 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:47.875134 20325 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
W20260709 12:18:47.863857 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.542s (SENT)
I20260709 12:18:47.876053 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.824613 23885 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:47.876103 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 90669.6us
I20260709 12:18:47.878574 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:47.881359 21043 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:18:47.863123 23772 consensus_queue.cc:1243] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:47.886732 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.868727 23929 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:47.854326 24076 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:18:47.801091 23880 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:18:47.854041 23984 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:18:47.911904 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:47.915663 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:47.916491 20172 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:47.918889 24149 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:47.920270 24090 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:47.923911 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.926028 23929 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:47.914987 24112 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:47.908634 23977 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
W20260709 12:18:47.933511 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 67157.2us
I20260709 12:18:47.905117 24134 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:47.879165 23722 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 12:18:47.990207 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.665s (SENT)
I20260709 12:18:47.907742 24017 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.991096 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:47.888341 24110 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:48.000087 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:47.889510 24144 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:18:47.995873 24104 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:48.013926 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d963e0e1da434f887fc330570683e5"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:48.023460 20328 raft_consensus.cc:606] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:18:48.013063 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 67885.7us
I20260709 12:18:48.017122 20248 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
W20260709 12:18:48.013934 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66716.7us
W20260709 12:18:48.025902 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.816s (SENT)
W20260709 12:18:48.022212 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 166647us
I20260709 12:18:48.022266 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:47.996337 24148 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:18:48.026360 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:48.034442 20144 leader_election.cc:400] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:48.034828 20144 leader_election.cc:403] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.992293 24095 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:48.019752 24088 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 12:18:48.035671 20144 leader_election.cc:400] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:48.016196 23748 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.037118 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:48.021400 24134 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:48.033963 23918 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.002s
I20260709 12:18:48.033208 23880 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:47.989075 23977 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:48.064661 20323 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:47.995829 24115 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:18:48.020756 24092 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:18:48.080600 21008 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.928s (SENT)
I20260709 12:18:48.047706 24152 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:48.087637 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 65462.5us
W20260709 12:18:48.088629 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 143951us
I20260709 12:18:48.090519 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:48.092563 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:48.033215 24027 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:18:48.057729 24096 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:48.095660 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:48.098218 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:48.074654 24153 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:18:48.072786 24150 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:18:48.070276 24158 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:48.072140 24101 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:48.069662 24106 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:48.070807 24144 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.119678 20248 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 3.
I20260709 12:18:48.049687 24088 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:48.121204 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 84173us
I20260709 12:18:48.156641 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:48.095939 24086 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.157449 24086 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:48.119110 24017 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:48.071300 23918 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:48.096257 23875 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:48.053553 23748 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.042539 20144 leader_election.cc:403] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.154469 23977 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:48.155323 24088 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:48.120493 24096 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:48.172236 24096 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:48.136428 24157 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:48.173559 24096 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:48.174324 20220 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.921s (SENT)
I20260709 12:18:48.159726 20294 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:48.169143 24057 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 12:18:48.166850 24115 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:48.079003 24085 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:48.209306 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 173752us
W20260709 12:18:48.202811 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.141742 24101 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:48.079706 24134 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:48.222477 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 73981.5us
I20260709 12:18:48.233649 20144 leader_election.cc:400] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:48.235354 20144 leader_election.cc:403] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.163383 23875 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.237931 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:48.238214 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 78634.2us
I20260709 12:18:48.242946 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.243937 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.217842 23984 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:48.231058 23880 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.275769 23880 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.230188 24115 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:48.240120 24101 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:48.282018 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.231528 24017 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:48.287914 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.240123 23875 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:48.284543 20325 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:48.246006 24110 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:48.292070 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:48.292773 20250 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:48.232026 24057 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:48.286686 24115 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:48.304749 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.302785 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.306243 23880 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:48.308069 24159 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:18:48.309119 24057 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:48.311753 23929 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:48.312146 23929 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:48.301064 23958 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:48.274739 24111 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:18:48.303225 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:48.326792 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.024s (SENT)
I20260709 12:18:48.327319 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:48.329929 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.330812 20324 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:48.352533 23918 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:48.361894 24162 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:18:48.362661 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.363756 20324 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:48.365849 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.369184 20323 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:48.371858 20325 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:18:48.359047 24163 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:48.374651 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47903.1us
I20260709 12:18:48.375105 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:48.376585 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.678s (SENT)
W20260709 12:18:48.377302 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74167.6us
I20260709 12:18:48.389453 24175 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:48.389930 24175 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.390275 24175 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:48.394649 20220 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.215s (SENT)
I20260709 12:18:48.407002 24140 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:48.422902 24140 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:48.423923 24140 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.425038 24086 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:48.425325 24140 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:48.379843 24054 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:48.407868 23748 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:48.409385 24085 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:48.412300 23913 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:48.414024 24165 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:48.416775 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.373114 24017 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.421828 23929 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.453516 20173 pending_rounds.cc:85] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 7
I20260709 12:18:48.460736 20173 pending_rounds.cc:107] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:18:48.461123 20173 raft_consensus.cc:2889] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:48.466140 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.467083 20329 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:48.464267 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.442049 24104 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:48.475139 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.475981 20172 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:18:48.478869 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.461624 24165 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.488288 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.491721 20329 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:48.492473 20327 raft_consensus.cc:1217] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[6.6-8.7]   Dedup: 8.7->[]
I20260709 12:18:48.493117 20327 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
W20260709 12:18:48.505187 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.513659 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:48.516408 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 282933us
I20260709 12:18:48.514916 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:48.532980 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.533880 20322 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:48.535002 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.536661 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:48.469789 24110 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:48.538964 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.489212 23929 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.558109 20324 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:48.505909 24165 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:48.564517 20172 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:48.542551 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.566341 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.573326 20330 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:18:48.565418 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 185017us
I20260709 12:18:48.462663 23913 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.540975 24057 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.578768 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.581773 20172 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:48.578006 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.578600 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.578994 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.540992 24118 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:48.577473 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.558346 24152 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:48.541605 24111 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:48.599694 20179 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9.
I20260709 12:18:48.563287 23713 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:48.542168 24134 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:18:48.600929 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.618449 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.660040 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.601800 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:48.618199 24134 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:48.587208 24118 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.569790 24110 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:48.668800 24134 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:48.674314 24134 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:48.677121 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.177s (SENT)
I20260709 12:18:48.670822 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:48.668932 24139 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:18:48.669993 24171 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:18:48.630079 24111 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.691085 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.698868 20328 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:48.697237 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.694274 20324 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:48.700590 24188 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.178s	user 0.003s	sys 0.000s
I20260709 12:18:48.701068 24110 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:48.700690 20178 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9.
I20260709 12:18:48.702742 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.703382 20178 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:48.703698 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.704383 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.707150 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.708292 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.709515 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.710561 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.711807 20178 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8.
I20260709 12:18:48.712726 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.716616 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.717388 20323 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:48.717476 23913 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:48.715293 24101 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.604574 23713 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:48.676019 24118 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:48.727197 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.730664 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:48.735656 21034 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:18:48.737656 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:48.738466 20324 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:48.631798 24057 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.727869 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.729240 20322 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:48.741691 20325 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:48.746031 20179 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9.
I20260709 12:18:48.715366 23984 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:48.755256 20329 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:48.755939 20321 raft_consensus.cc:606] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:48.756397 20321 raft_consensus.cc:614] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:48.758430 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:48.759289 21041 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:48.763960 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78927us
I20260709 12:18:48.769811 20253 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:48.773473 20254 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:48.763509 20180 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:48.728029 23713 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:48.781313 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.784194 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:48.744715 24134 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.711434 24115 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:48.956895 20328 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:48.856508 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:48.791230 20249 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:48.806444 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.918s (SENT)
I20260709 12:18:49.290189 20329 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:48.841285 24176 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.989524 24112 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:48.881541 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.292038 24112 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.293401 24096 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.294046 24096 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.294667 24112 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.164064 23626 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:49.296561 23626 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.296893 24096 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:49.016628 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.916849 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54177.6us
I20260709 12:18:48.848454 24101 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:48.763999 24140 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.299793 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.968019 21041 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:49.300964 20173 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:49.302153 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:48.805409 21039 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:49.299904 24140 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:48.880362 23875 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:18:48.791524 20256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:18:49.297288 24057 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.319693 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:49.324620 20253 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:48.956849 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.860997 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:48.789387 24175 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.298631 23626 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:49.290598 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 484177us
W20260709 12:18:49.345475 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.937s (SENT)
I20260709 12:18:49.345968 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.311231 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:49.268137 24085 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.316246 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.321291 20256 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:49.352849 20256 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:49.325318 23929 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.751s	user 0.013s	sys 0.000s
I20260709 12:18:48.793401 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:49.321594 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:49.325758 20174 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:48.976830 24144 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.000s
I20260709 12:18:49.354286 20250 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:49.348287 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.792s (SENT)
I20260709 12:18:49.354235 20254 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:49.355371 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.795s (SENT)
W20260709 12:18:49.314849 20220 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.749s (SENT)
W20260709 12:18:49.356575 21008 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.093s (SENT)
W20260709 12:18:49.349072 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.297305 24115 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.358106 24115 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:49.358731 24115 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.361829 24115 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:48.975682 23913 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:49.363231 23913 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.348230 20248 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:49.295457 24112 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.366559 24112 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.350947 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:49.369068 20180 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9.
I20260709 12:18:49.370187 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.371521 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.373066 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:49.373898 20180 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8.
I20260709 12:18:49.357015 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.377944 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:49.386543 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.388386 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:49.386857 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.389367 20180 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:49.290997 24176 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.396962 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:49.352639 24017 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.401684 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.355894 24144 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.418855 20254 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:49.428081 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.337059 23875 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.454027 23875 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.457315 24140 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:49.458020 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.475880 24096 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:49.356855 24085 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.486385 24085 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:49.490422 24176 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:49.492055 23918 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.492718 23918 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.495013 23918 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.500216 24112 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.505079 21039 raft_consensus.cc:2368] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:18:49.430692 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.441727 24175 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.444702 24111 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.446349 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:49.505699 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.562033 20179 raft_consensus.cc:2410] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:18:49.561928 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.536s (SENT)
I20260709 12:18:49.563163 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.525250 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:49.504220 23913 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.567854 20248 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:49.575958 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.514053 20253 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:49.577467 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:49.548138 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.578219 20247 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:49.523701 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:49.588109 20254 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:49.516032 20220 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.642s (SENT)
W20260709 12:18:49.592450 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76453.9us
I20260709 12:18:49.504272 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:49.581262 20256 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:49.605020 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.757s (SENT)
I20260709 12:18:49.606256 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.618391 20177 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.618788 20180 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:49.558274 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:49.610046 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:49.610759 24134 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.000s
I20260709 12:18:49.611949 20174 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:49.621457 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 569) took 1045 ms. Trace:
I20260709 12:18:49.621874 20174 rpcz_store.cc:276] 0709 12:18:48.576154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.415886 (+839732us) service_pool.cc:224] Handling call
0709 12:18:49.621381 (+205495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.612445 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:49.623247 20173 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:49.624413 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:49.625216 20321 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:49.616434 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 300253us
I20260709 12:18:49.596868 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:49.612710 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:49.620596 20328 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:49.626053 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.612426 20248 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:18:49.557561 23918 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:49.629874 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:49.630271 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.629788 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.631789 20172 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:49.632982 20179 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:49.640137 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:49.627101 24165 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.047s	user 0.012s	sys 0.000s
W20260709 12:18:49.643646 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 85512.6us
I20260709 12:18:49.654266 21039 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:49.652129 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:49.642863 20323 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:49.659240 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:49.569396 24112 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:49.643280 20256 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.646628 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:49.664566 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.654404 20172 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:49.660259 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:49.629114 24140 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:49.707391 20172 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:49.703634 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.668s (SENT)
I20260709 12:18:49.709506 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:49.717698 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.642531 24202 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:49.735046 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 74848.2us
I20260709 12:18:49.724192 20321 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:18:49.732821 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:49.717057 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.097s (SENT)
W20260709 12:18:49.703810 24163 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.287s	user 0.005s	sys 0.009s
I20260709 12:18:49.754637 20172 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.751806 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.757978 20177 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:18:49.759743 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56202.8us
W20260709 12:18:49.761075 21008 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.206s (SENT)
W20260709 12:18:49.762686 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45705.1us
W20260709 12:18:49.763624 20220 leader_election.cc:336] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.140s (SENT)
I20260709 12:18:49.768711 24086 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:49.770289 24086 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.645995 23918 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.774448 23918 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.763808 24202 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.778107 24202 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:49.778468 24195 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:18:49.779935 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1007) took 1051 ms. Trace:
I20260709 12:18:49.780287 21040 rpcz_store.cc:276] 0709 12:18:48.728443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.729293 (+   850us) service_pool.cc:224] Handling call
0709 12:18:48.735893 (+  6600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.736118 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.736163 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.736688 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.870424 (+133736us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:48.870476 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.870563 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.779657 (+909094us) raft_consensus.cc:1685] finished
0709 12:18:49.779686 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.779852 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"thread_start_us":133280,"threads_started":1,"wal-append.queue_time_us":869001}
W20260709 12:18:49.781397 24118 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.029s	user 0.011s	sys 0.001s
I20260709 12:18:49.781821 24118 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.783129 20330 raft_consensus.cc:2368] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15.
W20260709 12:18:49.783818 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.731101 24104 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.784607 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:49.784751 24104 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.785198 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1684) took 1215 ms. Trace:
I20260709 12:18:49.785287 20174 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:49.785636 20330 rpcz_store.cc:276] 0709 12:18:48.570220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.573946 (+  3726us) service_pool.cc:224] Handling call
0709 12:18:49.785010 (+1211064us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540007f154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:49.785141 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580434816}
I20260709 12:18:49.786906 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:49.663558 24165 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.789112 24165 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.789809 20178 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:49.790292 23626 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.791186 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 579) took 1116 ms. Trace:
I20260709 12:18:49.791451 20180 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:49.791810 20178 rpcz_store.cc:276] 0709 12:18:48.674423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.712515 (+ 38092us) service_pool.cc:224] Handling call
0709 12:18:49.790938 (+1078423us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400319cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:49.791089 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102643456}
I20260709 12:18:49.787082 24104 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.802497 20254 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:49.723035 24144 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.651773 24204 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:49.804978 20323 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:49.754142 24050 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:49.730456 23913 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:49.810544 21034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.032s	sys 0.020s
W20260709 12:18:49.813882 21034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.032s	sys 0.020s
I20260709 12:18:49.758260 24163 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
W20260709 12:18:49.808686 23885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.061s	sys 0.122s
I20260709 12:18:49.765964 23929 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.806962 24200 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:49.853154 20175 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:49.808745 24204 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:49.831097 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 503641us
I20260709 12:18:49.839620 20219 leader_election.cc:400] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:18:49.856014 20219 leader_election.cc:403] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:18:49.843923 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.856678 24203 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:18:49.861127 24101 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:18:49.852437 24076 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.861475 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:49.861845 24076 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.862773 24101 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:49.839751 23885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.061s	sys 0.122s
I20260709 12:18:49.862739 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:49.837430 24050 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:49.828929 24111 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:49.898828 20175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 571) took 1290 ms (client timeout 1678 ms). Trace:
I20260709 12:18:49.863798 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:49.838495 24100 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.903795 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:49.905647 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:49.908964 21035 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:49.860229 23913 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:49.899355 20175 rpcz_store.cc:269] 0709 12:18:48.608584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.659706 (+ 51122us) service_pool.cc:224] Handling call
0709 12:18:49.898639 (+1238933us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540031b0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:49.898752 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2730724096}
I20260709 12:18:49.858757 24204 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:49.919991 24163 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.921733 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:49.920060 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:49.922544 20180 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:49.923168 24050 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.924557 23913 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:49.926817 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.928226 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:49.920892 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 64675.5us
I20260709 12:18:49.920720 24111 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.948096 20180 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:18:49.931303 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:49.949535 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.511s (SENT)
I20260709 12:18:49.950599 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:49.951933 24057 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.952217 24134 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.901983 24092 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.865687 24200 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.908304 24118 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:49.864153 24206 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 12:18:49.962908 20220 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.728s (SENT)
I20260709 12:18:49.963620 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:49.956322 23713 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.150s	user 0.011s	sys 0.002s
I20260709 12:18:49.961452 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:49.965576 23713 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:49.965920 24134 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:49.966609 24134 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:49.967020 24134 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:49.968045 23713 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:49.955364 24057 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:49.968966 20173 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:49.969717 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:49.960163 24115 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.973675 24057 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:49.977012 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:49.978535 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:49.973094 24076 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:49.985870 24092 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:50.000144 24206 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.992133 23713 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:50.008447 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 353818us
I20260709 12:18:50.002241 24207 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:50.004896 24163 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:50.007800 24111 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:50.022348 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125197us
I20260709 12:18:49.986658 24115 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.023102 20321 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:50.066483 20248 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:50.034650 20172 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:18:50.070396 20172 pending_rounds.cc:85] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 7
I20260709 12:18:50.070253 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.070668 20172 pending_rounds.cc:107] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:18:50.070959 20172 raft_consensus.cc:2889] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:50.048707 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.074651 20256 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:50.036274 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:50.076522 20254 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:50.010788 23713 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:50.071835 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.077798 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:50.082757 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.807s (SENT)
I20260709 12:18:50.008486 24206 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.023787 24207 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:50.090561 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.090884 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:50.093464 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:50.039956 23875 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.092080 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.081598 24118 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.096279 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.083050 24096 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.104357 20323 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:50.095269 24085 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:50.097990 24165 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:50.094964 23713 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:50.106411 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 128022us
I20260709 12:18:50.112001 20254 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:50.096812 24207 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.129817 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:50.115522 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.120421 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.114634 24200 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.125200 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.140862 20250 raft_consensus.cc:2410] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:50.127789 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.113119 24085 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:50.115954 24205 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.113947 24076 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:50.112478 24218 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:50.168354 20323 raft_consensus.cc:2410] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:18:50.152806 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.111027 24096 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.122164 24165 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:50.125080 24167 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:50.118132 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:50.182003 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52264.5us
I20260709 12:18:50.182826 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:50.180651 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.150859 24085 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.105166 23875 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:50.192009 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75612.1us
I20260709 12:18:50.198385 20144 leader_election.cc:400] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8.
I20260709 12:18:50.179646 24223 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.199389 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:50.206045 24057 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.208819 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.214419 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:50.183768 24200 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:50.194712 24218 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:50.231832 24134 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.232270 24218 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:18:50.233834 24215 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:18:50.234078 24134 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.222190 24115 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:50.235111 24224 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:50.236496 24223 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.237025 24232 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:50.237475 24232 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.237826 24232 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:50.224085 23875 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.211666 24231 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.224817 24165 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.219368 24106 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:50.203240 24176 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:50.219007 24210 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:18:50.286960 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 106413us
I20260709 12:18:50.293402 24115 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:50.299654 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:50.301493 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.241365 24206 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.285290 24176 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.178886 24205 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:50.292510 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55926.2us
I20260709 12:18:50.294070 24233 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:50.323211 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 123883us
I20260709 12:18:50.298324 24158 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:50.325222 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:50.318379 23626 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.002s
I20260709 12:18:50.333374 24234 raft_consensus.cc:2764] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:18:50.350006 24205 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.332649 24158 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.358007 24158 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.332309 24233 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.360855 24233 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.321798 24176 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.309283 24115 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.329722 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:50.366135 20220 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.192s (SENT)
I20260709 12:18:50.375267 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.367168 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1011) took 1613 ms. Trace:
I20260709 12:18:50.374600 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:50.368976 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 72624.3us
I20260709 12:18:50.378646 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:50.326550 24241 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.376718 21034 rpcz_store.cc:276] 0709 12:18:48.754320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.754571 (+   251us) service_pool.cc:224] Handling call
0709 12:18:48.778477 (+ 23906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.804641 (+ 26164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.804674 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.848897 (+ 44223us) log.cc:844] Serialized 26 byte log entry
0709 12:18:49.830005 (+981108us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:49.830064 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.830162 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:50.366882 (+536720us) raft_consensus.cc:1685] finished
0709 12:18:50.366913 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:50.367087 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69909,"raft.queue_time_us":27076,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6901,"thread_start_us":913589,"threads_started":1,"wal-append.queue_time_us":1104158}
I20260709 12:18:50.365710 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 596) took 1066 ms. Trace:
I20260709 12:18:50.378425 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.396966 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.397912 20250 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:50.399362 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:50.399828 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.400202 20325 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:50.400501 20321 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:50.400658 20325 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:50.410790 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.340843 24096 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:50.334092 24091 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:50.445410 24091 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.446803 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.411460 20330 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:50.448115 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.448693 20329 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:50.449535 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.450166 20327 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:50.450973 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.414425 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.334079 23626 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.438333 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.461475 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:50.439558 23713 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.441186 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:50.464720 21039 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:50.378212 24144 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:50.401739 20325 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.468390 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.442675 24115 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.399257 24231 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:50.443789 23875 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:50.395800 24234 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:50.399061 23929 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:50.412864 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.462312 20326 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:50.462327 21038 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:50.463296 20256 raft_consensus.cc:1217] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:18:50.491146 20256 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:50.386384 24085 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.391860 24151 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.494686 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:50.474560 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.474721 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:50.475440 21040 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:50.475981 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.476871 24110 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:50.475462 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.479053 20251 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:50.479321 20252 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:50.507238 20248 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:50.481367 20325 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:50.483542 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.508718 20329 raft_consensus.cc:2410] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:50.363502 24204 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.492972 20256 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 12:18:50.465986 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.398422 24106 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:18:50.500067 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:50.410032 24165 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:18:50.381907 20176 rpcz_store.cc:276] 0709 12:18:49.299638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.459337 (+159699us) service_pool.cc:224] Handling call
0709 12:18:49.510332 (+ 50995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:49.601714 (+ 91382us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:50.047734 (+446020us) log.cc:844] Serialized 14 byte log entry
0709 12:18:50.284200 (+236466us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:50.284805 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:18:50.285061 (+   256us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:50.285420 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 12:18:50.309530 (+ 24110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.309588 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:50.365342 (+ 55754us) raft_consensus.cc:1685] finished
0709 12:18:50.365374 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:50.365628 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56715,"prepare.queue_time_us":421833,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":79,"raft.queue_time_us":168880,"raft.run_cpu_time_us":437,"raft.run_wall_time_us":29943,"thread_start_us":602304,"threads_started":3,"wal-append.queue_time_us":131892}
I20260709 12:18:50.508857 20248 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:50.516309 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.517838 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:50.521337 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:50.525421 20256 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:50.479864 24167 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:50.482937 24144 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:50.530216 21038 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:18:50.540530 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:50.500928 24231 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:50.533298 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:50.546368 21041 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:50.513255 24203 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:50.497856 23626 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.490024 24234 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:50.525132 24091 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.537034 20325 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:18:50.538928 20220 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.183s (SENT)
I20260709 12:18:50.562460 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.532102 21039 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:50.402007 24241 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.535200 20253 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:50.506754 24110 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:50.548699 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.514369 24100 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:50.490386 24200 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:18:50.482961 23885 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:18:50.504032 24054 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:18:50.516829 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:50.647943 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 131189us
I20260709 12:18:50.649119 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.564451 21040 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:50.564872 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54544.8us
I20260709 12:18:50.546430 24208 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:50.499526 24232 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:50.659041 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 208949us
I20260709 12:18:50.589967 21041 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:50.554876 23880 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:50.543934 23929 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:50.572427 23626 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.693579 23626 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.676731 23880 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:50.696214 23880 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:50.697676 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.620625 24239 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:50.698439 24239 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.699126 24085 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:50.555739 24203 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:50.705888 24203 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.707145 24203 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.564548 24234 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:50.691505 23929 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.580196 24100 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:50.715096 24100 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.620605 20256 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:18:50.557451 24207 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.627614 24115 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.597823 24144 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.625273 24110 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.624418 24204 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.634258 24176 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.734067 24176 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:50.629560 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:50.633059 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 94146.9us
I20260709 12:18:50.629210 24206 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:50.736393 20220 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.359s (SENT)
I20260709 12:18:50.736929 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.619021 24167 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.653888 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.738682 20171 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:50.579916 20179 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:50.668506 23918 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:50.672304 24232 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:50.676326 20328 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:50.656239 24208 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:50.614792 24231 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.684162 24104 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:50.700716 24241 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.701457 24239 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.702355 23713 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.677893 24168 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:50.626056 24091 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.724021 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:50.724946 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:50.758097 20177 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:50.753998 24168 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:50.735597 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 106106us
W20260709 12:18:50.760619 20144 connection.cc:256] RPC call timeout handler was delayed by -2.5402574899999308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:18:50.741541 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87725.6us
W20260709 12:18:50.761044 20144 connection.cc:256] RPC call timeout handler was delayed by -2.484457490000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:18:50.761415 20144 connection.cc:256] RPC call timeout handler was delayed by -2.4826574900000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 12:18:50.761646 20144 connection.cc:256] RPC call timeout handler was delayed by -2.3737574900001164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:18:50.761880 20144 connection.cc:256] RPC call timeout handler was delayed by -2.3683574900001076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:18:50.762120 20144 connection.cc:256] RPC call timeout handler was delayed by -2.3629574900000989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:18:50.762038 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:50.762555 20144 connection.cc:256] RPC call timeout handler was delayed by -2.3458574900000713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 12:18:50.762887 20144 connection.cc:256] RPC call timeout handler was delayed by -2.3251574900000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:18:50.741165 23918 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.749358 20172 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:50.727597 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:50.763988 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2873574899999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 12:18:50.764628 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:50.766410 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2684574899999461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 12:18:50.738057 24218 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:50.766732 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2441574900001342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 12:18:50.770390 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1361574899999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:18:50.770691 20144 connection.cc:256] RPC call timeout handler was delayed by -2.0074574899999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 12:18:50.752820 24175 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:50.770926 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7761574900000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24860000000000004s for a response
I20260709 12:18:50.752260 24057 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.773921 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.734951 24115 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.785849 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:50.786471 20256 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.763556 24168 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.768388 23918 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:50.741735 24206 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.799860 24207 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.752424 24104 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.817222 24104 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.789251 24086 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:50.810832 20177 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:50.775068 24092 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:50.775612 24175 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.825719 20256 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:50.772022 24200 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:50.771745 23913 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:50.828773 24086 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:50.829912 24086 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.834853 24175 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:50.837162 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52664.6us
W20260709 12:18:50.837258 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52268.2us
I20260709 12:18:50.838376 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.784050 24218 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:50.771447 24251 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:18:50.838495 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:50.848721 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:50.851230 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:50.858408 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:50.864220 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:50.843878 24201 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.850561 24241 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:50.882030 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:50.883747 21038 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:50.788856 24208 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:50.854347 24235 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:50.888860 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.528s (SENT)
I20260709 12:18:50.885995 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.848626 24085 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:18:50.891779 24165 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:50.898612 24165 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.900988 24165 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.902608 24200 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:50.903146 24200 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:50.869525 23713 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:50.904270 23713 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.871742 24111 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:50.909888 24110 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:50.911696 24100 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.911875 24218 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.913971 24100 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:50.860412 24152 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:18:50.916281 21041 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:50.920430 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:50.897512 24232 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:51.000057 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 79698us
I20260709 12:18:51.000315 24057 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:51.000887 24057 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.001263 24057 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:51.005910 24234 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:50.932126 24115 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:50.930017 24096 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:51.008307 24096 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:51.016786 20256 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:51.017486 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.022861 24205 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:50.938318 24231 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:50.924685 24165 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:51.029326 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:51.035943 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 196367us
W20260709 12:18:51.037714 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 199286us
I20260709 12:18:50.883598 24201 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:51.039530 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.040083 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.040350 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.041004 20177 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:51.041985 20175 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:51.042347 20175 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:51.047973 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.048679 20321 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:51.014037 24232 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:51.056496 24232 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.057928 23918 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.061518 23918 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.026129 24234 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:51.063956 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.064227 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.064952 21040 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:51.066358 20330 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:51.068670 24175 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.068607 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.069887 20330 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:51.071503 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.072139 20324 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:51.047673 24115 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:51.073657 24115 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:51.075021 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.075917 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.077024 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.077246 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.081007 20321 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:51.074704 24115 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.072185 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.035516 24231 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:51.099846 20330 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:18:51.104450 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 240301us
I20260709 12:18:51.105392 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.106560 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.107555 24152 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:51.108326 24152 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:51.108449 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.109009 24152 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:51.110327 24152 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.112303 20175 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:51.113472 20175 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:51.113489 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.125553 24234 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:51.126123 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.139889 24235 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:51.141270 24234 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:51.142529 24207 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:51.142901 24207 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:51.143736 24207 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.148524 24235 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:51.153266 20330 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:51.154815 24207 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:51.156507 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.158968 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.161455 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.162067 21037 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:51.176724 20144 leader_election.cc:400] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15.
I20260709 12:18:51.177130 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:51.178112 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.009223 24096 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.178736 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:51.175961 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52516.9us
I20260709 12:18:51.179419 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.184196 20178 raft_consensus.cc:2368] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:51.180157 20175 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:51.190610 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.191502 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.192157 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.192425 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.192833 20180 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:18:51.193279 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.181717 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.194430 20179 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:51.195905 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.198073 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.198773 20173 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
W20260709 12:18:51.189811 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 171521us
I20260709 12:18:51.197172 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.198302 20175 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:51.193712 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.200613 20180 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:51.169131 24235 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:18:51.201805 20220 leader_election.cc:336] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.627s (SENT)
I20260709 12:18:51.202673 23713 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:51.203148 23713 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:51.048314 24104 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 12:18:51.204042 23713 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.205082 24236 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:51.206696 24175 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.046450 24165 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.208106 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.209103 24165 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.210772 20174 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:51.212219 24231 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.205577 23713 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.037859 24200 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.218116 24201 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.218552 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.219898 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.221097 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.221457 23880 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.222163 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.222723 20177 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.191272 20176 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:51.226758 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.232555 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.102517 24206 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:51.235821 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.236619 20251 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 4: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:18:51.239549 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.204602 24104 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:51.241416 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.226207 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.242244 20254 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:51.243294 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.243691 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.250057 20324 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:18:51.253230 20254 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:51.254084 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.254829 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.256294 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.257727 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.259399 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.260339 20180 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:18:51.261324 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.264452 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:51.265098 20254 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.264264 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.270763 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.271435 20256 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:51.274739 20177 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:51.276149 20177 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:51.278380 20256 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:51.295092 20253 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:51.296265 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.297134 20254 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:51.300412 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.301644 20172 raft_consensus.cc:2410] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:51.301729 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.300593 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.311125 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.319308 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.284183 24201 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:51.320598 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:51.188776 24234 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:18:51.252228 24104 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:51.310961 24203 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 12:18:51.328395 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.325138 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:51.329344 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.330618 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.332293 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:51.331859 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.334453 20176 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:51.336903 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.339200 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.339354 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.339941 20325 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:51.352685 20249 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:51.294196 24151 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 12:18:51.354931 20220 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.543s (SENT)
W20260709 12:18:51.356556 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.355893 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.358144 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.359302 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.359750 20325 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:51.359915 20326 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.360852 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.361068 20325 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:51.361937 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.363078 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.366314 20330 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:18:51.366492 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.366683 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.366734 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.367123 20176 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:51.367018 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.366736 20330 pending_rounds.cc:85] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 4
I20260709 12:18:51.368479 20330 pending_rounds.cc:107] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:18:51.368759 20330 raft_consensus.cc:2889] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:51.377225 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.294008 24168 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.383379 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.420667 24050 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:51.421344 24050 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:51.422547 24050 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.427760 24050 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.378888 24118 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:51.390425 24104 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.384549 24264 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:51.433852 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51779.8us
I20260709 12:18:51.382496 24086 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:51.444171 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 354426us
I20260709 12:18:51.389160 24239 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:51.485574 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.433320 24104 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:51.536780 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 102198us
I20260709 12:18:51.540047 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.543176 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.544085 20177 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:51.551151 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.552040 20173 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:51.552722 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.737s (SENT)
W20260709 12:18:51.553826 20220 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.579s (SENT)
I20260709 12:18:51.555161 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.555825 20172 raft_consensus.cc:2376] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11. Re-sending same reply.
I20260709 12:18:51.555899 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.560379 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.561221 20177 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:51.562691 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.563186 20171 raft_consensus.cc:2368] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8.
I20260709 12:18:51.439450 24165 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:18:51.564695 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.439795 24057 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:51.558852 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74741.5us
I20260709 12:18:51.571727 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.574009 20171 raft_consensus.cc:2376] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11. Re-sending same reply.
I20260709 12:18:51.577036 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.577246 20330 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:51.579087 20326 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:51.579488 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.581640 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.587114 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.591079 20251 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:51.596920 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:51.597756 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.600176 20171 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:51.602249 20172 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:51.603024 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.603523 20172 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:18:51.608042 20177 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:51.613356 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.585978 24076 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:51.616134 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.590564 24239 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:51.605912 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:51.619119 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.616830 20177 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:51.622061 20254 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:51.632694 21037 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:51.599836 24234 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.634816 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.636585 20172 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:51.635222 20253 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:51.668164 24277 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:18:51.623327 24200 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:18:51.761168 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.619s (SENT)
I20260709 12:18:51.615720 24271 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:18:51.615576 24233 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:51.762467 20220 leader_election.cc:336] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.749s (SENT)
W20260709 12:18:51.779148 20220 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.637s (SENT)
I20260709 12:18:51.763375 20172 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:18:51.781514 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.782773 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.783356 20176 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:18:51.783723 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.787020 20294 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.788348 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:51.793442 24207 consensus_meta.cc:287] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.011s
I20260709 12:18:51.794103 20178 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:18:51.795508 21008 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.411s (SENT)
I20260709 12:18:51.758399 24140 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:51.795573 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.816s (SENT)
W20260709 12:18:51.779326 23713 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.002s
I20260709 12:18:51.796423 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.800025 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.809281 20172 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.799511 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:51.803957 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.806668 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:51.629036 24076 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.808521 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.812073 20176 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:18:51.819118 24268 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:18:51.820351 24232 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:51.820824 24232 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.821297 24232 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.823693 23885 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:51.824761 24203 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:51.828150 24276 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:18:51.776260 24236 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:18:51.830302 24168 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.753043 24218 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:18:51.799669 24206 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.831940 24206 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.834189 24206 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:51.808008 24057 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:51.835243 24256 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:51.836279 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.659365 24234 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.837818 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.838972 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:51.839135 24234 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:51.839941 24144 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:51.840656 24144 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:51.842033 20174 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:51.843382 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:51.847998 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:51.849241 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.806576 24140 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.856773 24208 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:51.857579 24076 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.863852 24140 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:51.801501 24111 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:51.866236 24111 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:51.866925 24096 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.867554 24111 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.869187 24111 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.874759 24231 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.853835 24273 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:51.876257 24273 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.876602 24273 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:51.877471 24266 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.490s	user 0.001s	sys 0.000s
I20260709 12:18:51.852474 24233 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:51.863222 24270 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.312s	user 0.000s	sys 0.002s
I20260709 12:18:51.881121 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.882442 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.883102 20178 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:51.888049 20175 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:51.879428 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:51.889900 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.890899 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.893955 24115 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.894497 24115 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:51.896592 23880 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
I20260709 12:18:51.898429 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.899315 20177 raft_consensus.cc:2410] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:51.900189 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.901549 20177 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:51.902935 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.296074 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.932304 20178 raft_consensus.cc:2368] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15.
I20260709 12:18:51.933463 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.934281 20178 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:51.934938 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:51.935715 21038 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.935901 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:51.940353 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:51.941300 20178 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:51.928534 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 79413.8us
I20260709 12:18:51.957733 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.929924 20176 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:51.934938 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:51.958760 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:51.914881 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.963352 20180 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:51.973752 20173 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:51.974148 20173 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:51.974874 20173 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.981106 24274 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:51.981583 24274 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:51.982373 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.982643 24274 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:51.950197 20328 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:51.993165 24274 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:51.994338 24283 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 12:18:51.976884 24279 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.122s	user 0.002s	sys 0.001s
I20260709 12:18:51.977918 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:51.995941 20324 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:51.980638 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 185105us
I20260709 12:18:52.004292 23913 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.004752 23913 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:51.980836 24086 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:52.006953 23913 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:18:52.007908 20251 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:52.008294 20251 pending_rounds.cc:85] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 4
I20260709 12:18:52.008522 20251 pending_rounds.cc:107] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:52.008759 20251 raft_consensus.cc:2889] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:51.981660 20173 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:52.010921 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.985913 20250 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:18:52.011845 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.012611 20248 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:52.017926 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.018522 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.018735 20251 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:51.986984 24050 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.024089 24261 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.024693 24261 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:51.987682 24168 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:51.987746 23626 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:52.026149 24168 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.026296 23626 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.028419 24168 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.028717 23626 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:51.988677 20253 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:51.990583 24219 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:52.030153 24261 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:52.030401 24219 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.030854 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:51.924296 23880 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.044797 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:51.923789 24115 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:51.987331 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.012369 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.035341 20324 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
W20260709 12:18:52.039712 21035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.004s	sys 0.011s
I20260709 12:18:51.953876 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:52.064541 21035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.004s	sys 0.011s
I20260709 12:18:51.945535 21038 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:52.067221 20178 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:52.043644 20172 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:52.045679 20251 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
W20260709 12:18:52.039366 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 92505.8us
I20260709 12:18:52.060307 20173 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:52.067791 21039 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:52.073236 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:52.074771 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:52.075806 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:52.085369 24085 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:52.088425 23913 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:52.088886 24218 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:52.091156 24218 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:52.078758 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:52.072562 20173 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:18:52.103722 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.145s (SENT) [suppressed 45 similar messages]
I20260709 12:18:52.106048 24219 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.107832 20077 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 9, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 9 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
W20260709 12:18:52.079954 24262 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:18:52.111198 24257 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:52.111752 20179 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:18:52.112349 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:52.112993 21034 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.114109 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:52.114936 20175 raft_consensus.cc:2410] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:52.118816 20178 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:52.113729 20077 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 10, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:52.120643 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50028.3us
I20260709 12:18:52.122272 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:52.125118 21042 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:52.125959 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:52.126631 20175 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:52.125169 24176 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:52.124353 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1025) took 1050 ms. Trace:
I20260709 12:18:52.134821 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.137931 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.024699 24050 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.146160 20253 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:52.130741 21035 rpcz_store.cc:276] 0709 12:18:51.074326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.078169 (+  3843us) service_pool.cc:224] Handling call
0709 12:18:51.078458 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.078679 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:51.335156 (+256477us) log.cc:844] Serialized 14 byte log entry
0709 12:18:52.123911 (+788755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.123988 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:52.124035 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.124127 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.124261 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59861,"prepare.queue_time_us":530206,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":63418,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":984771,"threads_started":2}
I20260709 12:18:52.150400 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:52.150967 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.151964 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.153949 20324 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.155921 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.155999 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.158540 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.158687 20325 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:52.158972 20326 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:52.164273 20325 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:52.120154 24206 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.078132 24168 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:18:52.069273 23880 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.189769 20172 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:18:52.190269 20172 pending_rounds.cc:85] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 9
I20260709 12:18:52.190557 20172 pending_rounds.cc:107] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:18:52.190869 20172 raft_consensus.cc:2889] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:52.178043 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.178543 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50774.9us
I20260709 12:18:52.111984 24104 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:52.184774 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46950.3us
I20260709 12:18:52.125284 24257 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:52.188068 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:52.197909 20323 raft_consensus.cc:2368] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:52.193078 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.140929 24271 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:52.131642 24085 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:52.193928 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:52.140528 24165 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.178207 20067 maintenance_manager.cc:419] P b336d660a2b34362b3d4d9e44ca2179d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033337
I20260709 12:18:52.141757 24086 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:52.194013 20322 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:52.200544 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 117460us
I20260709 12:18:52.201678 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:52.204355 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.205451 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:52.188838 24140 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.207425 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:52.331447 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 124113us
I20260709 12:18:52.202744 24085 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.181879 23713 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.205287 24104 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:52.187661 23626 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:52.311118 20330 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:52.185395 24239 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:52.185717 24232 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.187661 24206 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.204396 24118 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 12:18:52.329243 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:52.337353 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.339831 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.202813 24200 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:18:52.302359 24057 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:52.387133 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 185564us
I20260709 12:18:52.202713 24236 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.112s
W20260709 12:18:52.391674 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 62530.9us
I20260709 12:18:52.294639 24165 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:52.392930 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.359241 23913 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:52.402276 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:52.410854 20324 raft_consensus.cc:2368] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:52.386670 24096 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.387715 24085 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:52.387871 24239 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.401492 24175 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:52.404413 24273 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.527s	user 0.004s	sys 0.010s
I20260709 12:18:52.403124 24168 raft_consensus.cc:2764] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:18:52.445778 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.413499 24057 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:52.391192 23713 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.422897 24239 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:52.435256 23913 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:52.437059 24302 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:52.462350 24302 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:52.460623 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.462518 24057 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.465780 24302 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:52.468106 24301 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:18:52.468623 24292 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:18:52.471794 24300 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:18:52.474731 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 72582.4us
I20260709 12:18:52.474891 20328 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:52.399631 24257 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.483948 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.484987 24168 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:52.485373 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.485566 24168 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.486606 20327 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:52.487885 24168 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:52.487967 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.422544 24096 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.483287 24050 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:52.462965 24111 consensus_meta.cc:287] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.593s	user 0.014s	sys 0.009s
I20260709 12:18:52.504170 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:52.465808 24298 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:18:52.517043 23713 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.514776 21034 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:18:52.520934 23626 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:52.521181 23913 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.523844 20324 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:52.443662 24273 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.522588 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.521610 23626 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.529846 20322 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:52.522121 23880 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:52.547750 20321 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:52.464666 24104 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.518549 24086 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:18:52.553486 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 149294us
W20260709 12:18:52.566519 20076 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 205) took 17757 ms (client timeout 15000 ms). Trace:
I20260709 12:18:52.567106 24165 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:52.568576 20077 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.546380 24175 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:52.575824 20077 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.570763 24208 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:52.554140 24168 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:52.580946 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d963e0e1da434f887fc330570683e5"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:52.582882 20321 raft_consensus.cc:606] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:52.580068 20077 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 7 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:52.584972 20077 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 8, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:52.586378 20077 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 8, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:52.583240 20321 raft_consensus.cc:614] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:52.588011 20077 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 5, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 5 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:52.589805 20077 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 9, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.591028 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:52.591737 20321 raft_consensus.cc:606] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:52.592154 20321 raft_consensus.cc:614] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:52.591549 20077 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:52.595539 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:52.596642 20321 raft_consensus.cc:606] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:52.598060 20077 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.573305 24302 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:52.605861 21034 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:18:52.601706 24175 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.606078 20077 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 2, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.614856 20077 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 8, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.616503 20077 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 5, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:52.578090 24096 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:52.572644 20076 rpcz_store.cc:269] 0709 12:18:34.809580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.809867 (+   287us) service_pool.cc:224] Handling call
0709 12:18:52.566358 (+17756491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:48.155576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:48.156517 (+   941us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:48.156592 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:18:48.156621 (+    29us) tablet.cc:662] Decoding operations
0709 12:18:48.285377 (+128756us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:48.301800 (+ 16423us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:48.303773 (+  1973us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:18:48.426462 (+122689us) tablet.cc:701] Row locks acquired
0709 12:18:48.426525 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:18:48.426711 (+   186us) write_op.cc:270] Start()
0709 12:18:48.426889 (+   178us) write_op.cc:276] Timestamp: P: 1783599528426642 usec, L: 0
0709 12:18:48.426926 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:18:48.480336 (+ 53410us) log.cc:844] Serialized 6278 byte log entry
0709 12:18:48.799111 (+318775us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef3e28 00007f5dde92e581 00007f5dde92dd58 00007f5dde9329f1 00007f5dde9329a9 00007f5dde932939 00007f5dde932901 00007f5dde931b2d 0000000000388634 0000000000388479
0709 12:18:48.930712 (+131601us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.021784 (+1091072us) write_op.cc:301] APPLY: starting
0709 12:18:50.029093 (+  7309us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.099352 (+ 70259us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.105120 (+  5768us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.313796 (+208676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.314172 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:18:50.314240 (+    68us) write_op.cc:312] APPLY: finished
0709 12:18:50.314720 (+   480us) log.cc:844] Serialized 113 byte log entry
0709 12:18:50.519994 (+205274us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.540393 (+ 20399us) write_op.cc:454] Released schema lock
0709 12:18:50.556713 (+ 16320us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:50.662422 (+105709us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.662457 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":274240,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":1058231,"apply.run_cpu_time_us":32145,"apply.run_wall_time_us":648036,"num_ops":16,"prepare.queue_time_us":444946,"prepare.run_cpu_time_us":22436,"prepare.run_wall_time_us":643894,"raft.queue_time_us":140669,"raft.run_cpu_time_us":53082,"raft.run_wall_time_us":979719,"replication_time_us":481253,"spinlock_wait_cycles":29404416,"thread_start_us":1093365,"threads_started":5,"wal-append.queue_time_us":281564,"wal-append.run_cpu_time_us":15888,"wal-append.run_wall_time_us":2483426}]]}
I20260709 12:18:52.642189 21034 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:52.582171 24232 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.579353 24208 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.613715 24302 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:52.651260 24274 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.645s	user 0.013s	sys 0.000s
I20260709 12:18:52.666584 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:52.668115 24273 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.669163 24273 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:52.669409 24271 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:52.674171 24236 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.600014 24168 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.674748 24236 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.676841 24236 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:52.677203 24168 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.678972 24208 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:52.680980 24140 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:52.682289 24206 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:52.685920 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:52.690724 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.692387 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:52.618192 20077 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:52.690807 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:52.697883 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.700079 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.701211 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:52.700119 20077 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.698808 20253 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:18:52.706728 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.707998 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:52.708706 21034 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:52.671387 23626 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.708776 20077 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 7 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:52.710624 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:52.712692 20325 raft_consensus.cc:606] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.714335 20077 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.716302 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:52.716068 20077 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 2 to 5, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 5 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.717058 20325 raft_consensus.cc:606] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.717967 20077 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.719930 20077 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.721385 20077 catalog_manager.cc:5697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.724100 24302 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.725533 24302 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.727725 23918 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:52.730399 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:52.730993 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:52.731782 21040 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:52.731034 21034 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.732986 21038 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:52.735082 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:52.735785 23918 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:52.736819 23918 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.722764 20077 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 13, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 13 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.740201 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.740125 20077 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 6, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 6 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } }
I20260709 12:18:52.742825 24317 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:52.745059 21034 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:52.746322 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:52.736912 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 404689us
I20260709 12:18:52.741825 20077 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 9, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:52.747315 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:52.747853 20077 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:52.753319 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:52.754297 24050 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:52.754791 24050 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:52.755175 24050 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:52.750185 23913 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:52.712118 24205 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:52.758090 24057 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:52.758571 24057 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:52.758937 24057 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.703902 23885 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:52.770068 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.777704 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:52.749368 20077 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.789285 24262 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:52.789839 24291 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:52.790066 24262 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:52.797861 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:52.798538 20173 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:52.799533 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:52.799661 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:52.800213 20172 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.804080 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:52.805725 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:52.806483 20177 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
W20260709 12:18:52.789354 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 367901us
I20260709 12:18:52.810253 20174 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:52.810782 20174 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:52.811777 24234 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.812409 24234 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.812923 24262 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:52.813704 24262 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:52.814323 24262 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.815022 24234 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.818840 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:52.820986 20174 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:52.822715 20174 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.824676 24235 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:52.826483 24235 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:52.827013 24235 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:52.828055 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 55316.7us
I20260709 12:18:52.778966 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.847231 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:52.848098 20322 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:52.849948 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.850152 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:52.850615 20253 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:52.784464 20077 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 8, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.854648 20172 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:52.829113 24262 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:52.855144 20077 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 10, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.774384 23913 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:52.884872 20077 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:52.886431 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 108877us
I20260709 12:18:52.895324 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:52.887775 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56791.1us
W20260709 12:18:52.893232 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.897456 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 78712.6us
I20260709 12:18:52.904265 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:52.904587 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:52.903750 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:52.997910 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.893040 24233 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:53.006704 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:18:53.007200 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.009701 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:53.016124 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 111657us
I20260709 12:18:52.784165 23885 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:53.021891 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 123071us
W20260709 12:18:52.976881 24281 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:52.978169 24285 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:53.023142 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:53.041049 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.044718 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:53.023891 23713 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.050710 24218 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:53.077127 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54093.7us
W20260709 12:18:53.046947 24300 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:18:53.080003 24208 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:53.080587 24324 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:18:53.022691 24291 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:53.082551 24271 raft_consensus.cc:993] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:53.080586 24208 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.084800 24208 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.079355 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:53.088747 24206 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:53.089172 24206 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.089566 24206 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.091807 24334 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:53.092687 24334 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:53.093196 24334 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:53.094270 24334 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.096047 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:52.910269 24234 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:18:53.023130 24233 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:53.111554 20180 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:53.073345 23713 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.141373 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:53.128130 24218 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:53.128983 24233 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.111368 24271 raft_consensus.cc:1081] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
W20260709 12:18:53.179849 24323 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:18:53.130630 24273 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.180550 24273 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.129364 24104 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.183920 24104 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.186161 20180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:18:53.186806 20180 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.186908 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:53.187194 20180 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:53.029508 24219 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 12:18:53.201326 24219 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:53.206332 23713 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:53.207556 24111 raft_consensus.cc:993] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:53.208159 24111 raft_consensus.cc:1081] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:18:53.214826 24050 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.057382 24235 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.162621 24262 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:53.215358 20180 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.170917 24241 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:18:53.225522 24218 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:53.294474 20180 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:53.302955 20251 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:53.258225 24291 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:53.288147 24262 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:18:53.346027 24332 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:18:53.350059 24057 consensus_meta.cc:287] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.004s
I20260709 12:18:53.350592 24057 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:53.333948 24239 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.869s	user 0.012s	sys 0.001s
I20260709 12:18:53.352293 24239 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.354820 24239 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:53.356042 24085 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.919s	user 0.013s	sys 0.000s
W20260709 12:18:53.356395 24325 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:18:53.356544 24085 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.358944 24085 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:53.360375 24050 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:53.371754 20253 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:53.495059 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:53.495836 20176 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:18:53.375896 20174 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.003s
I20260709 12:18:53.425007 24057 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:53.432448 24302 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.004s
I20260709 12:18:53.375277 23885 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:53.447412 24351 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:53.502010 24274 raft_consensus.cc:993] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:53.501793 24351 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:53.418874 24333 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:18:53.381601 24218 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.504514 20252 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:18:53.448506 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.484020 21034 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:18:53.387809 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 343200us
I20260709 12:18:53.498008 20174 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:18:53.374177 23918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.007s	sys 0.010s
I20260709 12:18:53.507206 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:53.374256 21007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.009s
W20260709 12:18:53.511950 21007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.010s
W20260709 12:18:53.512354 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 750415us
W20260709 12:18:53.417466 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 276155us
I20260709 12:18:53.498347 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:53.514957 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:53.516376 20321 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:53.515631 20177 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.488193 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:53.517697 21043 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.488946 21035 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:53.513784 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:53.522503 24351 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:53.522581 24175 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:53.523228 24175 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.393600 24273 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:53.523726 24175 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:53.510408 23918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.008s	sys 0.010s
I20260709 12:18:53.526490 20325 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:53.518091 23713 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 12:18:53.488605 24328 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.224s	user 0.000s	sys 0.004s
I20260709 12:18:53.490098 24349 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.467870 24219 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:53.542459 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:53.543866 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.544351 20253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:18:53.481892 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:53.544911 20253 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.545328 20253 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:53.463649 24203 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:53.549000 24203 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.551195 24203 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:53.551865 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:53.552459 20255 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.399406 24291 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.555935 20322 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:53.528453 24274 raft_consensus.cc:1081] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:18:53.523238 24351 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.527725 24104 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:53.572727 20220 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.551s (SENT)
I20260709 12:18:53.573325 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:53.585930 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.592621 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:53.593672 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 112830us
I20260709 12:18:53.391146 24262 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.459112 24206 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.568603 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:53.607797 20250 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.617595 20255 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:53.561625 20253 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.565006 20176 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:53.621812 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:53.622489 20171 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:53.625833 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:53.625622 20325 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:53.627616 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:53.560248 24216 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.636849 20253 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:53.637918 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:53.626394 20177 raft_consensus.cc:2410] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:53.641248 20250 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:53.606902 23918 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.646780 21043 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:53.568284 24235 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:53.625166 24336 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.655351 24342 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:53.556401 24349 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.659670 24357 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:53.660288 24235 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.665190 23880 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:53.667353 21037 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:53.667500 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:53.676878 24317 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:53.633718 24261 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:53.688896 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.685s (SENT)
I20260709 12:18:53.708334 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:53.647019 24257 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:53.560675 24219 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.633306 24057 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:53.644788 24216 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.632540 24104 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:53.694682 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:53.644177 24351 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:53.708033 21039 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:53.714586 23880 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.630596 24234 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:18:53.690336 23713 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.686991 24232 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:53.712631 24257 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:53.734489 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 227347us
I20260709 12:18:53.740499 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:53.742161 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:53.699332 24118 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:18:53.721472 23626 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:53.739784 21035 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:53.718235 24057 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:53.734386 24208 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.004s
I20260709 12:18:53.752794 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:53.716657 24261 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.744125 24257 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.764096 24364 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:53.730257 24204 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:53.706132 24342 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.718101 24345 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:18:53.718250 24331 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:18:53.783233 20255 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:53.754053 24057 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.753768 23913 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:53.737798 24232 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.791676 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:53.732585 24351 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.735181 23713 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.789353 24361 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:53.797780 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 110261us
I20260709 12:18:53.811779 20295 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:53.815969 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:53.814991 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 168658us
I20260709 12:18:53.768934 24208 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:53.836508 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:53.888810 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.810276 24317 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:53.872754 24337 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.563s	user 0.003s	sys 0.000s
I20260709 12:18:53.870059 24218 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:53.826537 24274 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:53.909879 24218 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:53.910537 24218 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.910686 24216 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:53.877125 24144 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:18:53.910703 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1038) took 1175 ms. Trace:
I20260709 12:18:53.912283 21038 rpcz_store.cc:276] 0709 12:18:52.735161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.741574 (+  6413us) service_pool.cc:224] Handling call
0709 12:18:52.742028 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:52.851594 (+109566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.851629 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:52.852178 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.128287 (+276109us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:18:53.128333 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.128407 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.770098 (+641691us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:53.910416 (+140318us) raft_consensus.cc:1685] finished
0709 12:18:53.910437 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.910643 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109086,"raft.queue_time_us":110831,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":7375616,"thread_start_us":275654,"threads_started":1,"wal-append.queue_time_us":373714}
W20260709 12:18:53.894495 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58131.5us
W20260709 12:18:53.906997 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 197392us
I20260709 12:18:53.896102 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:53.914409 20324 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:53.914837 20324 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:53.915763 20324 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:53.901057 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.881s (SENT)
I20260709 12:18:53.907680 24206 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:53.825361 24351 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:53.914355 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:53.808235 23913 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.788727 24364 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.118s
W20260709 12:18:53.918978 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125705us
I20260709 12:18:53.947623 23880 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:53.957010 20220 leader_election.cc:336] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.955s (SENT)
I20260709 12:18:53.966199 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:53.988966 20220 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.988s (SENT)
I20260709 12:18:53.992607 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:53.988477 24363 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:18:53.948989 24274 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:53.992750 24233 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.000s
W20260709 12:18:54.020388 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.987671 24353 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:53.995412 24368 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:54.062853 21008 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.154s (SENT)
I20260709 12:18:54.074887 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:54.084290 24375 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:54.085084 24375 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:53.997303 24167 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:18:54.007990 24377 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.059551 24219 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:54.090456 24358 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 12:18:54.089561 24384 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.061909 24233 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:54.206233 24365 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:18:54.097748 24368 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:54.195891 23713 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:54.538609 21043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:18:54.614777 24206 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.104907 24351 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.225828 24369 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:54.616410 24369 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:54.616659 24351 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.513702 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:54.508391 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.020s	sys 0.043s
I20260709 12:18:54.619041 24377 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:54.619405 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.037s	sys 0.070s
I20260709 12:18:54.619380 24111 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:54.620240 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 704496us
I20260709 12:18:54.620229 24377 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:54.620581 24111 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:54.615217 21043 raft_consensus.cc:606] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:54.621793 21043 raft_consensus.cc:614] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:54.623607 20322 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:54.623776 24345 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:54.214776 24342 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:54.624778 24345 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.058020 24118 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 12:18:54.452754 20146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.011s	sys 0.026s
I20260709 12:18:54.605997 24096 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:54.401017 24380 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:18:54.139771 24349 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:54.207028 24372 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:18:54.462517 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.008s	sys 0.016s
W20260709 12:18:54.184567 24332 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:18:54.512850 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:54.660420 20146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.025s	sys 0.064s
W20260709 12:18:54.535156 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 458710us
W20260709 12:18:54.537773 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 474791us
I20260709 12:18:54.670369 24351 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:54.671131 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.013s	sys 0.023s
W20260709 12:18:54.671603 24291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.010s	sys 0.073s
W20260709 12:18:54.671725 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 905923us
I20260709 12:18:54.674101 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:54.674069 23713 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:18:54.155304 24333 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:18:54.205565 24359 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:18:54.081279 24353 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:54.618119 24369 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.614607 24368 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.695422 20323 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:54.691332 24351 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.699051 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:54.699229 24351 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.699928 20171 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:54.700268 24349 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:54.701174 24349 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:54.702878 24361 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.703163 20177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:18:54.700133 20174 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:54.704033 24096 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:54.702358 24351 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:54.661929 24232 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:54.704054 20177 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.702273 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:54.326033 24370 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:54.691164 20220 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.009s	sys 0.000s
I20260709 12:18:54.711799 20177 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.716676 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:54.716346 24206 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.719460 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:54.719982 24351 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:54.723207 24351 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:54.727672 24264 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:54.728318 24264 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:54.730297 24264 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:54.731158 24349 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:54.663615 24345 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:54.739538 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:54.149866 24261 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:54.742424 24096 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:54.751462 20220 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.010s	sys 0.001s
I20260709 12:18:54.755517 20174 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:54.762748 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2555) took 1268 ms. Trace:
I20260709 12:18:54.763337 20180 rpcz_store.cc:276] 0709 12:18:53.494333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.495270 (+   937us) service_pool.cc:224] Handling call
0709 12:18:53.496194 (+   924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:53.507347 (+ 11153us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:53.744942 (+237595us) log.cc:844] Serialized 14 byte log entry
0709 12:18:53.990837 (+245895us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:53.991480 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.991717 (+   237us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:53.991865 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.991997 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:54.762147 (+770150us) raft_consensus.cc:1685] finished
0709 12:18:54.762204 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:54.762476 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172603,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":84849,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":17283,"thread_start_us":330535,"threads_started":2,"wal-append.queue_time_us":181314}
I20260709 12:18:54.766209 24353 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:54.767215 23885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.015s	sys 0.012s
W20260709 12:18:54.767894 23885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.015s	sys 0.012s
W20260709 12:18:54.769256 20145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.004s	sys 0.008s
W20260709 12:18:54.769637 20145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.004s	sys 0.008s
I20260709 12:18:54.770959 24377 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:54.780732 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52234.1us
I20260709 12:18:54.756438 24206 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:54.786514 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 696488us
W20260709 12:18:54.815378 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.009s	sys 0.026s
W20260709 12:18:54.816094 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.010s	sys 0.026s
W20260709 12:18:54.816870 20143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.008s	sys 0.023s
W20260709 12:18:54.817440 20143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.008s	sys 0.023s
I20260709 12:18:54.819707 24370 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.822772 24370 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:54.184978 24274 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.850992 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:54.851830 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.852903 23913 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:54.843763 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.861783 24264 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.862231 24369 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:54.869168 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:54.849155 20177 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:54.882668 24377 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:54.883482 24345 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.885524 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2554) took 1391 ms. Trace:
I20260709 12:18:54.886812 24104 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.888917 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:54.891137 24208 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:54.892765 24233 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:18:54.914676 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.932720 20177 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:54.911303 20175 rpcz_store.cc:276] 0709 12:18:53.493976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.494846 (+   870us) service_pool.cc:224] Handling call
0709 12:18:53.495191 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:53.495652 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:53.495688 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:53.496215 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:18:53.731459 (+235244us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:53.731509 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.731604 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:54.884870 (+1153266us) raft_consensus.cc:1685] finished
0709 12:18:54.884926 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:54.885259 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1198,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":3351,"thread_start_us":234931,"threads_started":1,"wal-append.queue_time_us":397478}
W20260709 12:18:54.940677 24057 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.130s	user 0.006s	sys 0.015s
I20260709 12:18:54.943812 24104 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.971832 20174 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:54.974898 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.967697 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.975915 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.959668 24377 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.982758 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:54.983682 20180 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.984491 24377 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:54.985257 24349 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.968508 24216 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:54.986778 24216 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:54.988664 24367 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:54.989310 24175 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.465s	user 0.019s	sys 0.004s
I20260709 12:18:54.989743 24216 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:54.989523 24367 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:54.989892 24175 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:54.990940 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 122074us
I20260709 12:18:54.977375 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:54.995260 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:54.960180 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.674s (SENT)
W20260709 12:18:54.954504 24257 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.167s	user 0.009s	sys 0.008s
I20260709 12:18:54.956274 24262 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.003883 20144 leader_election.cc:400] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:55.007876 24334 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.951428 20324 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:54.998121 24218 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.085s	user 0.005s	sys 0.017s
I20260709 12:18:55.018224 24205 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.018785 24317 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:55.017953 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46019.8us
I20260709 12:18:54.964573 24345 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.018945 24205 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.027091 24085 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:55.027987 24085 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:55.029197 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100352us
W20260709 12:18:55.030251 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.677s (SENT)
I20260709 12:18:55.030810 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:55.033012 24085 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.019407 24317 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.037678 20176 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:55.037683 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.038635 24345 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.039053 24104 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.039717 24334 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:55.042235 24364 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.981738 24057 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.016680 24216 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.048354 24175 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:55.053875 24235 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.056722 24356 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.294s	user 0.001s	sys 0.020s
I20260709 12:18:55.058004 24111 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.079937 24111 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.080720 24111 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.081694 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 870) took 1317 ms. Trace:
I20260709 12:18:55.058507 24233 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.082525 24233 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.083721 24334 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.085238 24291 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:55.085019 24216 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.085726 24291 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:55.085520 24364 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.086225 24334 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.086932 24291 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.087766 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.089591 20174 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:55.015715 24257 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:55.060178 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.791s (SENT)
I20260709 12:18:55.060050 24349 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:55.083269 24111 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:55.056777 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.096824 24291 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.098668 20253 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:55.099629 24264 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:55.099848 24175 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.100319 24264 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:55.100922 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.101577 24264 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.104542 24375 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.105194 24388 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:55.105731 24388 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:55.106197 24388 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.068683 24317 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.075253 24085 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:55.075531 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.076817 24205 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.079025 24355 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.087416 24216 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.096905 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:55.100616 24175 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.068392 20144 leader_election.cc:400] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:55.111809 20324 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:55.070291 24385 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:55.064718 20180 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:55.024991 24218 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.121963 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:55.125488 24057 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.125713 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 90640us
I20260709 12:18:55.126633 24364 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.127130 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.085050 24233 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.139405 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65460.4us
W20260709 12:18:55.139194 20172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2553) took 1955 ms (client timeout 1992 ms). Trace:
I20260709 12:18:55.117609 24367 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:55.141314 24257 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.157572 20172 rpcz_store.cc:269] 0709 12:18:53.184080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.186649 (+  2569us) service_pool.cc:224] Handling call
0709 12:18:55.138766 (+1952117us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54002404d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:55.138944 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3415997824}
I20260709 12:18:55.167178 20321 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:55.161114 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 2946) took 1246 ms. Trace:
I20260709 12:18:55.171108 23880 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:55.171890 23880 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.174520 23880 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.177089 20255 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:55.178447 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 876) took 1228 ms. Trace:
I20260709 12:18:55.178853 20255 rpcz_store.cc:276] 0709 12:18:53.950535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.950816 (+   281us) service_pool.cc:224] Handling call
0709 12:18:55.178164 (+1227348us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540004c754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:55.178359 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628018560}
I20260709 12:18:55.179605 20326 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:55.179741 24384 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:55.181414 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.170387 20324 rpcz_store.cc:276] 0709 12:18:53.895717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.895866 (+   149us) service_pool.cc:224] Handling call
0709 12:18:54.950717 (+1054851us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b58006af7d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae540aa 00007f5ddaed6447 00007f5ddaeeefe7 00007f5ddaef07de 00007f5ddaefc27c 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c
0709 12:18:55.141929 (+191212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195863424}
I20260709 12:18:55.161823 20247 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.189177 21043 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:55.169902 24355 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:55.193279 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 133148us
W20260709 12:18:55.194281 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.145s (SENT)
I20260709 12:18:55.196077 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 865) took 1431 ms. Trace:
I20260709 12:18:55.196550 20252 rpcz_store.cc:276] 0709 12:18:53.749429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.749734 (+   305us) service_pool.cc:224] Handling call
0709 12:18:53.750045 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:55.105712 (+1355667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:55.105769 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:55.105830 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:55.105924 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.162966 (+ 57042us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001018d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:55.163039 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:55.180875 (+ 17836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116570496}
I20260709 12:18:55.162093 24216 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:55.212898 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44185us
I20260709 12:18:55.218010 24205 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:55.218199 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.218472 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.218757 24205 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.192320 24364 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:55.220224 24376 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.221098 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:55.221858 20251 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.222522 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.223889 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2935) took 1718 ms. Trace:
I20260709 12:18:55.224293 20323 rpcz_store.cc:276] 0709 12:18:53.505188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.505334 (+   146us) service_pool.cc:224] Handling call
0709 12:18:53.505695 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:54.696139 (+1190444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.204512 (+508373us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400087ad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:55.223807 (+ 19295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579049216}
I20260709 12:18:55.226339 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.082108 20250 rpcz_store.cc:276] 0709 12:18:53.764037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.764252 (+   215us) service_pool.cc:224] Handling call
0709 12:18:53.764575 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.764824 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:54.062529 (+297705us) log.cc:844] Serialized 14 byte log entry
0709 12:18:54.062989 (+   460us) log.cc:844] Serialized 14 byte log entry
0709 12:18:55.038939 (+975950us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18002a0160. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:55.080709 (+ 41770us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b18002a0160. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5ddaaaed70 00007f5ddaaa2293 00007f5ddaa97cea 00007f5ddaa9823a 00007f5ddaf02a2a 00007f5ddaf120bf 00007f5ddaf12038
0709 12:18:55.081048 (+   339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:55.081148 (+   100us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:55.081219 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.081291 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:55.081434 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10835,"prepare.queue_time_us":231623,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":111,"raft.queue_time_us":12253,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"spinlock_wait_cycles":15706112,"thread_start_us":226651,"threads_started":1}
I20260709 12:18:55.235106 24218 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.220827 24376 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.195403 24355 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:55.243839 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.244772 20250 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:55.243927 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.221784 24205 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.276018 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.276855 21035 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:55.278434 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.220501 24364 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:55.279722 24364 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:55.280947 24364 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.284859 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 867) took 1533 ms. Trace:
I20260709 12:18:55.285261 20253 rpcz_store.cc:276] 0709 12:18:53.751726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.752124 (+   398us) service_pool.cc:224] Handling call
0709 12:18:53.752385 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:55.099159 (+1346774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.284521 (+185362us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000d9654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:55.284782 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3092876160}
I20260709 12:18:55.286530 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:55.287549 24057 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:55.289381 24057 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:55.289647 24206 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:55.289829 24057 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:55.291502 24257 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:55.294096 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.294329 24336 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:55.295476 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:55.296917 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.298193 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.300262 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:55.302383 20294 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:55.303815 24218 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:55.304546 24218 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:55.308034 24376 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.310565 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.312047 24175 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.299520 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.315147 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:55.315855 24412 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:18:55.318733 24334 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:55.319134 24334 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:55.320256 24334 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.321712 24334 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.321779 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.322084 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.322811 21036 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:55.323194 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.324085 21042 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:55.324120 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.305177 24369 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:55.324916 21041 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:55.329722 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.333557 20251 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:55.302966 24388 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.290251 24206 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:55.349488 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.357302 20247 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:55.362643 20251 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:18:55.363175 20251 pending_rounds.cc:85] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 6
I20260709 12:18:55.371457 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:55.372745 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:55.363440 20251 pending_rounds.cc:107] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:18:55.375654 20251 raft_consensus.cc:2889] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:55.379814 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.331768 24317 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.361600 24336 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:55.356952 24369 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:55.400194 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.400527 24369 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.360152 24353 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:55.388957 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.394393 24395 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.398181 24057 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.400995 20329 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:18:55.381984 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.384423 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.384186 24175 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:55.424362 20250 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:55.444375 20248 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:55.452019 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:55.453101 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.454136 24388 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.456125 24175 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:55.457448 24175 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:55.457957 24175 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:55.460605 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:55.461283 20174 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.461742 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.462539 20178 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:55.463433 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.464754 20172 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:18:55.465087 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.465940 20180 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:55.466063 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.461165 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:55.470749 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.470837 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.471724 20173 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:55.472239 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.473428 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.474543 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:55.475068 20330 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.475621 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:55.475857 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:55.477047 24111 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:55.477632 24111 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.478216 24111 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.479668 24342 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:55.480405 24391 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:18:55.481583 24391 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:55.481937 24391 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:55.476400 20173 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.484161 24206 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.426335 24233 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.489859 24233 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.492724 24233 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:55.496047 24353 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.373909 24345 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:55.458997 24175 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.471294 23885 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:55.454066 20329 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:18:55.508836 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.483026 24391 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.424172 24395 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.469569 24317 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.513607 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:55.516775 24364 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.510224 24206 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:55.520833 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:55.507844 23885 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:55.515417 24353 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:55.536999 20174 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:55.530223 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:55.542047 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.543547 20180 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.525667 24355 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:55.548987 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.436161 24336 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.559007 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.524128 24388 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:55.563618 20250 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:55.529430 24218 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:55.553915 24355 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.565310 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.570995 20175 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:18:55.574275 20175 pending_rounds.cc:85] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 4
I20260709 12:18:55.574623 20175 pending_rounds.cc:107] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:55.574685 24396 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:55.574998 20175 raft_consensus.cc:2889] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:55.575223 24396 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.575739 24396 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.582217 20180 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:55.520454 24111 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.572365 24219 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.567080 20251 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:18:55.571897 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 119950us
I20260709 12:18:55.566761 24264 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.588872 24355 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.610288 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.639664 20328 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:55.642714 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:55.593144 24264 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.657960 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:55.649123 24216 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:55.662012 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.667819 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.666201 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:55.672549 24408 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.429s	user 0.007s	sys 0.000s
I20260709 12:18:55.673458 24273 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:55.674082 24273 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.676375 24273 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.676463 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:55.676918 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 141344us
I20260709 12:18:55.677995 24429 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:55.678149 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:55.679134 24274 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:55.679894 24357 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:55.680200 23626 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:55.681711 24204 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:55.682077 24204 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:55.679896 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:55.693082 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 82882.2us
I20260709 12:18:55.636948 24219 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.697296 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:55.699611 24422 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:55.700067 24264 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.692575 24274 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:55.702314 24418 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 12:18:55.703178 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:55.704941 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.705443 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.600633 23885 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.690263 24375 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:55.715437 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:55.669019 24216 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.727238 24203 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:55.734284 24417 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.217s	user 0.000s	sys 0.002s
I20260709 12:18:55.692078 23626 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:55.683058 24204 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.731339 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:55.741581 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.738503 24216 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.750167 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:55.751241 20250 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:55.753829 24431 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:55.754354 24431 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:55.754761 24431 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.738883 24203 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:55.777310 24203 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.778682 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.780071 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.758958 24369 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:55.781319 24369 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.781481 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.781843 24369 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:55.767124 24396 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.784533 24396 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.784817 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:55.762283 24359 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:18:55.786369 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.788022 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.789023 20248 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:55.789561 24111 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.795936 24336 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.761768 24420 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:18:55.771713 24395 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.802163 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.803053 24368 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:55.768213 24274 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:55.803467 24368 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:55.772032 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.804437 24368 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:55.773114 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:55.805963 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.806202 20247 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:55.774544 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.763190 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:55.776219 20256 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:18:55.807170 20255 raft_consensus.cc:2368] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:55.776777 24219 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:55.781646 24057 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.813723 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.815008 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:55.788388 24414 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
I20260709 12:18:55.815923 21037 raft_consensus.cc:2410] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:18:55.816875 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.818210 24204 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.818451 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:55.772039 24375 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.819096 21038 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:55.820732 21041 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:55.823768 21034 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:55.825026 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.820746 20250 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:18:55.825026 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.805524 24368 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.835280 20325 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:55.837895 23885 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.845158 24317 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:55.847195 24317 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:55.852365 24317 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:55.853627 24317 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:55.856001 24317 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.857972 24375 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:55.859706 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 96586.4us
I20260709 12:18:55.860395 24391 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.866029 20173 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:55.869866 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.871347 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.875530 20330 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:55.897264 20173 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:55.902767 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.903105 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:55.913306 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:55.918867 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.913076 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.923694 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.924396 21042 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:55.924693 21037 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:55.925380 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:55.926227 24367 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:55.926761 24367 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:55.928000 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.929016 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:55.931823 20252 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:55.935811 21038 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:55.910046 24396 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:55.948632 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:55.951197 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.918432 24218 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:55.954537 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.957135 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.948050 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.964058 20171 raft_consensus.cc:2393] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:55.963920 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:55.967097 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.967083 20172 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:18:55.968808 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:55.969072 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:18:55.969233 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109966us
I20260709 12:18:55.970772 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.972540 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.971530 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:55.949514 24111 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:56.011052 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.010376 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:56.016481 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47456.3us
I20260709 12:18:56.019291 20175 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:55.974632 20180 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:18:56.018883 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50445us
I20260709 12:18:56.024868 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.025578 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.026115 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:55.949420 24357 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:56.034335 24433 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:56.034119 24144 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:18:56.034827 24433 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.035218 24433 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:56.036187 20075 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:56.039846 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.040947 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:56.042291 20179 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:56.030543 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:55.973762 20174 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:18:56.028407 20178 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:55.927798 24367 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.026321 20171 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:55.972882 24218 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:55.972729 24396 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:56.046098 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.053210 20248 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:56.067305 20171 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:18:56.069252 20177 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:56.070261 24390 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:56.055068 20329 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:56.073182 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:56.071349 20172 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:56.067864 20171 pending_rounds.cc:85] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:18:56.077471 20171 pending_rounds.cc:107] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:18:56.077718 20171 raft_consensus.cc:2889] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:56.079016 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.079931 20178 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:56.053049 24364 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.973074 24264 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
W20260709 12:18:56.094893 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71037.1us
I20260709 12:18:56.064988 24257 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.054502 24273 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:56.089202 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.102689 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:56.106570 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.109359 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:56.111732 20248 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:56.114351 21038 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:18:56.112100 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:18:56.116423 20171 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:56.054930 24104 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:18:56.121796 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47858.7us
I20260709 12:18:56.128330 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:56.128997 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:18:56.212102 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87720.2us
I20260709 12:18:56.113334 24273 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.124761 24085 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:56.085690 24144 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:18:56.100495 24388 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:56.201534 20172 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:56.213223 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:56.222915 20177 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:56.224279 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 95578.5us
I20260709 12:18:56.111311 24257 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.244953 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:56.247380 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 106719us
I20260709 12:18:56.252348 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:56.122936 24355 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.128149 24364 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.255764 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.256986 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.223546 24273 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.219894 24424 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:56.262773 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:56.220449 24261 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:18:56.273890 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.290380 20176 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:56.275540 21038 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:56.254211 24219 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:56.299336 20174 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:56.246906 24388 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:56.279776 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.304744 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.274487 24357 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.226753 24444 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:56.289124 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.289354 20326 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:56.303500 20177 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:56.262039 24377 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:56.299736 24219 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.342175 24219 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:56.345414 24369 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.009s
I20260709 12:18:56.345750 20253 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:56.345944 24369 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.289893 24085 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.333432 24388 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:56.304436 24206 consensus_meta.cc:287] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.779s	user 0.017s	sys 0.000s
W20260709 12:18:56.357089 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 105090us
I20260709 12:18:56.304297 24424 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:56.365787 24424 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.367161 24355 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:56.370702 24441 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:18:56.373023 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:56.373737 21043 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:18:56.374665 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:56.335170 20177 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:56.264726 24448 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:18:56.373198 24219 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.298437 24264 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:56.361708 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:56.229517 24218 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:56.419710 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 58150.2us
W20260709 12:18:56.401160 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.403257 20324 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:18:56.338475 24377 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:56.423012 24206 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:56.375869 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.423377 24377 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.249884 24396 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.333684 23626 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:18:56.303480 24431 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.440277 21038 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:56.437906 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.288368 24203 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.453605 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:56.349637 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 119491us
I20260709 12:18:56.443011 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.439292 24424 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:18:56.445399 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.441743 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:56.457773 21036 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:56.459296 20176 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:18:56.426663 24264 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:56.466406 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.464313 20321 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:56.468732 21035 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:56.472229 20328 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:56.474798 20327 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:56.476948 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.402913 24085 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.479071 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.466362 24369 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:56.470813 24264 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.519383 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.521106 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.522480 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.523772 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:56.523983 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.524355 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.524454 20178 raft_consensus.cc:2376] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8. Re-sending same reply.
I20260709 12:18:56.524042 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.525334 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:56.525678 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.537581 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.539047 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.540373 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.544553 20180 raft_consensus.cc:2393] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:56.466967 24364 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:56.547554 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.548220 20176 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:56.552426 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.553103 20321 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:56.554759 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.554773 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.556689 20178 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
W20260709 12:18:56.541321 24216 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.004s
I20260709 12:18:56.557803 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:56.545137 24317 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.002s
I20260709 12:18:56.524462 24257 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:56.561709 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.562904 20174 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:56.561293 24216 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.567808 21041 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:56.570875 24057 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.757s	user 0.000s	sys 0.015s
I20260709 12:18:56.571623 20251 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:18:56.551587 24433 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.003s
I20260709 12:18:56.562664 20171 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
W20260709 12:18:56.554912 24204 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.008s
I20260709 12:18:56.579881 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.550979 24219 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:56.580097 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.584232 20171 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:56.584959 20179 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:18:56.617236 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.587010 24436 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.510s	user 0.003s	sys 0.000s
W20260709 12:18:56.590490 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.596433 24454 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:18:56.598141 24431 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:56.594863 24433 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.601318 24388 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.625399 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.631526 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.648784 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.632822 21039 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:18:56.668589 21008 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.537s (SENT)
I20260709 12:18:56.668569 20172 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:18:56.669958 20255 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:56.674261 20178 raft_consensus.cc:2376] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10. Re-sending same reply.
I20260709 12:18:56.676244 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.681093 20247 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:56.685353 20171 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:56.687729 20172 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:56.687862 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.689147 20178 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:56.677323 23885 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.003s
I20260709 12:18:56.690666 20329 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:56.692047 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.690979 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:56.690656 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.696404 20176 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:18:56.696790 20176 pending_rounds.cc:85] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:18:56.696995 20176 pending_rounds.cc:107] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:18:56.697219 20176 raft_consensus.cc:2889] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:56.698326 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.699049 20176 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:56.695214 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.713529 20178 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:56.713943 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.718549 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.722223 24264 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.722856 20178 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:56.723304 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.779477 20171 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:56.779752 24273 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.782461 24273 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:56.726049 20330 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:56.728626 24388 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:56.729430 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:56.785194 24104 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:56.731065 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.785768 24104 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:56.731693 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.732787 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:56.788525 21036 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:56.790992 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.791425 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:56.791986 20178 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:18:56.793066 24367 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:56.793298 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.794118 20178 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:56.794872 24388 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:56.733424 20177 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.739223 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.795888 20254 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:56.796870 20177 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:56.798478 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.799324 24388 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.740692 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:56.742321 24432 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.497s	user 0.001s	sys 0.000s
W20260709 12:18:56.742794 24436 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:56.743391 20325 raft_consensus.cc:1217] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[8.6-10.7]   Dedup: 8.6->[10.7-10.7]
I20260709 12:18:56.807683 20325 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
W20260709 12:18:56.747205 24462 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:56.694908 24216 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:56.748623 24203 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:56.750025 24433 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:56.750270 20326 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:56.751470 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:56.752303 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 713) took 1398 ms. Trace:
I20260709 12:18:56.756738 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.837216 20179 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 4: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:18:56.773132 21040 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:18:56.776501 24355 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:56.837898 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.773941 24463 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 12:18:56.788093 24104 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:56.803942 20176 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:18:56.809533 20321 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:56.858824 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.795207 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.832186 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.833205 20330 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:56.799816 24388 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:56.836843 20324 rpcz_store.cc:276] 0709 12:18:55.353912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.360632 (+  6720us) service_pool.cc:224] Handling call
0709 12:18:56.752122 (+1391490us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000866d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:56.752241 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351845248}
I20260709 12:18:56.767236 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:56.846180 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.848261 24416 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:56.849272 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:18:56.868045 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100887us
I20260709 12:18:56.866083 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:56.873850 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:56.874106 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:56.884212 20177 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:18:56.884847 20177 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:18:56.885130 20177 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:18:56.885602 20177 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:56.886727 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:56.887883 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.890185 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:56.866465 24434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.020s	sys 0.015s
I20260709 12:18:56.893972 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:56.900023 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:56.863679 24364 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.901453 20171 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:56.871006 24456 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:56.908275 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:56.907265 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:56.910357 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.913467 21035 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.913704 20175 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:18:56.913754 20178 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.911307 20328 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:18:56.920400 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:56.921432 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:56.926342 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2954) took 1606 ms. Trace:
I20260709 12:18:56.928082 20323 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:56.930471 20178 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:56.914469 20175 pending_rounds.cc:85] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:18:56.932222 20175 pending_rounds.cc:107] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:18:56.932623 20175 raft_consensus.cc:2889] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:56.936822 20177 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:56.896811 24355 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:56.943921 20171 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:56.907907 24233 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:56.950713 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:56.900897 24434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.020s	sys 0.015s
I20260709 12:18:56.921229 24444 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:56.946027 24456 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:56.963035 24456 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.963268 24385 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:56.965523 24385 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:56.957374 20171 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:56.961025 24388 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:56.943197 24451 raft_consensus.cc:2764] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:56.926864 20322 rpcz_store.cc:276] 0709 12:18:55.320376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.589675 (+269299us) service_pool.cc:224] Handling call
0709 12:18:55.595876 (+  6201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:55.636366 (+ 40490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:55.636402 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:55.654621 (+ 18219us) log.cc:844] Serialized 26 byte log entry
0709 12:18:55.948818 (+294197us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:55.948872 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.948992 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:56.741628 (+792636us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:56.909995 (+168367us) raft_consensus.cc:1685] finished
0709 12:18:56.910020 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:56.926249 (+ 16229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37519,"raft.queue_time_us":26165,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6087,"spinlock_wait_cycles":264424704,"thread_start_us":259732,"threads_started":1,"wal-append.queue_time_us":419140}
W20260709 12:18:56.975533 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.932068 24367 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:56.907625 24111 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:18:57.002203 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 203740us
W20260709 12:18:57.060083 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.977169 24144 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:57.092208 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 123135us
I20260709 12:18:57.098399 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:57.112831 20175 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:18:56.965895 24385 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:18:57.084899 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.115151 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.920645 24364 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:56.949927 24104 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:18:56.991153 24233 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:57.105835 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:57.119091 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:57.111205 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.879s (SENT) [suppressed 21 similar messages]
I20260709 12:18:57.122113 24144 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:57.123319 24144 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:57.128930 24364 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.129513 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.130988 24431 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.140789 20322 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:57.027941 24444 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:57.097983 24433 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.150508 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:18:57.176082 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.184187 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.191742 20322 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:57.190044 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48384.7us
I20260709 12:18:57.092518 24367 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.129594 24364 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:57.109100 24447 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:18:57.193619 24345 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:57.191542 24451 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.139498 23626 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:18:57.218552 24474 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:57.236310 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:57.217132 24456 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:57.241096 24456 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.198750 24434 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:57.216447 24264 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.246170 24456 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.252360 24479 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.253132 24479 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.268592 24367 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:57.275882 24449 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.988s	user 0.009s	sys 0.002s
I20260709 12:18:57.214522 24205 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:57.277069 24205 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.278612 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1091) took 1170 ms. Trace:
I20260709 12:18:57.197433 24433 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:57.286007 21036 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:57.284142 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.279124 21040 rpcz_store.cc:276] 0709 12:18:56.108531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.108696 (+   165us) service_pool.cc:224] Handling call
0709 12:18:57.278361 (+1169665us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54005da054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:57.278502 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301290240}
I20260709 12:18:57.310871 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1093) took 1186 ms. Trace:
I20260709 12:18:57.220803 24261 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:57.228328 24345 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:57.325294 21035 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:57.311525 21041 rpcz_store.cc:276] 0709 12:18:56.111646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.111792 (+   146us) service_pool.cc:224] Handling call
0709 12:18:56.218830 (+107038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.568179 (+349349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.298124 (+729945us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54006022d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:57.298382 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802075520}
I20260709 12:18:57.334725 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:57.335554 20255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1656) took 1377 ms (client timeout 1523 ms). Trace:
W20260709 12:18:57.336055 20255 rpcz_store.cc:269] 0709 12:18:55.958439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.958554 (+   115us) service_pool.cc:224] Handling call
0709 12:18:57.335293 (+1376739us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54002df854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:57.335492 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407774464}
I20260709 12:18:57.337944 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:57.338744 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:57.346338 24345 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.347159 20075 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.348304 24345 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:57.349545 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.279434 24205 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:57.352322 24433 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:57.339705 24385 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.354033 24385 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.226325 24364 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.339104 24261 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.357762 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:57.358712 21035 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:18:57.363073 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.366053 24450 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.001s	user 0.007s	sys 0.003s
W20260709 12:18:57.371891 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.380618 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.409893 21036 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:57.232043 24451 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.300124 24233 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.395682 24479 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.389503 23885 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:57.281054 24444 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:57.434580 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 241726us
I20260709 12:18:57.411914 24416 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:57.448328 21037 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:18:57.452153 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.426286 24481 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.460850 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:18:57.431821 24439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.020s	sys 0.014s
I20260709 12:18:57.454263 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:57.468017 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:57.431497 24396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.004s	sys 0.005s
I20260709 12:18:57.474627 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:57.476055 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2595) took 1536 ms. Trace:
I20260709 12:18:57.433138 24364 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.476347 24487 raft_consensus.cc:2764] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:57.489593 24424 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:57.493795 20220 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.483917 24488 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:18:57.494802 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.216s (SENT)
I20260709 12:18:57.494979 24496 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:18:57.495353 24104 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:57.472720 24479 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:18:57.496112 24429 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:57.461786 24261 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.470669 24481 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:57.505084 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 565) took 1604 ms (client timeout 1846 ms). Trace:
I20260709 12:18:57.478024 20173 rpcz_store.cc:276] 0709 12:18:55.939670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.950100 (+ 10430us) service_pool.cc:224] Handling call
0709 12:18:55.950590 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:55.971270 (+ 20680us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:56.046254 (+ 74984us) log.cc:844] Serialized 14 byte log entry
0709 12:18:56.227710 (+181456us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:56.247532 (+ 19822us) log.cc:844] Serialized 26 byte log entry
0709 12:18:56.247725 (+   193us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:56.247759 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.247836 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:57.365266 (+1117430us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:57.469806 (+104540us) raft_consensus.cc:1685] finished
0709 12:18:57.475833 (+  6027us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.475988 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36374,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":48478,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":26867,"spinlock_wait_cycles":11229952,"thread_start_us":115491,"threads_started":1,"wal-append.queue_time_us":288394}
W20260709 12:18:57.467860 24439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.026s	sys 0.016s
I20260709 12:18:57.519335 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.519937 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.521046 20322 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:18:57.522783 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:57.485703 24377 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:57.522881 24497 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.525722 24424 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:18:57.524544 21034 rpcz_store.cc:269] 0709 12:18:55.901058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.901301 (+   243us) service_pool.cc:224] Handling call
0709 12:18:57.454008 (+1552707us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:18:57.505004 (+ 50996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3324160}
I20260709 12:18:57.532122 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:18:57.505435 24396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.004s	sys 0.006s
I20260709 12:18:57.527947 20329 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:57.529714 24481 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:57.482808 24474 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:18:57.539441 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.540027 24205 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:57.540815 24205 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:57.530580 24342 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.533576 24364 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:57.534663 24489 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:57.549435 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:57.551256 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56492.6us
I20260709 12:18:57.548892 24429 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.555859 24479 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:57.555971 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.544512 24204 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:57.563095 24205 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.569119 24204 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.571973 24345 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:57.572567 24345 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:57.573817 24345 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.545646 24481 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:57.581468 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:57.548314 24364 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:57.588575 24489 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:57.592751 24489 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:18:57.595832 24357 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.596884 24479 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:57.598430 24364 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.590052 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:57.579453 24104 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:57.575517 24345 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.615386 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:18:57.607708 24501 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:18:57.618626 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:57.617480 24364 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:57.617386 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65927.4us
I20260709 12:18:57.600399 24504 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:57.620682 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.623518 24479 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.624187 24474 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.620944 24504 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.624835 24504 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:57.605257 24496 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:57.626102 24496 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:57.623611 24481 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.602257 24429 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:18:57.641057 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.627301 24496 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.646799 21037 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:57.648089 24458 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.134s	user 0.002s	sys 0.003s
I20260709 12:18:57.648213 20329 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:57.650940 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.600030 24424 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:57.657866 20321 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:57.659441 24481 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:57.659951 21039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1051) took 2018 ms (client timeout 2213 ms). Trace:
W20260709 12:18:57.660358 21039 rpcz_store.cc:269] 0709 12:18:55.641264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.641409 (+   145us) service_pool.cc:224] Handling call
0709 12:18:57.659779 (+2018370us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540047b654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:57.659891 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413595392}
I20260709 12:18:57.663904 24433 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.664453 21035 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:57.667699 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.668155 21038 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:57.669508 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.675800 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.677155 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.677522 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2971) took 1662 ms. Trace:
I20260709 12:18:57.678010 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1725) took 1140 ms. Trace:
I20260709 12:18:57.678900 24479 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.677980 20327 rpcz_store.cc:276] 0709 12:18:56.015345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.024895 (+  9550us) service_pool.cc:224] Handling call
0709 12:18:56.046638 (+ 21743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.479833 (+433195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.677270 (+1197437us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540015cf54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:57.677458 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984169728}
I20260709 12:18:57.679682 24479 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.680502 24479 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.681185 24479 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.679208 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:57.678364 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:57.688449 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:57.678519 20325 rpcz_store.cc:276] 0709 12:18:56.537937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.715657 (+177720us) service_pool.cc:224] Handling call
0709 12:18:56.743173 (+ 27516us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:56.808033 (+ 64860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.677778 (+869745us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54002b6450. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:57.677938 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62023552}
I20260709 12:18:57.669903 24085 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:57.698513 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:18:57.677536 24467 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.846s	user 0.002s	sys 0.000s
W20260709 12:18:57.699939 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.702127 20178 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:57.704319 20173 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:57.705005 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:57.709379 20179 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:57.714780 20172 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:57.716156 20173 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:57.721695 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:57.724859 24504 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:57.732255 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 53956.2us
I20260709 12:18:57.733423 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.699708 24233 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:57.736979 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:57.738781 20173 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
W20260709 12:18:57.739060 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62019.2us
I20260709 12:18:57.710548 24204 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.742285 20173 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:57.719264 24464 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:18:57.731175 24357 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:57.743166 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.711719 24429 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:18:57.738340 24233 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.741825 23626 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.730674 24336 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:18:57.778095 20144 leader_election.cc:400] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:57.778581 20144 leader_election.cc:403] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:57.771796 24233 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:57.780690 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:18:57.783864 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50562.4us
I20260709 12:18:57.784783 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:57.752410 24357 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:18:57.789919 24504 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:57.790055 24336 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:57.790608 24336 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:57.788152 24357 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.771965 24481 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.791493 24336 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:57.793108 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.793234 24336 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.795009 24511 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:18:57.795756 24511 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.796068 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.772262 24497 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 12:18:57.795771 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.797477 24474 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.811115 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.817108 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:57.817788 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:57.818524 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:57.820487 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.822578 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:57.823623 20248 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:18:57.807377 24481 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.811995 23626 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:57.867384 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.869529 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49128.9us
I20260709 12:18:57.870718 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.821540 24511 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.882323 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:57.882764 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.866945 24504 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.820433 24474 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:57.866854 23626 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:57.887742 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:18:57.888432 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 727) took 1294 ms. Trace:
I20260709 12:18:57.821030 24496 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:18:57.891158 20323 rpcz_store.cc:276] 0709 12:18:56.594069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.196544 (+602475us) service_pool.cc:224] Handling call
0709 12:18:57.227928 (+ 31384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.357613 (+129685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.357645 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:57.357687 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:57.357719 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.888199 (+530480us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400087fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:57.888249 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.888370 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297615744}
I20260709 12:18:57.893986 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:57.918778 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:57.884673 24481 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:57.921777 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.922623 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:57.923332 20255 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:18:57.921159 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:57.889941 24505 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:57.893134 23626 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.895190 24511 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:57.929546 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:57.930271 20256 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:18:57.933277 20256 pending_rounds.cc:85] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 5
I20260709 12:18:57.933529 20256 pending_rounds.cc:107] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:18:57.933782 20256 raft_consensus.cc:2889] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:57.934916 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:57.935623 21036 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:57.936751 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:57.926906 24433 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.938652 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:57.940845 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.942210 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.943902 24413 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:57.944736 24390 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.943506 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:57.947122 24390 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.949708 21039 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:18:57.952780 24205 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:57.954869 24233 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:57.924412 24504 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.957729 21039 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:58.009788 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:58.010564 21035 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.015940 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:57.932535 24511 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:58.018472 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56402.2us
I20260709 12:18:58.020891 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.022718 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:58.023485 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.024492 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.026496 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.025331 20247 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:18:58.032508 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.034320 20173 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:58.025856 24505 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.036042 24505 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.038410 24505 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.030196 24357 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.041450 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 2978) took 1463 ms. Trace:
I20260709 12:18:58.041903 20330 rpcz_store.cc:276] 0709 12:18:56.577887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.784302 (+206415us) service_pool.cc:224] Handling call
0709 12:18:56.784670 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.862071 (+ 77401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.041171 (+1179100us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b54003980d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:18:58.041369 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111120640}
I20260709 12:18:58.047889 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.048704 20171 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:18:58.052649 20250 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.015821 24481 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:58.019161 24433 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:58.061515 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.025655 24511 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.066637 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.068063 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.073705 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.075739 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:58.075924 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.076356 20174 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9. Re-sending same reply.
I20260709 12:18:58.076604 20180 raft_consensus.cc:2368] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:18:58.078148 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.079092 20173 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
W20260709 12:18:58.067759 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46387.2us
I20260709 12:18:58.088675 21035 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:58.027740 24424 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:58.094074 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.096097 20174 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:58.097030 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.097191 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.099539 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.101136 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:18:58.102154 24514 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:18:58.040995 24342 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:18:58.110317 21034 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:58.066483 24433 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.102413 24429 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:58.123302 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:58.127391 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.131677 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.132934 20250 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:18:58.082670 24481 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.142839 24357 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.143898 24357 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:58.145213 24521 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:18:58.108870 24353 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:58.109303 24377 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:58.161073 24451 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.162251 24511 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.169183 24487 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:58.169690 24487 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:58.170744 24487 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.172020 24487 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:58.177510 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:58.171917 24511 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.193285 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.194689 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.195226 20254 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:18:58.204334 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:18:58.215891 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85701.7us
I20260709 12:18:58.216863 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.113499 24464 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:18:58.222582 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:58.223099 20251 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
W20260709 12:18:58.226281 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 94820.6us
I20260709 12:18:58.230886 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.235646 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.238054 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:58.240356 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:58.251590 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:58.252388 20176 raft_consensus.cc:2368] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:18:58.256579 20220 leader_election.cc:400] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:18:58.256913 20220 leader_election.cc:403] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:18:58.234884 24233 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:58.241567 24489 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:58.262169 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:58.237810 24504 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:18:58.256732 24479 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:58.280586 20256 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:58.289914 24481 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.290719 24511 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:58.291368 24494 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 12:18:58.293883 24175 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:58.296133 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.263057 24439 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:18:58.302541 24481 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:58.305889 24511 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.306118 24481 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.280293 24390 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:58.309780 24481 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.311633 24175 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:58.312166 24175 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.312408 21039 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:58.308320 24511 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:58.318122 24517 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.266s	user 0.000s	sys 0.003s
I20260709 12:18:58.318658 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:58.319380 21038 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:58.322033 24488 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:58.322575 24488 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:58.323764 24488 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.324513 24474 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.325592 24488 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.326464 24481 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:58.332800 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:58.316030 24345 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.006s
I20260709 12:18:58.368453 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.378605 24523 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:58.379312 24523 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.379338 23626 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.381927 24523 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.382405 23626 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.347391 24504 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.392544 20256 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:58.345357 24481 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:58.344904 24496 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.390002 24532 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.400914 23626 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:18:58.460879 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 238349us
I20260709 12:18:58.463315 21008 leader_election.cc:400] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:18:58.463809 21008 leader_election.cc:403] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:58.396124 24504 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.452698 24481 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:58.469205 24489 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:58.484225 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.486346 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.469470 24523 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:18:58.469790 24481 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.455883 24496 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.463488 23626 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.461419 24532 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.502857 20253 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:58.503743 24504 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.511338 24216 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:58.483685 24526 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.512609 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:58.516500 21039 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:18:58.513782 24496 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.517918 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.518944 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:58.520936 21039 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:58.523116 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.491698 24390 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:58.515491 24216 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.526014 24504 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:58.530352 24496 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:58.548394 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 62162.7us
I20260709 12:18:58.538520 24216 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.560873 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.540792 24504 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.545570 24496 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.564939 24504 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:58.553072 24511 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:18:58.581995 24416 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.595081 24487 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:58.574256 24496 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.598963 24481 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.553033 24175 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:58.613364 24541 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:18:58.617440 24481 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:58.620039 24543 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:18:58.621234 24544 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:58.624446 24532 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.630090 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:58.451635 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:58.647414 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.579725 24489 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.669864 21039 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:58.672243 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.608865 24487 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.684747 24175 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:58.708501 24433 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:18:58.712489 24518 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.647s	user 0.005s	sys 0.005s
I20260709 12:18:58.677147 24511 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.738225 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.740855 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:58.722785 24487 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.722852 24104 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:58.748041 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.681870 24488 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:58.742584 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:58.678619 23626 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.748801 20174 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:58.737385 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:58.756040 20256 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:18:58.756482 20256 pending_rounds.cc:85] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 9
I20260709 12:18:58.756709 20256 pending_rounds.cc:107] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:18:58.756935 20256 raft_consensus.cc:2889] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:58.757057 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.750638 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:58.762176 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.763021 20253 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:58.763053 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:58.776436 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.746284 24479 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:58.748391 24104 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:58.772544 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.783798 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.787923 20247 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:58.791014 24530 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:58.791457 24530 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:58.791932 24530 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.748559 24511 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.803550 24511 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.808835 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:58.796864 24488 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:58.833098 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2162) took 1017 ms. Trace:
I20260709 12:18:58.819468 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.791385 24504 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.834791 20252 rpcz_store.cc:276] 0709 12:18:57.816041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.816179 (+   138us) service_pool.cc:224] Handling call
0709 12:18:57.816612 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.817066 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.817100 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.818115 (+  1015us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.917181 (+ 99066us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:57.917245 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.917348 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.711877 (+794529us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:58.812707 (+100830us) raft_consensus.cc:1685] finished
0709 12:18:58.812741 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.832984 (+ 20243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":404,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":12263168,"thread_start_us":51185,"threads_started":1,"wal-append.queue_time_us":187788}
I20260709 12:18:58.804611 24479 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:58.860780 24547 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:18:58.861369 24488 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.863807 23880 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:58.854332 24342 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:58.812263 24523 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:18:58.867136 24523 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:58.869231 24479 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:58.869947 24546 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 12:18:58.870217 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:18:58.870854 20255 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.868713 24530 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:18:58.871927 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.15191e+06us
I20260709 12:18:58.873715 24530 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:58.887153 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:58.888420 24396 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:18:58.888788 24111 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:58.908093 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:58.909050 20329 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:58.912982 24496 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.867504 24523 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:18:58.931100 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:58.936584 20255 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:18:58.931907 20321 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:58.938917 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:58.941972 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:58.915545 24496 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.932382 24368 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:58.941610 24111 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:58.946398 24368 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.946540 24111 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.949388 24368 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:58.942842 20329 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:18:58.950091 24111 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:58.955682 24396 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:58.955832 24368 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:58.957880 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 68226.8us
I20260709 12:18:58.957911 24342 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.980283 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:58.980556 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:18:58.983938 23880 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:58.984350 23880 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.984668 23880 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:58.989475 24555 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:18:58.991041 24545 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.367s	user 0.004s	sys 0.000s
I20260709 12:18:58.962260 24368 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:58.992966 24523 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:58.993628 24368 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:58.994386 24523 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.958189 24504 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.000912 20075 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:18:58.998250 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:18:59.004158 24273 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:59.004914 24144 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:59.005343 24144 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.005700 24144 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:59.005803 24111 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:59.010193 24559 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:59.010527 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:59.011696 24369 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:59.017182 24140 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:59.011978 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2166) took 1194 ms. Trace:
W20260709 12:18:59.017971 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 153735us
I20260709 12:18:59.018297 20250 rpcz_store.cc:276] 0709 12:18:57.817395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.817530 (+   135us) service_pool.cc:224] Handling call
0709 12:18:59.011803 (+1194273us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000497d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:18:59.011917 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538491264}
I20260709 12:18:59.004426 24085 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:59.012959 24553 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 12:18:59.013902 20075 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 9 to 12, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:18:59.024731 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:59.025318 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:59.034945 21037 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.029748 20178 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.030305 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:58.943847 24216 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.031554 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:59.036904 21039 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:59.038367 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.039052 21038 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:59.033071 20321 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:59.039700 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:59.040557 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:59.041366 20173 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.053709 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:59.061884 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.063557 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:18:59.034152 24364 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.028088 24505 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.068461 20172 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:59.087025 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:59.096802 24355 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:59.056901 23626 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.050899 24273 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.048434 24496 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:59.102573 20077 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 307) took 11880 ms (client timeout 15000 ms). Trace:
I20260709 12:18:59.103084 20075 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 8, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.062367 24085 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:59.062084 24369 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:59.113356 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:59.066367 24368 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:59.117331 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:18:59.141233 20321 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:59.131732 20173 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:18:59.149369 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.149756 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.150902 21039 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:18:59.143448 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.116737 24261 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.066937 24429 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:18:59.161366 20173 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:59.125360 24355 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:59.162525 24355 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.162873 20173 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 12:18:59.166828 20173 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:18:59.167382 20173 pending_rounds.cc:85] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 7
I20260709 12:18:59.167878 20173 pending_rounds.cc:107] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:18:59.168601 20173 raft_consensus.cc:2889] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:59.169257 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.088513 24364 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.145603 21037 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:18:59.155772 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 88544.3us
I20260709 12:18:59.100342 24505 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.136374 24216 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.179502 20075 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 9, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:59.187554 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.194082 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.161213 24233 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.136201 24536 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 12:18:59.140321 24273 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.206692 20177 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:18:59.207733 20177 pending_rounds.cc:85] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:18:59.208001 20177 pending_rounds.cc:107] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:18:59.179040 24456 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.208285 20177 raft_consensus.cc:2889] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:59.188817 24369 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.153882 24496 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.220453 24504 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.221084 24504 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.223515 24504 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.224515 24355 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.228207 24355 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.235208 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
W20260709 12:18:59.235548 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52138.5us
I20260709 12:18:59.208213 24429 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:59.253281 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.146160 20077 rpcz_store.cc:269] 0709 12:18:47.222055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.222599 (+   544us) service_pool.cc:224] Handling call
0709 12:18:47.406239 (+183640us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b54002d0190. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3e9c 00007f5dd7dd40f6 00007f5de0d4d759 00007f5de0ce5a76 00007f5de0cb6d58 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc
0709 12:18:59.102308 (+11696069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:53.400223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:53.421188 (+ 20965us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:53.421232 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:18:53.421253 (+    21us) tablet.cc:662] Decoding operations
0709 12:18:53.436782 (+ 15529us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:53.448338 (+ 11556us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:53.450783 (+  2445us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:18:53.491082 (+ 40299us) tablet.cc:701] Row locks acquired
0709 12:18:53.491097 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:18:53.491268 (+   171us) write_op.cc:270] Start()
0709 12:18:53.491399 (+   131us) write_op.cc:276] Timestamp: P: 1783599533491214 usec, L: 0
0709 12:18:53.491424 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:18:53.500751 (+  9327us) log.cc:844] Serialized 11783 byte log entry
0709 12:18:54.762221 (+1261470us) op_driver.cc:464] REPLICATION: finished
0709 12:18:54.866037 (+103816us) write_op.cc:301] APPLY: starting
0709 12:18:54.866257 (+   220us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:54.881207 (+ 14950us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:54.881310 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:54.901147 (+ 19837us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:54.901776 (+   629us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=60
0709 12:18:54.901853 (+    77us) write_op.cc:312] APPLY: finished
0709 12:18:54.902673 (+   820us) log.cc:844] Serialized 200 byte log entry
0709 12:18:54.902995 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.903869 (+   874us) write_op.cc:454] Released schema lock
0709 12:18:54.904001 (+   132us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:54.996688 (+ 92687us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:54.997785 (+  1097us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":484080,"reported_tablets":48,"spinlock_wait_cycles":2422400,"child_traces":[["op",{"apply.queue_time_us":103328,"apply.run_cpu_time_us":10408,"apply.run_wall_time_us":106277,"num_ops":30,"prepare.queue_time_us":265002,"prepare.run_cpu_time_us":22513,"prepare.run_wall_time_us":246769,"raft.queue_time_us":725393,"raft.run_cpu_time_us":18998,"raft.run_wall_time_us":122546,"replication_time_us":1270413,"thread_start_us":630792,"threads_started":4,"wal-append.queue_time_us":217921,"wal-append.run_cpu_time_us":91369,"wal-append.run_wall_time_us":2192433}]]}
I20260709 12:18:59.210856 24085 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.259334 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 85686.2us
I20260709 12:18:59.260860 23626 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:59.236846 20321 raft_consensus.cc:606] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:59.264964 20321 raft_consensus.cc:614] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:59.210139 24111 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.217470 24489 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.270752 23626 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:59.277973 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:59.282397 20325 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:59.252873 24504 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.268096 24569 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.289472 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.215443 24456 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.215660 24369 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.291426 20328 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:59.262107 24233 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.268752 24429 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:59.295058 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:18:59.288694 24496 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.335338 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.343340 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:18:59.339389 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44456.3us
I20260709 12:18:59.348407 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:59.357815 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.282408 24111 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.286900 24489 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.362413 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 84522us
I20260709 12:18:59.363422 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.292085 24504 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.296419 24576 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:18:59.295912 24569 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.386554 20066 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.295s	user 0.020s	sys 0.021s
I20260709 12:18:59.305311 24233 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.380148 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:18:59.352921 24355 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:59.396850 20324 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:18:59.385998 24364 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:59.410976 24565 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:18:59.409492 24273 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:59.446213 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45697.3us
W20260709 12:18:59.431663 24573 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:18:59.411984 24587 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.411928 24577 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:59.454108 24567 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:18:59.455780 24556 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.618s	user 0.003s	sys 0.000s
I20260709 12:18:59.455524 24568 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:18:59.457257 24590 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.457845 24590 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.463966 24504 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.465204 24505 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:59.468406 24539 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.887s	user 0.000s	sys 0.004s
I20260709 12:18:59.470598 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 661) took 1408 ms. Trace:
I20260709 12:18:59.473112 24104 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.474795 24104 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:59.385567 24429 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.479882 24592 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.480572 24590 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.480469 24592 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.453109 24368 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:59.482757 24592 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.483420 24531 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.483999 24531 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.486340 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 138085us
I20260709 12:18:59.402912 24144 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.470961 20180 rpcz_store.cc:276] 0709 12:18:58.061910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.081770 (+ 19860us) service_pool.cc:224] Handling call
0709 12:18:58.096487 (+ 14717us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:58.110737 (+ 14250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:58.110770 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:58.121431 (+ 10661us) log.cc:844] Serialized 52 byte log entry
0709 12:18:58.464961 (+343530us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:58.473425 (+  8464us) log.cc:844] Serialized 14 byte log entry
0709 12:18:58.480303 (+  6878us) log.cc:844] Serialized 14 byte log entry
0709 12:18:58.483329 (+  3026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.483431 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.700154 (+216723us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18000a1380. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b522 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:58.724676 (+ 24522us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18000a1380. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:18:59.436874 (+712198us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:18:59.470362 (+ 33488us) raft_consensus.cc:1685] finished
0709 12:18:59.470390 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.470534 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35923,"prepare.queue_time_us":37737,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":5560,"raft.queue_time_us":19503,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":25091,"spinlock_wait_cycles":62285952,"thread_start_us":317759,"threads_started":1,"wal-append.queue_time_us":390641}
W20260709 12:18:59.492520 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45439us
I20260709 12:18:59.450709 23885 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.448536 24451 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:18:59.512398 24578 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:18:59.513918 24566 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:18:59.514772 24572 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:18:59.520691 24577 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:59.521746 24577 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.528048 24342 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 12:18:59.528627 24274 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:59.529628 24274 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.529979 24274 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:59.530480 24233 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.532732 24489 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.533257 24369 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:59.533324 24489 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.533944 24489 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.536082 24456 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:59.530867 24274 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.559291 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 192196us
W20260709 12:18:59.564457 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 77354.1us
W20260709 12:18:59.558140 23880 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.008s
I20260709 12:18:59.528534 24342 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.550447 24111 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:59.597189 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.597635 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.600091 20321 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:18:59.601159 24600 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:18:59.601996 20321 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:59.603149 20324 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:18:59.603513 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.605885 24534 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:59.606655 24534 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.610518 24551 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.611122 24551 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.611490 24569 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.612689 24144 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:59.599359 20322 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:18:59.561378 24505 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.560554 24368 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:18:59.628548 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56651.8us
I20260709 12:18:59.505820 23885 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.636368 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.507488 24451 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:18:59.632603 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 141092us
I20260709 12:18:59.640841 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.644649 24261 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.636737 24597 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:18:59.646528 20326 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:59.646977 24551 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.602312 24542 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:18:59.633635 24523 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.639s	user 0.015s	sys 0.001s
I20260709 12:18:59.628331 24274 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.649770 20324 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:59.664177 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:59.670640 20253 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:18:59.638453 24342 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.688855 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.685180 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.685813 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.686506 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:59.691082 20177 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:59.687372 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.665419 24336 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.667258 24369 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:18:59.693063 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:18:59.693203 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.599439 23880 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.694255 20328 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:59.695011 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.688063 24396 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 12:18:59.699213 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.700351 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.701272 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.636235 24505 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.671350 24534 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:18:59.695914 24582 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:59.709335 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.752307 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.757738 20328 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:18:59.753377 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 60378.5us
W20260709 12:18:59.754654 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49389.9us
W20260709 12:18:59.755645 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 63243.7us
I20260709 12:18:59.692735 24355 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:59.760777 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.771364 21035 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:18:59.772505 21038 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.779757 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.782102 24204 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:59.786703 24204 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.789593 23626 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.791247 23626 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.791994 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.804666 24451 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.807746 24589 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.761974 24355 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:59.813042 24355 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.814716 24355 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.815117 24434 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:18:59.815385 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.698199 24584 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 12:18:59.695730 24336 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.820145 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:59.793529 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.827745 20250 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:18:59.669366 24542 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.817132 20324 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:59.695765 24342 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.829221 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:59.821468 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.830487 20254 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:59.760896 24534 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:18:59.840862 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:18:59.829071 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69454.8us
I20260709 12:18:59.840960 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:59.760690 24576 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:59.842523 20253 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:18:59.843752 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.828617 20177 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:18:59.845261 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:18:59.820912 24547 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:59.849637 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:18:59.847133 21037 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:18:59.852514 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.858464 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.859385 21037 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:18:59.859434 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:18:59.816496 24602 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:59.855787 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.863888 23885 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.863749 24602 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.864916 24085 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:59.864666 24534 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.866991 24534 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.868881 24342 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.870165 24531 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:18:59.870661 24336 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.872037 21036 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:18:59.872568 21034 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:59.815567 24434 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:18:59.875008 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.647428 20066 maintenance_manager.cc:643] P b336d660a2b34362b3d4d9e44ca2179d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 7.261s	user 0.218s	sys 0.074s Metrics: {"bytes_written":30768,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":142479,"dirs.run_cpu_time_us":570,"dirs.run_wall_time_us":100579,"drs_written":1,"lbm_read_time_us":15852,"lbm_reads_1-10_ms":4,"lbm_write_time_us":324395,"lbm_writes_10-100_ms":6,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":127246,"threads_started":2,"update_count":30,"wal-append.queue_time_us":244823}
I20260709 12:18:59.879623 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.880605 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.881431 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.884805 21034 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:59.861030 24529 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:59.816723 24605 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.895375 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.886536 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.845810 24537 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:18:59.892789 24364 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:59.865553 24085 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:18:59.877903 20173 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:18:59.896678 21034 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:18:59.905289 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.911303 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.912729 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.915354 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:18:59.915791 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:18:59.893622 24534 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:59.763814 24368 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.921669 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.922348 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:18:59.884373 24504 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:59.894358 24529 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.936961 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.922040 24464 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.920964 24534 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:18:59.857321 24576 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.936676 24529 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.951181 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.944906 24534 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.905105 24605 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:18:59.964246 20067 maintenance_manager.cc:419] P b336d660a2b34362b3d4d9e44ca2179d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10401 bytes on disk
I20260709 12:18:59.929872 24537 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:18:59.964645 24602 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:18:59.960381 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.994416 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:18:59.964749 24505 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.944763 24464 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:00.013391 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53111.5us
I20260709 12:19:00.015093 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:00.031584 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.962049 24479 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:19:00.035363 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:00.039861 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:18:59.961898 23880 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:18:59.947005 24434 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:00.047887 24617 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:19:00.048395 24605 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.045506 20066 maintenance_manager.cc:643] P b336d660a2b34362b3d4d9e44ca2179d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.026s	user 0.002s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":13502,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 12:19:00.054915 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.018152 24364 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:18:59.961125 24085 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:00.046479 24608 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:19:00.044195 24505 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:00.057889 24613 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:19:00.071149 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.071826 21041 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:00.078835 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.059478 24434 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.077841 24479 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:19:00.078398 24364 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.071995 21042 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:19:00.084831 21037 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:00.072207 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:00.089206 21040 raft_consensus.cc:2368] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:00.053544 24504 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:00.056818 23880 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.096093 23880 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.097481 21034 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:19:00.097935 24104 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.009s
I20260709 12:19:00.098560 23880 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.098671 24542 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.069329 24489 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.110370 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:00.073817 24505 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:00.114156 21041 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:00.060979 24619 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:00.115780 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.116691 24233 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:00.120231 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 79261.7us
I20260709 12:19:00.121748 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.077183 24464 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.090597 24618 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:19:00.140688 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.142589 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.108716 24537 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.123359 24505 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.121021 24396 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.132637 24144 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:00.146912 24616 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:19:00.109429 24542 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:00.149600 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.149439 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1113) took 1113 ms. Trace:
I20260709 12:19:00.144820 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:00.145884 24621 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.124672 24619 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:00.154196 21035 rpcz_store.cc:276] 0709 12:18:59.035593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.035780 (+   187us) service_pool.cc:224] Handling call
0709 12:19:00.149261 (+1113481us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540056c7d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:00.149380 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409617664}
I20260709 12:19:00.136682 24233 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:19:00.152151 24530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.016s	sys 0.033s
W20260709 12:19:00.161640 24530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.017s	sys 0.033s
I20260709 12:19:00.159720 24620 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:00.158217 24619 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:00.158838 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.158530 24542 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.165843 24542 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.159746 21041 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:19:00.166749 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.171974 24619 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:00.172488 24609 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.473s	user 0.002s	sys 0.000s
I20260709 12:19:00.171767 24504 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.174697 24619 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.178385 24233 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:00.185740 24576 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:00.189405 24601 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.707s	user 0.001s	sys 0.000s
I20260709 12:19:00.153343 24144 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.192664 24144 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.153786 24396 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.194509 24396 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.184491 24559 raft_consensus.cc:993] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:19:00.196341 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:00.206028 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:00.206705 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47930.1us
I20260709 12:19:00.210728 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.218626 20330 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:19:00.222266 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.232741 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.234083 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:00.233958 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.234809 20330 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.217280 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:00.237769 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.216547 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:00.254675 20330 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:00.256690 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:00.257592 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.243108 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:00.242591 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.249825 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.261025 21040 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:00.264489 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.270226 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:00.270761 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.265211 20252 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
W20260709 12:19:00.273138 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61413.3us
I20260709 12:19:00.273422 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.273883 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.238047 24542 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.218386 24104 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.275280 20294 leader_election.cc:400] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:00.279100 24396 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.281157 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.281810 20256 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:00.264429 24261 raft_consensus.cc:1081] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
W20260709 12:19:00.275768 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 58871.9us
I20260709 12:19:00.238940 24317 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.278259 24104 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.293956 20254 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:19:00.294831 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.275381 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.206740 24623 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:00.266160 24603 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:00.286626 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.298959 20252 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:00.250059 24534 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.291682 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.307657 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:00.311925 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:00.312858 20325 raft_consensus.cc:606] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.313309 20325 raft_consensus.cc:614] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:00.313829 24429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.005s	sys 0.015s
I20260709 12:19:00.298736 24603 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:00.282027 24600 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:19:00.322467 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.298494 24623 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:00.331259 24534 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.321519 24104 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.335234 24456 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:00.335692 24456 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:00.336566 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:00.336565 24456 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.337751 24456 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.327418 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:00.321226 24429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.006s	sys 0.016s
I20260709 12:19:00.340499 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:00.341635 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.344616 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.345191 24085 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:00.346040 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.346730 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.347338 24368 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:00.347628 24630 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:19:00.348147 24368 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:00.349520 24523 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:00.349735 24144 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.350658 24586 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:00.351085 24586 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:00.321923 24595 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.355907 20177 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:00.361239 24622 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:19:00.361670 20176 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:19:00.362365 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.362685 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.325188 24603 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.375286 24429 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.325966 24623 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:00.390496 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:00.370716 24587 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.403478 24568 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:00.439414 24568 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.441788 24568 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.406735 24429 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.432973 24586 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.445367 24586 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:00.403718 24600 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:19:00.451658 24273 consensus_queue.cc:1175] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 13 status { last_received { term: 13 index: 10 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:00.349571 24233 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 12:19:00.433764 24628 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:19:00.472951 24620 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:00.479094 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 238094us
I20260709 12:19:00.434024 24434 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.459092 24505 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.510607 24504 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:00.511783 24504 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:00.512210 24274 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.838s	user 0.006s	sys 0.007s
I20260709 12:19:00.513425 20321 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:00.514034 24504 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.516172 24429 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.496995 24434 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.519136 24434 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.435997 24587 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.521291 24587 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.521618 24204 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.485630 24620 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.524674 24504 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:00.507531 24529 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.001s
I20260709 12:19:00.528896 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:00.534739 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:00.534883 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:00.536455 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:00.543769 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.525234 24504 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.549384 24505 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.538911 24542 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:00.559897 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:00.551514 24633 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 12:19:00.542443 24619 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:00.562101 24505 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:00.539057 24534 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:19:00.566025 20177 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.532881 24529 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.571381 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.576529 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:00.581404 20179 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:00.585295 20177 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:00.588800 24623 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.589843 24479 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:00.595239 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.597698 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:00.602670 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.605851 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:00.606422 20250 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.607924 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.608196 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.576025 24542 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:00.610008 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.611020 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:00.611361 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.611769 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.612408 20324 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:19:00.612010 20323 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 4.
I20260709 12:19:00.613525 20172 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:00.615224 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.576795 24505 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:19:00.608152 24618 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:00.672144 24504 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.673401 24529 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.615948 24396 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:19:00.624080 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:00.645402 20327 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:00.633312 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:00.620927 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.644183 21034 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:00.573366 24619 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.596467 24336 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.675869 20250 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:19:00.678870 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 63716.1us
I20260709 12:19:00.622366 20330 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
W20260709 12:19:00.682468 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:00.644358 24647 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:19:00.607496 24489 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:00.623735 24611 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:00.639974 24368 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.647099 24623 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:00.675230 24542 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:00.680536 24551 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.706250 24620 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.683619 24595 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:19:00.714267 24619 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.708576 24542 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.717346 24542 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.695739 24489 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.687127 24336 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.695557 24603 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.703104 24368 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.734027 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1743) took 1040 ms. Trace:
I20260709 12:19:00.737197 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:00.740931 24635 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 12:19:00.741786 24434 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.741819 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.746760 20256 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:00.746678 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.748477 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.748790 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.764689 20321 rpcz_store.cc:276] 0709 12:18:59.693915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.694766 (+   851us) service_pool.cc:224] Handling call
0709 12:19:00.733686 (+1038920us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54000870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:00.733879 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877151616}
I20260709 12:19:00.771495 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.772861 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.773475 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.758633 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.760890 20247 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:19:00.776075 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:00.777372 24368 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:00.762873 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:00.763028 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.787776 20250 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:00.790341 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.747198 24204 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:00.747376 24489 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:00.803680 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.803695 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:00.804960 20326 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:00.794394 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.791869 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.774153 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.817587 21038 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:00.817757 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.818575 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.819445 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.825551 24611 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:00.829205 24317 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:00.829831 24317 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:00.796552 24596 raft_consensus.cc:993] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:00.832872 20322 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:00.834587 24317 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.797137 24599 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:00.837056 24559 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:00.831184 24429 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:19:00.836864 24603 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:00.843273 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:00.855615 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46956.7us
I20260709 12:19:00.856180 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.861924 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:00.811235 24551 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:00.866303 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:00.862416 20326 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:00.867767 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:00.867817 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:00.872148 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:00.791106 24434 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:00.882997 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:01.018126 24650 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:19:00.966686 24355 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.044750 24336 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:00.869354 24623 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:00.809814 24204 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:00.878475 24618 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:00.881932 24529 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:01.050550 24621 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:00.855291 24261 raft_consensus.cc:1081] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:01.050958 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:00.850680 24619 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.056721 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.056648 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.115684 20326 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:00.860311 24559 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:01.055997 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 172975us
I20260709 12:19:01.120193 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:01.119699 24619 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.122154 24534 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:01.122294 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:01.122658 24534 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:01.122813 24619 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.123165 24534 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.063710 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.078163 24355 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.126603 24355 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.128845 24504 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:01.135362 24523 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.136076 24523 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.137573 24204 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:01.138236 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.054862 24505 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:01.059118 24413 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.150815 20247 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:01.107584 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:01.109438 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.094434 24623 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:01.098145 24529 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:01.074486 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 190649us
W20260709 12:19:01.144187 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.158840 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.145718 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.147451 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:01.163847 21035 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:01.156100 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.163954 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:01.157559 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:01.165421 20249 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.164866 21036 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:01.139159 24505 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:01.157835 24623 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:01.171685 24505 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.172971 24523 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.110447 24568 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:19:01.174260 24434 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.177101 24534 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.180764 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.183753 20321 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:01.179453 24534 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.210767 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.212539 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.214061 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.223098 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.223750 20247 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:01.218480 20249 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:01.225473 20249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:19:01.234372 20249 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.228400 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.230700 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.231031 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.232110 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.170027 24205 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:19:01.179153 24577 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:19:01.243407 20176 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:01.243871 20254 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:01.244179 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.245216 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.163745 24529 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.238740 20175 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:01.156754 24413 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:01.232288 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 149583us
I20260709 12:19:01.234449 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.245886 20254 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:19:01.237548 20249 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:01.226958 24534 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:01.261970 20247 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.273208 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:01.276407 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:01.289124 20248 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:01.291951 20174 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:01.291832 24336 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:01.293351 24336 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:01.293782 24336 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:01.294978 20180 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:01.294791 24336 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.296753 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:01.299062 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.299758 20176 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:01.293377 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.279706 20249 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.308305 20256 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 9. Ops: []
I20260709 12:19:01.309696 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.310061 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:01.311420 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:01.313071 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:01.306246 20172 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:01.317107 24413 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:01.317309 24620 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.318856 20247 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:01.318949 24618 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:01.333835 20180 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:01.334914 20176 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:01.336772 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.342001 20172 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:01.342682 20249 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.343452 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.336549 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:01.346099 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:01.331804 24654 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:19:01.320561 24621 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:01.351238 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:01.322573 24619 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:01.353513 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:01.336274 24620 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:01.298345 24534 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.308414 24599 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:01.371781 20172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:01.407508 20175 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:01.415624 24620 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:01.355144 24364 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 12:19:01.443317 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 170338us
I20260709 12:19:01.369745 24596 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:19:01.387419 24667 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.360204 24577 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:19:01.387624 24336 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.390879 20172 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.484133 20172 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.489346 24368 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:01.489868 24368 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:01.443434 24636 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:19:01.453686 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:01.505244 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 51674.6us
I20260709 12:19:01.506459 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:01.459458 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:01.464902 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:01.471808 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.475292 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:01.514930 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55542.7us
I20260709 12:19:01.441095 24656 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:01.441071 24618 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:01.516453 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:01.494753 24651 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:19:01.502652 20172 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.490903 24368 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.514000 24204 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:01.524223 24621 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:01.514572 24434 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:01.545269 20172 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:01.546346 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 209901us
I20260709 12:19:01.549362 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:01.533474 24479 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:01.532222 24505 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:01.504151 24667 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:01.561290 24661 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:01.571789 24534 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.573868 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:01.585498 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.587868 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.589247 20326 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:01.552520 24620 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.549974 24599 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.547135 24621 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:01.534137 24618 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:01.557680 24489 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.007s
W20260709 12:19:01.618660 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 52770.3us
I20260709 12:19:01.559000 24479 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:01.622349 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 229755us
I20260709 12:19:01.557049 24364 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:01.623185 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:01.563097 24662 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:01.616708 24536 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.620518 24621 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.623004 24368 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:01.640101 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:01.612287 24505 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.637827 24657 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:01.645237 24536 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.635084 24600 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:19:01.624926 24489 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.634675 24264 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:19:01.682331 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:01.643091 24584 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:19:01.636687 24364 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.677139 24671 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:01.679126 24657 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.697888 24667 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.699709 24618 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.700344 24675 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:01.713953 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.695722 24479 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.714990 20171 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:01.712073 24568 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:01.717708 24657 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.730052 24675 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:01.736172 24261 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:01.747591 20252 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
W20260709 12:19:01.749646 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 237540us
I20260709 12:19:01.750506 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:01.737452 24568 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.744153 24261 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.776551 24673 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:01.785562 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:01.786324 20247 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.790414 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:01.743863 24675 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.792587 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:01.793211 20326 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:01.793505 20326 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:01.798975 20325 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:01.782378 24568 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:01.800483 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 284421us
I20260709 12:19:01.794450 20326 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.801306 20326 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:01.802541 21034 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:01.803871 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:01.804560 20327 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:01.797504 24656 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:01.807221 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:01.806051 20247 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:01.815035 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:01.816042 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.817553 20252 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:01.807987 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:01.798738 24598 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:01.819078 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:01.821552 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:01.802623 24489 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.786415 24673 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:01.811993 24317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.007s	sys 0.003s
I20260709 12:19:01.851531 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2672) took 1656 ms. Trace:
I20260709 12:19:01.830441 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:01.830201 24598 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.826535 24413 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:01.826416 24667 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:01.834329 24261 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.834973 24579 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:01.873184 24579 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:01.806654 24675 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:01.852397 24317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.007s	sys 0.003s
I20260709 12:19:01.876708 21039 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:01.839104 24434 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:01.838945 24662 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:01.840325 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:01.845582 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:01.881968 24364 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.882124 24429 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:01.846498 24679 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:01.882818 24429 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.883329 24429 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.803681 24671 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:01.885387 24085 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:01.886036 24085 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:01.888803 24396 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:01.889350 24396 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:01.835027 24529 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 12:19:01.851114 24620 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:19:01.861451 24598 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:01.900874 24364 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:01.901540 24364 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:01.902621 24364 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.906874 24673 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:01.908377 24489 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:01.908921 24489 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:01.909061 24559 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.910358 24559 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:01.911211 24489 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:01.899251 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53750us
I20260709 12:19:01.911736 24618 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:01.913492 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:01.890549 24396 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:01.852545 20179 rpcz_store.cc:276] 0709 12:19:00.195139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.199693 (+  4554us) service_pool.cc:224] Handling call
0709 12:19:00.199997 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.581824 (+381827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.851287 (+1269463us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54002c5954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:01.851467 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876651776}
W20260709 12:19:01.969736 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.009536 24598 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.010354 24598 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.013875 24598 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:02.019825 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 106434us
I20260709 12:19:02.023741 24619 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.024283 24619 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:02.024753 24619 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.035526 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:02.036358 21035 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:02.037959 21035 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:02.022425 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.042791 20326 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:01.887295 24085 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:01.899578 24623 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.006s
I20260709 12:19:02.011329 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1103) took 1180 ms. Trace:
I20260709 12:19:02.056118 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.059398 20174 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:19:02.061683 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:02.062968 21037 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:19:02.049044 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 256428us
I20260709 12:19:02.070833 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:02.071841 21037 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:02.022538 24621 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:02.051759 24336 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.002s
I20260709 12:19:02.069229 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.097007 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.109792 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.101284 21037 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:02.057207 21041 rpcz_store.cc:276] 0709 12:19:00.831405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.863904 (+ 32499us) service_pool.cc:224] Handling call
0709 12:19:00.864419 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.864751 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:00.965404 (+100653us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.010740 (+1045336us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b1800110440. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287
0709 12:19:02.010870 (+   130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.010935 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:02.010995 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.011082 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.011255 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4468,"prepare.queue_time_us":100406,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":28444,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5890,"spinlock_wait_cycles":11723008,"thread_start_us":28317,"threads_started":1}
I20260709 12:19:02.103853 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.107326 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.111362 20330 raft_consensus.cc:2368] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9.
I20260709 12:19:02.111795 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.112578 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.112619 20322 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:02.065220 24413 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.118722 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.048204 24205 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.047902 24662 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:02.126612 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.120455 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.066367 24671 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:02.126649 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.133744 20172 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:01.988291 24529 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.106698 24396 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.100637 24085 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.129514 20256 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:02.116518 24261 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.047288 24618 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.070518 24623 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.118793 24413 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.132206 24205 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:02.212117 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:02.137584 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 316103us
I20260709 12:19:02.200698 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.201495 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:02.211263 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.242959 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.145246 20248 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:02.204593 20252 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.119684 24611 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:02.176316 20179 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:02.247557 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.131552 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.249887 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:02.227409 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1693) took 1082 ms. Trace:
I20260709 12:19:02.257728 20255 rpcz_store.cc:276] 0709 12:19:01.145147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.145388 (+   241us) service_pool.cc:224] Handling call
0709 12:19:02.227021 (+1081633us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54002fd854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:02.227248 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503256320}
W20260709 12:19:02.263387 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62868.3us
W20260709 12:19:02.263532 20294 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.573s (SENT) [suppressed 8 similar messages]
I20260709 12:19:02.264353 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:02.188486 24681 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:19:02.220026 24677 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:19:02.259299 24504 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.274151 24542 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:02.274885 24685 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:19:02.274770 24489 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:02.276814 20252 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:02.139873 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.283625 20180 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:02.179979 24621 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.287889 20325 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:02.266871 24679 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.129906 24479 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:19:02.279317 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.269670 24587 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:02.299007 20329 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:02.303767 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.136802 24662 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.308208 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.313089 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.313491 20323 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:02.310521 20325 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.277415 24205 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.189112 24568 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.259084 24261 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.324785 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3006) took 1094 ms. Trace:
I20260709 12:19:02.317970 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.321918 20250 raft_consensus.cc:2368] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:19:02.296737 24656 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:02.136679 24671 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.144282 24657 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.325296 20171 rpcz_store.cc:276] 0709 12:19:01.230640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.230787 (+   147us) service_pool.cc:224] Handling call
0709 12:19:02.324564 (+1093777us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54000c67d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:02.324721 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090832768}
I20260709 12:19:02.309844 24587 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.343978 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.350975 20329 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:02.351326 20329 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:02.352159 20329 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.352617 24662 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.353216 20329 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:02.353792 24536 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:02.338367 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:02.337911 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 209284us
I20260709 12:19:02.335074 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2687) took 1071 ms. Trace:
I20260709 12:19:02.357738 20175 rpcz_store.cc:276] 0709 12:19:01.263373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.264618 (+  1245us) service_pool.cc:224] Handling call
0709 12:19:01.264905 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.410371 (+145466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.334787 (+924416us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400240ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:02.335000 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327469952}
I20260709 12:19:02.307171 24336 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:02.313288 24689 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:19:02.329252 20325 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:02.346707 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.356580 20330 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:19:02.360517 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:02.363756 20330 pending_rounds.cc:85] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 9
I20260709 12:19:02.364027 20330 pending_rounds.cc:107] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:19:02.361620 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:02.360865 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:02.364306 20330 raft_consensus.cc:2889] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.357256 20253 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 4.
I20260709 12:19:02.334815 24688 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:02.368670 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.304841 24687 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:19:02.369159 20251 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:02.367554 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.370857 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.371555 20323 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:02.372644 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.373304 20323 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:02.374609 20323 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:19:02.374909 20323 pending_rounds.cc:85] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 6
I20260709 12:19:02.375128 20323 pending_rounds.cc:107] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:19:02.375339 20323 raft_consensus.cc:2889] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.376336 24429 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.356756 24587 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:02.380375 24688 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.385540 24688 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:02.385892 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 122374us
I20260709 12:19:02.386584 24413 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.389695 20323 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:02.382879 20329 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:02.391104 20329 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:02.391521 20329 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:02.392571 20329 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.396173 20329 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:02.396502 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.399076 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.380815 24489 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:02.406289 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:02.422447 24144 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.423167 24144 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.424978 24274 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:02.426187 24686 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:02.426723 24686 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:02.428140 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.427779 24686 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.427877 20329 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:02.399927 24679 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.408941 24413 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.423655 24144 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.440109 24342 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:02.369614 24336 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.445434 24596 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:02.435019 20326 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:02.445277 24671 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.448050 24413 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.431308 24686 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.431629 24205 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:02.429508 24623 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:02.450577 24559 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
W20260709 12:19:02.464408 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 185215us
I20260709 12:19:02.465579 20144 leader_election.cc:400] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9.
I20260709 12:19:02.457293 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.466725 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:02.466926 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44926.7us
I20260709 12:19:02.461071 24261 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.470954 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.450305 24342 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:02.452764 24596 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:02.470827 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:02.473873 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.477979 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:02.453293 24542 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:02.479768 24623 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:02.450465 24679 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.485351 24679 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.472728 24657 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.488349 24611 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.488831 24611 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:02.488850 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.489261 24611 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.492815 24413 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.442785 24579 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.465148 24506 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.525135 24506 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.513013 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:02.464318 24205 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.468012 24618 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.453902 24619 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.523187 24342 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.542250 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.516800 24596 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.532442 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.534451 20173 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:02.529089 24542 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:02.548280 24542 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:02.549358 24542 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.550625 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.540527 24579 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:02.556707 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.560222 24504 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.570917 20322 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:02.535205 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.535454 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:02.536484 20172 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:02.583069 20248 raft_consensus.cc:2368] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:02.529618 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:02.583770 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.537995 24205 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:02.543081 24620 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:02.574318 24529 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:02.578387 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 107646us
I20260709 12:19:02.581300 24619 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:02.586378 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 111474us
I20260709 12:19:02.577474 24342 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.593498 24705 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:02.594089 24705 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.596896 24705 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.604338 24336 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.585542 24264 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:02.608623 24531 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.609084 24264 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.609222 24531 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.591305 24620 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:02.612233 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.613121 20329 raft_consensus.cc:2410] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:19:02.612717 24620 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.534642 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.508191 20324 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
W20260709 12:19:02.583884 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54353.2us
W20260709 12:19:02.583901 24690 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.324s	user 0.002s	sys 0.003s
I20260709 12:19:02.564096 24676 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:02.565512 24506 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.584872 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3015) took 1816 ms. Trace:
I20260709 12:19:02.643031 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:02.643386 20328 rpcz_store.cc:276] 0709 12:19:00.768401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.822965 (+ 54564us) service_pool.cc:224] Handling call
0709 12:19:00.823343 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.842255 (+ 18912us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:02.335344 (+1493089us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b18004183c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf 00007f5ddaf12038
0709 12:19:02.413231 (+ 77887us) log.cc:844] Serialized 14 byte log entry
0709 12:19:02.584480 (+171249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:02.584538 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:02.584589 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.584707 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:02.584813 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22891,"prepare.queue_time_us":24290,"prepare.run_cpu_time_us":5288,"prepare.run_wall_time_us":102776,"raft.queue_time_us":26231,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":15276,"spinlock_wait_cycles":16505728,"thread_start_us":234208,"threads_started":2,"wal-append.queue_time_us":174195}
I20260709 12:19:02.647856 24676 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.630100 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.626053 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.649552 20325 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:02.632061 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.651053 24676 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.652558 24619 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:02.657831 24505 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.659864 20253 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:02.660938 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:02.661969 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:02.662588 20253 raft_consensus.cc:2368] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:02.642444 24611 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.648420 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 981) took 1179 ms. Trace:
I20260709 12:19:02.642267 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:02.673346 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.665155 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.663244 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:02.669056 20256 rpcz_store.cc:276] 0709 12:19:01.468836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.471539 (+  2703us) service_pool.cc:224] Handling call
0709 12:19:02.648252 (+1176713us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003d86d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:02.648359 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425261952}
I20260709 12:19:02.611438 24531 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:02.694870 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.622859 24542 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:02.698596 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.696681 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.699971 20179 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:02.700650 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.701460 20176 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:02.698099 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.702251 20174 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:02.702920 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.703943 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:02.704433 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.699820 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:02.710393 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 175850us
I20260709 12:19:02.711529 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.711460 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2704) took 1360 ms. Trace:
I20260709 12:19:02.714224 20180 rpcz_store.cc:276] 0709 12:19:01.350865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.358992 (+  8127us) service_pool.cc:224] Handling call
0709 12:19:01.381088 (+ 22096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:02.297633 (+916545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.711232 (+413599us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54002c4554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:02.711401 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074943872}
I20260709 12:19:02.715521 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.712289 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.716735 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.719645 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.719830 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.720315 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.722174 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.723716 24505 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.723997 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.727245 24504 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.727659 24600 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:02.697398 24686 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:02.729105 24686 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.730108 24504 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:02.733038 24611 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:02.732779 24587 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.733939 20252 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:02.716748 24688 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.737653 24504 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:02.739017 24688 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:02.739367 24618 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:02.739818 24618 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:02.740136 24688 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:02.740542 24688 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:02.740727 24618 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.731302 24686 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.746084 20144 leader_election.cc:400] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:02.750396 20144 leader_election.cc:403] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:02.752976 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.754997 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.757375 20255 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:19:02.757797 20255 pending_rounds.cc:85] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 9
I20260709 12:19:02.757611 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.758119 20255 pending_rounds.cc:107] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:19:02.758363 20255 raft_consensus.cc:2889] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.758471 20180 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:19:02.753649 20256 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:02.734957 24587 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.761341 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.698844 24542 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:02.764186 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.765987 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:02.710976 24261 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:02.741407 24688 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:02.769790 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.767372 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:02.773873 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:02.774101 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.774525 20171 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.774513 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.776799 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.766414 24619 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.781234 20173 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:02.767194 24355 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:02.770625 24542 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.749070 24205 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.782110 24700 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.799727 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.808853 24274 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:02.809801 24261 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:02.736912 24144 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.804145 20171 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:19:02.804953 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.806017 24675 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:02.811041 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47718us
I20260709 12:19:02.812438 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.818022 24686 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:02.818446 24686 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.818799 24686 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.829236 24264 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:02.830204 24396 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:02.833596 24611 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:02.840109 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:02.841121 20173 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:02.842341 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:02.844234 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1134) took 1045 ms. Trace:
I20260709 12:19:02.844691 24506 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:02.846029 24396 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:02.846261 24549 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:02.846464 24396 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:02.846766 24549 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:02.846968 24396 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.844802 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.847798 24549 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:02.849059 24536 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:02.844662 21039 rpcz_store.cc:276] 0709 12:19:01.799126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.799306 (+   180us) service_pool.cc:224] Handling call
0709 12:19:01.799631 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.877185 (+ 77554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.843977 (+966792us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54005da054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:02.844174 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176490240}
I20260709 12:19:02.849439 24536 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.850199 24536 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:02.849330 24549 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.852785 24700 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:02.853816 24675 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:02.854533 24429 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.855465 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1702) took 1039 ms. Trace:
I20260709 12:19:02.855875 20250 rpcz_store.cc:276] 0709 12:19:01.816526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.816683 (+   157us) service_pool.cc:224] Handling call
0709 12:19:02.855270 (+1038587us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54001013d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:02.855405 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076482816}
I20260709 12:19:02.862821 24688 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:02.895638 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:02.879702 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.898867 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:02.891846 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47127.9us
I20260709 12:19:02.893965 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.894570 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.881928 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:02.912376 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.912623 20247 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.896052 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.913378 20324 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:02.914633 20173 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:02.914790 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.878768 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.920078 20330 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:02.895221 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.921847 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.923262 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:02.923647 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.932610 20327 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:02.798516 24568 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:02.934310 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55631.7us
I20260709 12:19:02.938969 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.940274 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:02.942656 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:02.962046 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:02.962865 20173 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.872073 24618 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.880918 24596 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.974751 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:02.919255 24676 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.942386 24673 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:02.948825 24611 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:02.963784 24705 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.943897 24429 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:02.988050 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47889.9us
I20260709 12:19:02.947660 24261 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:02.962744 24085 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:02.984994 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:02.998265 20327 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.990711 20144 leader_election.cc:400] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:19:03.000339 20144 leader_election.cc:403] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:02.996032 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:02.890728 24536 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.020421 24144 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:02.987936 24672 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:02.990027 24620 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:03.022576 24672 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:03.022609 24620 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.023830 24672 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.025046 24620 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:02.992494 20074 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 9 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.027688 20074 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:03.028417 24396 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.009436 24693 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:03.010345 20075 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 310) took 15803 ms (client timeout 15000 ms). Trace:
I20260709 12:19:03.034812 20175 raft_consensus.cc:2410] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:03.010456 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:02.992753 24587 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:03.011776 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:02.984565 24687 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:19:03.013626 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:03.031200 20074 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 7 to 8, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
W20260709 12:19:03.015040 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.014886 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:02.993764 20247 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:03.014075 24698 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.017496 24675 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:03.030912 24693 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:03.038123 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.040860 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:03.013206 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:03.063445 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48647.8us
I20260709 12:19:03.059899 20074 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 2 to 5, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 5 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.065034 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.053064 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:03.057348 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:03.073952 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:03.050514 20248 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:03.035791 24680 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7.
I20260709 12:19:03.090137 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:03.089205 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.092767 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:03.031742 20075 rpcz_store.cc:269] 0709 12:18:47.195240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.195499 (+   259us) service_pool.cc:224] Handling call
0709 12:19:02.998877 (+15803378us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:59.684265 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:59.816281 (+132016us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:59.816356 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:18:59.816387 (+    31us) tablet.cc:662] Decoding operations
0709 12:18:59.944012 (+127625us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:59.958785 (+ 14773us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:59.959744 (+   959us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:19:00.087735 (+127991us) tablet.cc:701] Row locks acquired
0709 12:19:00.087798 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:19:00.088007 (+   209us) write_op.cc:270] Start()
0709 12:19:00.088148 (+   141us) write_op.cc:276] Timestamp: P: 1783599540087939 usec, L: 0
0709 12:19:00.088171 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:19:00.147216 (+ 59045us) log.cc:844] Serialized 2583 byte log entry
0709 12:19:00.232035 (+ 84819us) op_driver.cc:464] REPLICATION: finished
0709 12:19:00.364247 (+132212us) write_op.cc:301] APPLY: starting
0709 12:19:00.370561 (+  6314us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:00.706718 (+336157us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:00.706843 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:00.718317 (+ 11474us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:00.780338 (+ 62021us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:19:00.780404 (+    66us) write_op.cc:312] APPLY: finished
0709 12:19:00.780775 (+   371us) log.cc:844] Serialized 65 byte log entry
0709 12:19:00.780996 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:00.781142 (+   146us) write_op.cc:454] Released schema lock
0709 12:19:00.781209 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:00.781730 (+   521us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:00.781769 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2962682,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":94254,"apply.run_cpu_time_us":18095,"apply.run_wall_time_us":452601,"cfile_cache_hit":22,"cfile_cache_hit_bytes":23023,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":121060,"lbm_reads_1-10_ms":4,"lbm_reads_10-100_ms":3,"lbm_reads_lt_1ms":5,"num_ops":6,"prepare.queue_time_us":219343,"prepare.run_cpu_time_us":7162,"prepare.run_wall_time_us":507737,"replication_time_us":143694,"thread_start_us":183392,"threads_started":2}]]}
I20260709 12:19:03.060449 24675 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:03.096800 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 105494us
I20260709 12:19:03.060835 24587 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:03.103348 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.105116 20294 leader_election.cc:400] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:03.101130 24559 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:03.089205 24600 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.105592 20294 leader_election.cc:403] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:03.105402 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.091742 24144 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:03.098357 24274 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:03.099709 24674 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:03.119791 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:03.125830 20326 raft_consensus.cc:606] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.065034 24698 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:03.142967 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 108045us
I20260709 12:19:03.145597 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.151988 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.100291 24542 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.126945 24672 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:03.129618 24693 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:03.131876 24669 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:03.133193 24429 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:03.126842 24505 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.112547 24396 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:03.118120 24205 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:03.104205 24675 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:03.158181 20173 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:03.124523 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.166862 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:03.155704 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.145671 24674 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:03.151489 24657 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:03.155258 24656 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.139385 24559 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:19:03.188961 20179 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:03.192498 20074 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 5 to 6, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 6 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.209779 20254 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:03.194113 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.197007 20180 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:19:03.199461 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75071.6us
I20260709 12:19:03.181169 24429 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:03.235724 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:03.204185 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87656.1us
I20260709 12:19:03.211341 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.214877 24698 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:03.182626 24700 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:19:03.223506 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:03.247664 20326 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:03.248051 20326 raft_consensus.cc:614] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:03.227391 24536 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:03.233634 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:03.241739 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:03.196915 24678 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:03.251507 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57478.5us
I20260709 12:19:03.255541 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:03.256685 20327 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:03.248991 20248 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:03.263089 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:03.206456 24205 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.207383 24619 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:03.170694 24587 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.267822 20325 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:03.281823 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:03.246737 24531 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.279728 24674 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.283351 20177 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:03.285379 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:03.260051 24577 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:03.263593 24434 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.320569 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:03.322363 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:03.355863 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:03.358052 24549 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.506s	user 0.000s	sys 0.011s
I20260709 12:19:03.246961 24686 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.369891 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:03.371207 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:03.371941 21036 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:03.372787 21035 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:03.374202 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:03.379355 24660 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:03.380676 24660 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:03.380875 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:03.381225 24660 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:03.382413 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.382534 24660 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.383258 24679 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.384156 24660 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:03.389623 24542 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:03.390416 24727 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.391037 24727 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.393474 24727 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:03.397783 20327 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:19:03.397859 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:03.398684 20330 raft_consensus.cc:606] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:03.292326 24680 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.396762 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:03.404129 21034 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
W20260709 12:19:03.408967 24726 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:19:03.412708 20323 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:03.423084 24673 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:03.360173 24688 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.289289 24657 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:19:03.439695 21041 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:19:03.446069 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:03.443969 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61219.6us
I20260709 12:19:03.401336 24663 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:03.457260 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:03.459683 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:03.459867 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:03.460362 20330 raft_consensus.cc:606] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:03.460716 24673 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:03.461164 24673 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:03.461539 24673 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:03.461575 24536 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:03.423851 24705 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:03.460747 20330 raft_consensus.cc:614] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:03.466781 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.412091 24680 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.484040 24599 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:03.438983 24688 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.517009 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:03.485579 24596 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.480348 24536 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:03.511000 20330 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:03.512821 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:03.599293 20329 raft_consensus.cc:2368] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:03.517398 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:03.600240 20175 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:03.600103 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79912.3us
I20260709 12:19:03.514199 20328 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:19:03.599330 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.601835 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:03.601874 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:03.603047 20330 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
W20260709 12:19:03.594367 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.607281 20330 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:19:03.619984 24737 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:19:03.620142 20329 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:03.615044 24735 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.621204 24735 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.622424 24730 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:03.623036 24730 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.593614 24542 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:03.626701 24542 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.629469 24542 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:03.619035 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:03.467854 24663 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:03.638949 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 228623us
I20260709 12:19:03.640450 20329 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:03.660105 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:03.660873 20329 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:03.663921 24505 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:03.605055 24599 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:03.665565 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:03.667522 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 74180.1us
I20260709 12:19:03.674806 20329 raft_consensus.cc:2376] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7. Re-sending same reply.
I20260709 12:19:03.678196 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:03.688004 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:03.689975 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:03.709121 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:03.710341 20330 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:03.716425 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:03.732606 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:03.733819 20179 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:03.740867 20326 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:19:03.616178 24596 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.683912 24205 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:03.659969 24504 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:19:03.640858 24724 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
W20260709 12:19:03.752333 24719 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:19:03.679750 24542 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
W20260709 12:19:03.753801 24737 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:19:03.754303 24686 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:03.777429 24713 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:19:03.786993 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 110621us
I20260709 12:19:03.787043 24205 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.813234 24705 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:03.827287 24672 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.007s
I20260709 12:19:03.779887 24536 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.804664 24599 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:03.884609 24738 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:19:03.895020 24660 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.003s
I20260709 12:19:03.900669 24596 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:03.895447 24734 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.325s	user 0.006s	sys 0.000s
W20260709 12:19:03.917963 24741 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:19:03.918462 24730 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:03.930315 24735 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:03.932454 24429 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:03.934249 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.935767 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3040) took 1042 ms. Trace:
I20260709 12:19:03.964813 20323 rpcz_store.cc:276] 0709 12:19:02.893516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.893679 (+   163us) service_pool.cc:224] Handling call
0709 12:19:03.935443 (+1041764us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54000ce754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:03.935670 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146482048}
I20260709 12:19:03.883910 24672 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:03.945099 24663 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:03.860198 24688 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:03.950067 24205 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:03.884809 24680 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:03.896870 24568 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:03.969871 24568 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.972342 24568 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:03.854766 24705 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:03.974442 24705 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:03.886241 24736 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:03.975203 24736 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.977537 24736 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:03.952376 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 217121us
I20260709 12:19:03.979079 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:03.884640 24740 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:03.952978 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 151188us
I20260709 12:19:03.983843 24742 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.983475 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:03.983901 24740 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:03.989993 24740 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:03.991614 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:03.992558 20325 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:03.993160 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:03.993914 20327 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:03.995414 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:04.012641 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.010764 24740 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:04.065932 24700 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:04.069839 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 71998.7us
I20260709 12:19:04.074753 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:04.011173 24688 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.072060 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.007988 24746 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:04.015916 24756 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.016929 24542 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:04.106096 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.109499 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.082937 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:04.182384 21042 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:19:04.184449 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 101647us
I20260709 12:19:04.170259 24746 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.013850 24505 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 12:19:04.080363 24740 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.186924 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:04.182672 24738 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:19:04.194564 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:04.194947 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.198199 20325 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:19:04.185616 24741 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:19:04.183205 24536 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:04.200304 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 125666us
W20260709 12:19:04.201617 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 186193us
I20260709 12:19:04.118371 24542 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.204015 20144 leader_election.cc:400] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
W20260709 12:19:04.199033 24673 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.002s
I20260709 12:19:04.088766 24688 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.186348 24742 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:04.183457 24756 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.199921 24735 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:04.212755 24542 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.200564 24740 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.182075 24759 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:19:04.202596 24536 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:04.243630 24770 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:04.243980 24772 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:04.246527 24756 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.249665 24688 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:04.252163 24675 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.052s	user 0.014s	sys 0.000s
I20260709 12:19:04.271751 24536 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:04.204308 24680 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:19:04.199385 24746 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.221624 24673 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.443933 20327 raft_consensus.cc:2376] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10. Re-sending same reply.
W20260709 12:19:04.466712 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 261708us
I20260709 12:19:04.467125 24355 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.435863 24759 consensus_queue.cc:1243] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:04.444458 24657 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.464221 24771 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:04.424990 24656 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.479310 24355 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.480404 24657 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.464375 24736 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.444458 24660 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.493039 24355 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:04.496075 24396 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:04.510740 24396 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:04.508056 24679 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.511884 24396 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.512323 24679 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.513221 24396 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.514508 24679 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.496832 24736 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.508064 24264 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.516383 24264 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.499655 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.499761 24542 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.517860 21034 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:04.522011 24673 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.523242 24740 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.501091 24657 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:04.524127 24761 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.437s	user 0.000s	sys 0.003s
I20260709 12:19:04.525709 24768 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:04.443101 24770 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.445047 24772 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:04.531503 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.479332 24771 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:04.501456 24618 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.488272 24656 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.504719 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.449151 24675 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.509644 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.562386 24771 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.525857 24619 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.559587 24618 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.563606 24619 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.565703 24619 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.500159 24536 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.546682 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.547855 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1725) took 1090 ms. Trace:
I20260709 12:19:04.550343 21034 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:04.556559 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.509532 24660 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.566915 20255 rpcz_store.cc:276] 0709 12:19:03.457499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.458500 (+  1001us) service_pool.cc:224] Handling call
0709 12:19:03.458859 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:03.482461 (+ 23602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:03.482496 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:03.483134 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 12:19:03.894392 (+411258us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:03.896365 (+  1973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:03.896500 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.523765 (+627265us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b2400142358. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9 00007f5dd7e4aa55 00007f5dd7e4a09d 00007f5ddaa7c10e 00007f5ddaa9388c 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221
0709 12:19:04.545548 (+ 21783us) raft_consensus.cc:1685] finished
0709 12:19:04.545571 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.547784 (+  2213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52511,"raft.queue_time_us":24993,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3777,"spinlock_wait_cycles":4135680,"thread_start_us":409616,"threads_started":1,"wal-append.queue_time_us":527332}
W20260709 12:19:04.559665 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55052.5us
I20260709 12:19:04.562963 24542 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.563841 24771 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:04.570272 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.571143 20325 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:19:04.566569 20324 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:04.501075 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.572722 20328 raft_consensus.cc:606] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.573195 20328 raft_consensus.cc:614] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:04.527225 24768 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:19:04.567162 24577 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:04.575129 24542 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.575538 24736 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.575992 24536 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.575693 24542 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.577831 21041 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:04.577915 24660 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.566184 24618 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.578783 24618 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:04.578931 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.578457 24542 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.581741 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:04.582418 20325 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:04.583088 24620 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.585309 24264 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:04.586453 24767 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:19:04.587913 24675 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.579332 24618 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.589058 24724 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.589600 24724 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.592237 24620 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.592733 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3018) took 1820 ms. Trace:
I20260709 12:19:04.593253 20180 rpcz_store.cc:276] 0709 12:19:02.772071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.772192 (+   121us) service_pool.cc:224] Handling call
0709 12:19:02.782975 (+ 10783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:03.210748 (+427773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.592430 (+1381682us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002378d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:04.592657 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951172864}
I20260709 12:19:04.594305 24620 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.579314 24751 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:04.594997 24751 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:04.575690 20251 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:04.596750 24751 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.597864 24751 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:04.598686 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:04.600044 24675 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:04.600528 24675 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.600899 24675 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.600165 24757 raft_consensus.cc:993] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:19:04.603555 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:04.617605 24705 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.638856 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:04.639855 20180 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:04.624373 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:04.595407 24618 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.620555 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:04.642442 20172 raft_consensus.cc:2410] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:04.656384 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:04.657048 20172 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:04.660267 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:04.616003 24505 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.668524 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:04.637693 24603 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.671387 20180 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:04.641496 24264 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.642445 24774 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.658684 24757 raft_consensus.cc:1081] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:19:04.688117 24693 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:04.666097 24618 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:04.699383 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 225313us
I20260709 12:19:04.700549 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:04.711422 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.645295 24705 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:04.718918 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.722605 24551 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:04.723364 24551 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.724193 24656 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.725598 24551 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.722829 24660 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.727437 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:04.683331 24770 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:04.734005 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86730.2us
I20260709 12:19:04.675572 24505 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.735651 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:04.738248 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.741477 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:04.741649 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.742908 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.743434 20255 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:19:04.743909 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.744948 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.745436 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.746786 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.747318 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.748615 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.750242 24551 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:04.750655 24771 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:04.750249 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.722596 24746 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:04.755856 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.685331 24264 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.681111 24603 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.752146 20249 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:04.752067 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:04.753261 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:04.754532 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 99953.9us
I20260709 12:19:04.756736 20256 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:04.765869 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.729998 24776 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:04.768726 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.770534 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:04.700085 24774 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.706105 24618 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.771744 20329 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:04.734790 24656 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:04.776777 24656 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.777202 24705 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:04.775120 24771 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:04.778597 24771 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.771934 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:04.780728 21042 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:04.732631 24660 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.769754 21037 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:04.773947 24783 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:04.772106 24776 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.802695 24746 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.803285 24746 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.803988 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.804564 20330 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:04.804785 20321 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:04.774147 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:04.769842 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.776197 24780 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:04.772622 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.759312 24775 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:04.786401 24783 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:04.789193 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57336 (request call id 61) took 1187 ms. Trace:
I20260709 12:19:04.793367 24656 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.794124 24505 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.796411 21037 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:04.806634 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:04.808300 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.812078 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.789256 24587 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:04.817694 20325 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:04.820971 20328 rpcz_store.cc:276] 0709 12:19:03.601586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.601721 (+   135us) service_pool.cc:224] Handling call
0709 12:19:04.788989 (+1187268us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54003ad4d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef2853 00007f5ddfec060a 00007f5dd94467d4 00007f5dd9446762 00007f5dd9446691 00007f5dd944660c 00007f5dd94458c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:04.789098 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231131008}
I20260709 12:19:04.775506 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:04.832145 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.983805 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:04.984447 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 208895us
I20260709 12:19:04.984942 20322 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:19:04.985335 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 66447.6us
I20260709 12:19:04.827752 20321 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:04.832676 20329 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:19:04.813668 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:04.989210 20330 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:04.989687 24700 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:19:04.839036 24264 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.820181 24317 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:04.839655 24531 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:04.814196 24599 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:04.996078 24599 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:04.838950 24603 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:04.841894 24618 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.834239 24660 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.852569 24675 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.840306 24693 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:04.957202 24680 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:05.002692 24680 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.004690 24675 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.005726 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2223) took 1733 ms. Trace:
I20260709 12:19:05.006616 24680 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.863528 24724 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.008188 24599 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:04.832541 24746 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.834121 24774 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:04.806536 24776 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:05.011068 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 785) took 1765 ms. Trace:
I20260709 12:19:05.011596 20324 rpcz_store.cc:276] 0709 12:19:03.245173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.245395 (+   222us) service_pool.cc:224] Handling call
0709 12:19:03.245725 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.572350 (+1326625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.010455 (+438105us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003ad4d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:05.010822 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037229440}
I20260709 12:19:04.813889 24779 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.814913 24780 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:05.017444 24551 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.815235 24783 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:04.819343 24784 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.034845 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:04.971391 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.036116 21042 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:04.975541 24742 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.981012 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:04.976125 24577 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:04.989276 20177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3014) took 2213 ms (client timeout 1658 ms). Trace:
I20260709 12:19:05.037850 24577 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:04.990530 24700 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:04.992164 24317 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:05.009093 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.006326 20252 rpcz_store.cc:276] 0709 12:19:03.272060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.272210 (+   150us) service_pool.cc:224] Handling call
0709 12:19:03.272510 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.583794 (+1311284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.583828 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:04.583870 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:04.583900 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.005045 (+421145us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001973d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:05.005137 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:05.005426 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3015181568}
I20260709 12:19:05.017524 24780 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.033427 24693 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:04.846980 24587 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.060127 24551 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.062413 24587 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.034878 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.064007 24599 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:05.064934 24599 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.065918 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.067138 20254 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:05.067410 24771 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.068413 24577 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.068383 24771 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.070019 24551 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.074101 24772 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.074993 24772 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.017508 24785 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:05.038573 20177 rpcz_store.cc:269] 0709 12:19:02.767390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.768300 (+   910us) service_pool.cc:224] Handling call
0709 12:19:04.897878 (+2129578us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54000bf754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:04.980374 (+ 82496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179267456}
W20260709 12:19:05.053745 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.053500 24693 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.083336 24693 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.088896 24771 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.055492 24317 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:05.095815 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 109208us
I20260709 12:19:05.097172 24623 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.097826 24623 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.098408 24623 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.037405 24742 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.112574 24742 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.033577 24783 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.035830 24784 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.118031 24772 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.120882 24784 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.118109 24783 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.017793 24779 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.121299 24785 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:05.128486 24429 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.131012 24779 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.060635 24700 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.139412 24599 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:05.144742 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.148334 24549 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:05.149787 24549 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:05.150188 24549 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:05.144510 24771 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.153752 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.152309 24774 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.169354 24774 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.170733 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.171926 24742 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:05.172484 24742 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.173003 24742 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.153292 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.176192 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.162734 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.144449 24772 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.178010 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.151885 24504 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.194551 24675 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:05.195138 24675 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.195649 24675 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.195163 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 632) took 1086 ms. Trace:
I20260709 12:19:05.200409 21041 rpcz_store.cc:276] 0709 12:19:04.108916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.109115 (+   199us) service_pool.cc:224] Handling call
0709 12:19:05.191410 (+1082295us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54004ad154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:05.194948 (+  3538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075286784}
I20260709 12:19:05.202951 24504 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.201785 24779 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.205363 24779 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.207085 24504 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.208668 24779 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.151692 24785 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.211519 24774 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.216194 24673 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:05.216696 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 56438.3us
I20260709 12:19:05.216501 24675 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.220111 20249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:19:05.259300 20249 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:19:05.224153 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.226140 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.228235 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.156518 24771 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.151547 24549 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.221273 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.259824 20249 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.261898 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.215124 24317 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.257578 24673 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.271801 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.275846 24678 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.277050 24317 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.276815 24678 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.285152 24675 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:05.285730 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.287899 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.288960 21037 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:05.289222 24771 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.273097 24673 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.252689 24776 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:05.302958 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.303040 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.309094 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:05.310313 20323 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:05.306607 24577 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:05.318337 20249 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.320889 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.327296 24746 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.327765 20249 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.328150 24746 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:05.334921 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:05.347020 24144 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:05.348264 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:05.349359 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.325688 24742 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.362586 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.370471 20177 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.354519 24678 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.368708 24144 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.376248 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.381639 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.382732 21042 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:05.383739 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.385756 20327 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
W20260709 12:19:05.389355 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 51042us
I20260709 12:19:05.392977 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:05.367630 24577 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.397723 21037 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:19:05.404119 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.404564 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.409693 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.411312 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.414100 21042 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.418711 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:05.420652 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 72619.5us
I20260709 12:19:05.399883 24599 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.423373 24599 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.427070 24746 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:05.428505 24599 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.428920 24549 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:05.411216 24780 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.437881 24780 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.439275 20180 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:05.439332 24791 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:19:05.413332 24779 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.445593 20250 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:05.444921 24779 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.451687 24776 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.419405 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:05.455989 24792 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:19:05.456739 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.458256 24577 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:05.459384 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:05.460143 24429 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.460632 24429 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.461131 24429 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.463909 24783 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:05.464375 24783 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.464767 24783 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:05.466531 24742 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.451936 24779 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.483840 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.484675 20177 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:05.486495 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.486994 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.489135 20179 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:05.492542 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.493263 21043 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:05.497588 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.498440 20172 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.507026 20180 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:05.509112 21039 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:05.510699 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.514294 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.516108 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:05.522059 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 64198.7us
I20260709 12:19:05.528560 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.525898 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.536556 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.529795 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:05.538501 24746 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:05.540800 20172 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:05.547605 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.544895 24742 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:05.553767 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.554018 24742 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:05.540186 24746 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:05.551062 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.555498 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.557587 24144 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:05.564112 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:05.554641 20256 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:05.566290 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.567207 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:05.570212 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.570837 20254 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:05.567855 24144 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:05.576236 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.575969 24144 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.545362 24673 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.551121 24599 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.577193 21042 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:05.578486 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.585141 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.585233 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.588004 24669 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.588450 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.587733 20076 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.588610 24669 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.591140 24669 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.591748 24317 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.592409 24317 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.593169 24673 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:05.593851 24673 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.594411 24673 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.594805 24317 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:05.595817 21041 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:05.550820 24623 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.580972 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.584990 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:05.579128 24785 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:05.604775 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:05.590473 20076 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 10, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:05.605420 21041 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.606166 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.606920 21043 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:05.609510 24771 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:05.610190 24771 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.612346 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:05.607620 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.614049 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:05.614710 21038 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:05.619370 20324 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:05.619762 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.619791 20324 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:05.622967 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.623266 24577 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:05.626325 21043 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:05.626331 24599 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.627823 20252 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:05.629292 24599 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:05.629606 20074 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 318) took 25610 ms (client timeout 15000 ms). Trace:
I20260709 12:19:05.632057 20253 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:05.611681 24742 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.636332 20324 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.637923 24746 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.638543 20324 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:05.639942 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55182.4us
I20260709 12:19:05.640949 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.637142 24434 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.642709 24434 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.643265 24559 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:05.643743 24559 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.644155 24559 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:05.647666 24434 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.653827 24434 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:05.630044 20074 rpcz_store.cc:269] 0709 12:18:40.018728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.020751 (+  2023us) service_pool.cc:224] Handling call
0709 12:19:05.629250 (+25608499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:03.272440 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:03.273149 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:03.273192 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:19:03.273213 (+    21us) tablet.cc:662] Decoding operations
0709 12:19:03.273983 (+   770us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:03.274052 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:03.274083 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:19:03.274667 (+   584us) tablet.cc:701] Row locks acquired
0709 12:19:03.274688 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:19:03.274855 (+   167us) write_op.cc:270] Start()
0709 12:19:03.275002 (+   147us) write_op.cc:276] Timestamp: P: 1783599543274801 usec, L: 0
0709 12:19:03.275029 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:19:03.358823 (+ 83794us) log.cc:844] Serialized 2084 byte log entry
0709 12:19:04.252882 (+894059us) op_driver.cc:464] REPLICATION: finished
0709 12:19:04.481729 (+228847us) write_op.cc:301] APPLY: starting
0709 12:19:04.483224 (+  1495us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:04.515184 (+ 31960us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:04.515282 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:04.533157 (+ 17875us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:04.533368 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:19:04.533416 (+    48us) write_op.cc:312] APPLY: finished
0709 12:19:04.533667 (+   251us) log.cc:844] Serialized 57 byte log entry
0709 12:19:04.559864 (+ 26197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:04.568545 (+  8681us) write_op.cc:454] Released schema lock
0709 12:19:04.590603 (+ 22058us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:04.591130 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:04.591179 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36278,"reported_tablets":46,"spinlock_wait_cycles":61696,"child_traces":[["op",{"apply.queue_time_us":214822,"apply.run_cpu_time_us":8624,"apply.run_wall_time_us":114459,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":45238,"prepare.run_cpu_time_us":23945,"prepare.run_wall_time_us":491324,"raft.queue_time_us":332236,"raft.run_cpu_time_us":24074,"raft.run_wall_time_us":200374,"replication_time_us":977665,"thread_start_us":667529,"threads_started":4,"wal-append.queue_time_us":470181,"wal-append.run_cpu_time_us":103283,"wal-append.run_wall_time_us":1703351}]]}
I20260709 12:19:05.655529 20076 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:05.659792 24776 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.641996 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:05.660509 24776 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.661317 24675 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.660843 20076 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:05.670686 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.671449 20171 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:05.672676 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.672506 20076 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.673869 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.674433 20171 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.674753 20076 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.676266 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.677124 20252 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:05.678982 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.680871 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.682335 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.611886 24785 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:05.683314 24785 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:05.683709 20076 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.685504 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:05.662622 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.662873 24776 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.664049 24771 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.664412 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.705559 20172 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:19:05.705921 20171 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:05.666246 20174 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:05.666415 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.707053 20177 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:19:05.667434 20176 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:05.668591 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.669703 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.670291 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.685751 21041 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:05.686815 20180 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:05.661914 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:05.685573 20076 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:19:05.702219 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.665846 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.718473 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.720877 20076 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 10, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 10 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.729974 20076 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 10 to 11, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:05.737823 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.734690 20173 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:05.741122 20324 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:05.741346 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.738900 20175 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:05.749243 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.750288 20178 raft_consensus.cc:2368] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:05.750919 24434 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:05.751184 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.752724 20076 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.755079 20076 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 10, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 10 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.756218 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:05.759337 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.760562 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.761530 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.762238 20174 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:05.760617 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.763015 20172 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:05.764719 20180 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:05.765404 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:05.765908 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 104094us
I20260709 12:19:05.706180 24783 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.766237 20172 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:05.722186 24678 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:19:05.767772 20076 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 7 to 10, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 10 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.744747 24675 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:05.769331 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.769469 24675 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.769531 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:05.770219 24675 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:05.772358 24669 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:05.772646 24675 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:05.773849 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.768695 20176 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:05.775619 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.776226 20174 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:05.776490 24783 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.721611 24599 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:05.778263 24623 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.778903 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.778998 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.779163 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.780128 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.710702 24429 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.780874 20174 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:05.785998 20175 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:19:05.786377 20175 pending_rounds.cc:85] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 4
I20260709 12:19:05.788030 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.788309 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:05.789283 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:05.791482 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 173813us
I20260709 12:19:05.786586 20175 pending_rounds.cc:107] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:19:05.794006 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.794245 20175 raft_consensus.cc:2889] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:05.792737 20076 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 2 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 4 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.788105 24673 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:05.797681 20248 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:05.797220 20250 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:05.800745 20076 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:05.819576 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63564.2us
I20260709 12:19:05.804500 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.857795 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.810168 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.858826 20326 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:05.792411 24678 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:05.864629 24678 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:05.865917 24678 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:05.801496 24144 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.866945 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.867645 24144 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:05.870172 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.809682 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.873966 20323 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:05.868822 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:05.866456 20325 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:19:05.794052 24785 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:05.883924 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 116472us
I20260709 12:19:05.886462 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:05.885058 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.895962 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:05.898134 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 70933.3us
I20260709 12:19:05.902232 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:05.917068 24144 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:05.920622 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.898034 24746 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:05.901997 24549 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.924171 24549 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.924605 24549 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.927587 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.928552 20179 raft_consensus.cc:2368] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:05.930146 24317 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:05.929904 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.931324 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.916836 24429 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:05.931545 24599 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:05.934412 24783 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.934552 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.934686 24599 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:05.934871 24783 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.935417 24783 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.932734 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:05.936560 20178 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:05.936054 24599 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.937779 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:05.938372 20175 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:05.939960 24779 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:05.940457 24779 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.941020 24779 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:05.935487 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:05.967386 20175 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:05.970887 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:05.976431 24768 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.976997 24768 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.977425 24768 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.970757 24559 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:05.979704 24434 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:05.980283 24434 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:05.980783 24434 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.985201 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:05.986012 21041 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:05.989080 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:05.990226 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59473.1us
I20260709 12:19:05.989581 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:05.995898 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:05.997764 20325 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:19:06.001451 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:06.004563 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.005142 21042 raft_consensus.cc:2368] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:06.006228 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.007390 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.007839 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.013962 21038 raft_consensus.cc:2368] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:05.975286 24549 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.013098 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.016861 20330 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:06.019309 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:06.003821 24429 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:06.030618 24678 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.033484 24678 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:06.034794 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53055.9us
I20260709 12:19:06.026678 24559 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:06.080772 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 67940.4us
I20260709 12:19:06.089227 24809 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:06.093631 21041 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:06.094527 21035 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:06.094774 24317 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:06.081202 24805 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:19:06.095480 24317 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.069900 24675 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:06.111769 20175 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:06.122782 21035 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:19:06.128396 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61740.7us
I20260709 12:19:06.129518 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.135663 24317 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.135864 24808 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:06.136750 24808 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.138298 24549 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:06.142133 20329 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:06.148772 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:06.151635 24804 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:19:06.152976 24434 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.155324 24434 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.106004 24746 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:19:06.157071 24783 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.139833 24675 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:19:06.161294 24783 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.083351 24429 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.168298 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:06.184340 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 179272us
I20260709 12:19:06.187826 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:06.139166 24808 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:06.203980 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74664.2us
I20260709 12:19:06.205452 24819 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.213430 24429 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.216665 24785 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.191818 24783 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:06.227972 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.234807 24812 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:06.235152 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.237084 20219 leader_election.cc:400] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:06.237449 20219 leader_election.cc:403] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:06.239372 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.240439 24678 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.241068 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.241464 24796 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:06.241926 24796 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:06.242760 24796 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:06.234869 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86300.8us
I20260709 12:19:06.245698 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:06.252651 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:06.254429 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:06.255221 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:06.256441 20176 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:06.220417 24783 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:06.260155 20248 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:06.259171 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:06.263350 24506 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:06.264189 24413 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:06.264614 24413 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:06.272367 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:06.265028 24811 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:19:06.279170 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 44139.3us
I20260709 12:19:06.265004 24413 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:06.282189 24816 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:06.282683 24816 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:06.283141 24816 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:06.283321 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72160.9us
I20260709 12:19:06.284209 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.288057 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.288710 20328 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.292044 24796 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:06.293869 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:06.295359 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.295204 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.278484 20256 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:06.297679 20247 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:06.294911 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.265898 24783 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.246986 24779 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.307641 20330 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 5: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:06.243784 24434 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:19:06.308275 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.309152 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:06.297999 24802 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.317608 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:06.317927 24144 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:06.318359 24144 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:06.318691 24144 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:06.321745 24413 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.322908 24815 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:06.324802 24549 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:06.325145 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:06.317598 24802 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.326041 24623 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:06.326512 24623 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:06.326613 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:06.326959 24623 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:06.325486 24549 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:06.329730 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.323400 21008 leader_election.cc:400] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:19:06.331084 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:06.332382 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.332450 20248 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:06.333774 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 172462us
W20260709 12:19:06.338490 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 44699.3us
I20260709 12:19:06.346954 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.351547 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.352557 20327 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:06.352771 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.354656 20328 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:06.355515 20253 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:06.251674 24812 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.335016 24780 raft_consensus.cc:2764] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:19:06.335258 24700 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.367446 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.368155 20323 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:19:06.365269 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.344964 24832 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:06.317875 24808 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:06.306722 24816 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.377259 24549 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.380002 24816 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.370018 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:06.380908 20174 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:06.376410 24700 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.370663 24832 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:06.383733 24824 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:06.384327 24824 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:06.384766 24824 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.386729 24812 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.387800 20251 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
W20260709 12:19:06.388428 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48994.6us
I20260709 12:19:06.389345 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.390578 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.391430 24577 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:06.392284 24577 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:06.392786 24577 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:06.393196 24577 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.396147 24832 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.400133 24832 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.387826 24818 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:06.404134 24818 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:06.404569 24818 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:06.406301 24831 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:19:06.406831 20249 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:06.407526 24808 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:06.372354 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.376813 24779 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.410082 24802 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.376791 24413 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.411523 24413 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:06.411927 24413 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:06.412304 24413 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:06.423272 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54544us
W20260709 12:19:06.432605 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85784.8us
I20260709 12:19:06.433789 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.434762 24779 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.375380 24809 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:06.439421 24144 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.440037 24623 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.444293 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.448105 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.454073 20144 leader_election.cc:400] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:06.454559 20144 leader_election.cc:403] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:06.457396 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.462083 24623 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.462896 24817 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:06.464856 24144 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.455433 24833 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:06.469901 24807 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:06.473503 24807 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:06.474594 24815 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:06.475037 24815 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:06.476146 24815 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.476679 24802 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:06.477439 24802 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:06.477823 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44128.5us
I20260709 12:19:06.484189 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:06.484663 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.499009 24413 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.506069 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:06.506722 21035 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:06.507994 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.508956 21041 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.509292 24814 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:19:06.511984 24802 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.513041 20325 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:06.512881 24783 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.515080 24783 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.460323 24824 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.526648 20248 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:06.530678 21041 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:06.532799 20327 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:06.535621 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.536374 20329 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:06.497117 24833 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:06.505328 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.538285 21008 leader_election.cc:400] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
W20260709 12:19:06.538054 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53971.2us
I20260709 12:19:06.543044 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.538036 24783 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:06.534034 24817 raft_consensus.cc:2764] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:06.546042 24811 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.546680 24811 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.497411 24144 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:06.548669 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:06.550366 24824 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.550762 20323 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:19:06.551080 24811 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:06.551043 24623 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:06.553107 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.553275 21036 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:06.553161 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.560326 20328 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:06.561537 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.564112 24818 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.566588 24818 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.558750 24317 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:06.559054 24742 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:06.533983 24675 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:06.576223 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72164.9us
I20260709 12:19:06.572202 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.568655 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:06.580382 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100798us
I20260709 12:19:06.583449 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:06.557024 24817 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:06.583680 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:06.588611 24675 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.589190 20251 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:06.583302 24780 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:06.589727 24577 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.590314 24780 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:06.592590 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.593251 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.591773 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:06.574530 24783 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:06.600431 20327 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:06.615986 20144 leader_election.cc:400] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:06.616405 20144 leader_election.cc:403] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:06.605039 20329 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:06.591069 24675 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.618139 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.618353 20247 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:06.576086 24808 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:06.619705 21035 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
W20260709 12:19:06.620883 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 249780us
W20260709 12:19:06.596413 24768 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.618s	user 0.015s	sys 0.001s
I20260709 12:19:06.622872 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.553325 24814 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:19:06.617856 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.591881 24817 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:06.618543 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:06.559022 24144 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:06.640707 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 88297us
I20260709 12:19:06.645383 20321 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:06.651140 24577 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.630019 24700 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10.
I20260709 12:19:06.652437 24700 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:06.638330 24816 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.654146 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.655500 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.656015 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.656695 20327 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:06.652345 24413 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:06.657601 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.658294 20327 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:06.658181 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.582468 24742 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.581686 24833 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:19:06.660984 24742 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:06.581552 24818 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:19:06.661355 24833 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:06.661820 24833 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:06.662789 24833 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.633487 24783 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.664978 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.665108 24144 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.661964 24818 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:06.665412 20252 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:06.659407 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.679703 20323 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:19:06.680697 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:06.647132 24817 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.646835 24678 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:06.630954 24807 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:06.689308 20329 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 12:19:06.689515 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:06.691622 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:06.691982 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 73507.8us
I20260709 12:19:06.696532 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.697216 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.697875 20321 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:06.704257 24780 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.707007 24815 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:06.724237 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83973.5us
I20260709 12:19:06.707124 21043 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:06.725839 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:06.720952 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 71173.9us
I20260709 12:19:06.639274 24768 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.726763 20175 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:06.726753 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:06.725975 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 91125.5us
I20260709 12:19:06.684832 24818 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:06.734388 20322 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:06.728570 20256 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:06.732189 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.711663 24834 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.730723 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:06.736735 20324 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:06.722149 24769 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:06.734711 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:06.725425 24623 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.742244 20329 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:06.744532 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:06.741501 24785 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:06.746273 24769 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:06.747061 24705 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:19:06.738137 24779 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:06.748428 24837 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:19:06.758790 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.764308 24818 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.737555 24780 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:06.769455 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:06.750144 24832 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:06.794893 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65307.1us
I20260709 12:19:06.796420 24838 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:19:06.797001 24818 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.797904 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.798182 24599 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:06.798532 24599 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:06.799324 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.796784 24768 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:06.805300 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.771620 24785 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:06.760330 24623 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:06.844064 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44837.9us
I20260709 12:19:06.846522 20255 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:06.851181 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:06.851787 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.852344 21043 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:06.852627 21041 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:06.808869 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 216360us
I20260709 12:19:06.783926 24779 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:06.855737 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.855986 24779 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.793715 24832 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:06.858907 24832 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:06.859897 24785 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.843873 24769 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.844794 24813 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:06.860314 24434 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:06.841446 24839 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:19:06.812022 24771 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:06.868290 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 63076.6us
I20260709 12:19:06.870224 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.799408 24599 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.750696 24834 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:06.875967 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:06.865244 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:06.847218 24776 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:06.880667 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:06.864673 24669 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:06.898496 21041 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:06.878751 24833 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.900801 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:06.902647 21038 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:06.903100 24768 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:06.903702 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.905902 24623 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.908128 20247 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:19:06.908891 24834 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.915802 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.895109 24434 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:06.907053 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:06.922997 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:06.932161 20175 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:06.903741 24783 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.934026 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:06.937463 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:06.949033 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:06.950168 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.918354 24669 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:06.934352 24317 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:06.930442 24809 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:06.888509 24813 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.947495 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:06.957417 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:06.957911 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54342us
I20260709 12:19:06.959177 21035 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:06.939519 24623 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:06.954697 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 99075.4us
I20260709 12:19:06.936640 24434 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:06.963971 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48265.8us
I20260709 12:19:06.957129 24811 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:06.967087 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:06.973585 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.974764 24846 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:06.975241 24846 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:06.975618 24846 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.973717 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.979941 24835 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:06.980639 24857 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:19:06.983728 24850 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.979943 24849 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:19:06.988008 24678 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:06.984347 24850 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:06.991196 24850 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.987190 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:06.996490 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.971474 24599 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.951951 24819 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:19:06.971012 24824 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:07.004585 24771 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:07.005064 24771 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:07.005448 24771 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.978747 24768 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:07.006786 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:06.992470 24812 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:07.008222 24812 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.010474 24812 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:06.992307 24839 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:07.011742 24860 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:07.012380 24860 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.015077 24813 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:07.015697 24824 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:07.016775 24824 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.001308 24669 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.020169 24817 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.021869 24832 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.022635 24817 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:07.029230 24768 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:07.045248 24768 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:07.043782 24816 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.994388 24835 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:07.036741 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:07.051123 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:07.057552 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 101975us
I20260709 12:19:07.058825 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.062821 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.065452 24577 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.073657 24742 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:07.074548 24816 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:07.081518 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78675.6us
I20260709 12:19:07.082353 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:07.084681 24860 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:07.099220 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 48155.2us
I20260709 12:19:07.102588 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:07.106580 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.108968 20176 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:07.109709 24816 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:07.110642 24783 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:07.111084 24783 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:07.111467 24783 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.111406 24860 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:07.121058 24832 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:07.123245 24863 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:19:07.125739 24771 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.133661 24429 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.131822 24623 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.115347 24846 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.142585 24669 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:07.143376 24846 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:07.146919 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 151966us
I20260709 12:19:07.132797 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:07.154340 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.159333 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:07.161398 20220 leader_election.cc:400] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:07.162190 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:07.164913 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.166841 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.167510 20326 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:07.167490 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.168675 20325 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:07.171998 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:07.172762 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 177814us
I20260709 12:19:07.179175 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.179926 20326 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:07.190656 20324 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:07.195163 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.172684 24832 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:07.199378 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.200352 20247 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:07.199467 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.201292 20326 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:07.201229 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:07.203125 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.206564 21041 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.208281 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.204447 20251 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:07.208847 20176 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.205351 20175 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:07.169175 24817 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:19:07.178253 24429 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:07.180958 24814 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:07.174472 24816 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:19:07.245177 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.262979 20251 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.248121 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.252033 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.264147 20256 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:07.266467 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.267198 20253 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:07.181877 24851 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:19:07.267984 24429 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:07.261529 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:07.265173 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109916us
I20260709 12:19:07.223917 24814 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:07.220417 20219 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:07.274729 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:07.219971 24779 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:07.279388 21041 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:07.209980 24809 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:07.294080 24779 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.295455 24780 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:07.297910 24429 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.305980 24780 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:07.307339 24779 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:07.306998 24780 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.216071 24833 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 12:19:07.304809 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 84485.8us
I20260709 12:19:07.219364 24846 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:19:07.330569 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:07.290759 24814 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.330236 24506 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:19:07.311188 24868 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:07.337275 24868 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.337776 24868 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:07.339721 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.339977 24700 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:07.340235 24673 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:07.340595 24700 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:07.341638 24700 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.342273 24413 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.342780 24413 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.343602 24780 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.345253 24413 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.346310 24771 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.346402 24768 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.339768 24816 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:19:07.348955 24816 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:07.349314 24816 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:07.350134 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.310863 24808 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.350284 24816 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.350821 24808 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.351226 24808 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.351992 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.352380 21036 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:07.352931 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:07.357074 24776 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:07.357465 24776 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:07.358006 21043 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:07.358246 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:07.358412 24776 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.358915 24413 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.359493 24413 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.359751 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:07.361763 24413 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.365067 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:07.366096 21035 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 5.
I20260709 12:19:07.287986 24577 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 12:19:07.368851 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56744.8us
I20260709 12:19:07.370412 24825 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:07.371512 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:07.326563 24851 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.374543 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.303052 24817 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:07.378551 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.377051 20324 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:19:07.384256 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.384970 20330 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:07.389919 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.390630 20327 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:07.393296 20328 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:07.389467 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:07.399945 20176 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:07.416456 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.380108 24771 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:19:07.420722 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.421362 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:07.377326 24832 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:07.376484 24817 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:07.376221 24816 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.423445 20295 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:07.425563 21035 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:19:07.427873 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.428349 20251 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:07.469282 20176 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:07.449858 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.471674 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.472384 20251 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:19:07.481351 21041 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:07.483278 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.423749 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:07.416536 24818 raft_consensus.cc:2764] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:19:07.431497 24599 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:19:07.328985 24809 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.394390 24506 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:07.436787 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.423904 24776 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:07.440223 24783 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.442399 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.443382 21039 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:07.448141 20179 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.505378 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.455835 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:07.483325 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59984.3us
I20260709 12:19:07.506613 20247 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:07.484267 20256 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:07.484752 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.483448 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.487044 20172 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:07.433235 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:07.487813 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:07.495807 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 72251.4us
I20260709 12:19:07.431705 24832 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:07.503324 20177 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:07.508816 20176 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.509063 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:07.517620 20176 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:07.518497 20178 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:07.518987 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.520722 20172 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:07.521113 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.521832 20171 raft_consensus.cc:2368] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:07.526125 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:07.525390 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 92219.2us
I20260709 12:19:07.526726 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.501823 24846 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:07.526505 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.549729 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.550557 20248 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:07.552621 20249 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:07.552947 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.503908 24506 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:07.575212 20173 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:07.548162 24812 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.580204 24783 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:07.547748 24873 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:07.576697 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:07.581841 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.582031 20247 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:07.558056 20076 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 206) took 13809 ms (client timeout 15000 ms). Trace:
I20260709 12:19:07.559048 24846 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:07.559597 20075 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 12, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.519556 24832 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:07.568019 24860 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:07.544301 24669 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.569120 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:07.510804 24317 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:07.594702 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.577301 20177 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:07.585505 20075 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 11, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:07.595444 20247 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:19:07.596016 20075 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 13, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 13 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.565366 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.597203 20248 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:07.589862 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:07.568882 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.599308 20075 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.592341 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.602860 20075 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.607465 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.578321 24809 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.609143 21039 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:07.593439 24669 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.594741 24317 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.612234 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.627723 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.626449 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:07.583072 20076 rpcz_store.cc:269] 0709 12:18:53.748866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.763021 (+ 14155us) service_pool.cc:224] Handling call
0709 12:19:07.557951 (+13794930us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:06.178568 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:06.263352 (+ 84784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:06.263415 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:19:06.263437 (+    22us) tablet.cc:662] Decoding operations
0709 12:19:06.272214 (+  8777us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:06.291646 (+ 19432us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:06.291683 (+    37us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:19:06.293083 (+  1400us) tablet.cc:701] Row locks acquired
0709 12:19:06.293133 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:19:06.293324 (+   191us) write_op.cc:270] Start()
0709 12:19:06.293495 (+   171us) write_op.cc:276] Timestamp: P: 1783599546293247 usec, L: 0
0709 12:19:06.293541 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:19:06.294364 (+   823us) log.cc:844] Serialized 6088 byte log entry
0709 12:19:06.546694 (+252330us) op_driver.cc:464] REPLICATION: finished
0709 12:19:06.804226 (+257532us) write_op.cc:301] APPLY: starting
0709 12:19:06.811787 (+  7561us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:07.025080 (+213293us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:07.025237 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:07.142611 (+117374us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:07.142967 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:19:07.143032 (+    65us) write_op.cc:312] APPLY: finished
0709 12:19:07.143471 (+   439us) log.cc:844] Serialized 139 byte log entry
0709 12:19:07.168464 (+ 24993us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:07.172570 (+  4106us) write_op.cc:454] Released schema lock
0709 12:19:07.182183 (+  9613us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:07.315207 (+133024us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:07.329343 (+ 14136us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3200,"reported_tablets":36,"spinlock_wait_cycles":41728,"child_traces":[["op",{"apply.queue_time_us":193433,"apply.run_cpu_time_us":31152,"apply.run_wall_time_us":506313,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":26396,"prepare.run_cpu_time_us":21577,"prepare.run_wall_time_us":167212,"raft.queue_time_us":109298,"raft.run_cpu_time_us":19893,"raft.run_wall_time_us":74067,"replication_time_us":252935,"thread_start_us":158308,"threads_started":4,"wal-append.queue_time_us":51154}]]}
I20260709 12:19:07.609601 20075 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 9 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:07.615271 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.590731 24808 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.628794 20171 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:07.632736 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.633384 20247 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.633806 24808 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.634778 20255 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:07.575770 24817 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.635474 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.642213 24814 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.636482 20075 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 11, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 11 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.629916 24317 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:07.646020 20075 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:07.606415 24843 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:07.651165 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.637974 24868 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.659353 21036 raft_consensus.cc:2368] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
I20260709 12:19:07.626402 24669 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.664819 24868 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:07.666656 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.694970 20247 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:07.696408 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.663857 20075 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 11, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.660326 24768 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.677489 24814 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.685581 24796 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.685896 20172 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:07.708648 20253 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:19:07.698699 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81955.3us
I20260709 12:19:07.686013 20179 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:07.693894 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:07.636905 24742 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:07.729197 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.652606 24843 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:07.703513 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:07.706804 20075 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 12, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.745244 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:07.763463 20326 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:07.698015 20247 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:07.748308 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.765980 20324 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:07.767656 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:07.773346 20075 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:07.746047 24826 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.745886 24742 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:07.760497 24835 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:07.695998 24860 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:19:07.745442 24815 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.765239 24843 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:07.782238 20075 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.786954 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.784153 24783 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:07.776422 24824 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:07.795228 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:07.802242 24815 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.798729 20180 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:07.803037 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:07.817257 20329 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.804177 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.793537 24742 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:07.824065 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.826864 20323 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:07.790169 24826 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.831101 24826 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.837024 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.838690 24832 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.839546 20177 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:07.839924 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.840523 20178 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.842886 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:07.794313 24835 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:07.844715 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.823010 24434 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:19:07.847551 24815 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.850178 24824 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.850823 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:07.851539 20256 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:07.852419 24824 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:07.861940 24506 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.864060 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.864459 20321 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:07.868989 20180 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:07.879108 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:07.881142 20176 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:07.882239 24843 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.781971 24846 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.884443 24779 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:07.884714 24832 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:07.888217 21039 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:07.888965 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.890412 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:07.801193 20075 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.863337 24506 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.896816 21042 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:07.892877 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 265238us
I20260709 12:19:07.897763 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.891131 20323 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:07.902305 20220 leader_election.cc:400] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:07.905920 20329 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:07.909904 20178 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:07.911055 20326 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:07.911337 20075 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } }
I20260709 12:19:07.915033 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.913861 20075 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 9, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.880384 24317 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.917107 20075 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 12, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.927875 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:07.929518 24549 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.933365 20075 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.935962 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:07.938859 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.937638 20075 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 12, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:07.940585 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.942359 20075 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 11, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.947178 24843 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:07.952172 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.954810 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:07.955911 20075 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 3 to 4, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 4 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:07.915086 24884 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:07.962666 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:07.964519 20249 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:07.964282 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:07.913379 24815 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:19:07.968716 24843 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:07.959702 24812 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.963835 24816 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:07.844766 24835 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.949925 24860 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:07.975972 24860 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:07.976888 24860 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:07.977697 24669 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:07.950126 24779 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.959542 24809 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.962886 24884 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.981173 24884 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:07.971535 24825 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:07.962369 24796 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:07.988705 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 73761.5us
I20260709 12:19:07.987736 21037 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:07.986538 24669 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.982612 24868 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:08.019434 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 109009us
W20260709 12:19:08.020582 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 131704us
I20260709 12:19:08.018594 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:07.988407 24825 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:08.040302 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:07.990253 24317 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:07.990981 24776 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.026443 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.031320 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:08.055516 20173 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:08.032481 20178 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:19:08.041340 20175 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:08.041186 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:08.059437 20179 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:08.062304 20255 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:08.066408 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:08.067677 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:08.070083 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 156249us
W20260709 12:19:08.054538 24893 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.004s
W20260709 12:19:08.072702 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 110858us
I20260709 12:19:08.040635 24877 raft_consensus.cc:2764] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:08.055549 24868 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.052583 24742 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:08.071880 24796 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:19:08.171030 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 103474us
I20260709 12:19:08.145707 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:08.175689 24796 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:08.064003 24809 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.077389 24850 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:19:08.113068 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.175837 20248 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:08.078449 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:08.181381 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:08.198187 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85209.6us
I20260709 12:19:08.135171 24865 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
W20260709 12:19:08.111711 24894 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:19:08.223050 24868 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:08.149256 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:08.246033 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 167699us
W20260709 12:19:08.135082 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58261.2us
W20260709 12:19:08.291118 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 109848us
W20260709 12:19:08.291241 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44345us
I20260709 12:19:08.292033 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:08.292181 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:08.145923 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:08.065091 24780 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:08.246929 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 175893us
I20260709 12:19:08.175731 24811 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:08.296918 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.182780 24796 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:08.069280 24885 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.244098 24826 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:08.301337 24903 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:19:08.312053 24826 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:08.313387 24742 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:08.114770 24859 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.177s
I20260709 12:19:08.314648 24859 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:08.315012 24859 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:08.315896 24859 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.243772 24506 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:19:08.317196 24859 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.243611 24809 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.109339 24896 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:08.300611 20329 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:08.319808 24896 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.320259 24896 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:08.320511 24892 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:19:08.322136 24809 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:08.310932 20248 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:19:08.110008 24899 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 12:19:08.313081 24826 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.319113 24860 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:08.298579 24802 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.298198 24835 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:19:08.302448 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:08.299064 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 149877us
I20260709 12:19:08.324483 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:08.289594 24832 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:08.339844 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.322770 24814 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:08.346086 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:08.348867 20326 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:08.323518 24819 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.298378 24901 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.353538 24835 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:08.353935 24835 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:08.354806 24835 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:08.356745 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.358641 24796 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:08.360841 24796 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:08.338351 24700 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:19:08.374742 24700 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:08.375166 24700 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:08.376125 24700 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:08.379629 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77232.3us
W20260709 12:19:08.386411 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 94466.3us
I20260709 12:19:08.377425 24700 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:08.405100 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:08.408504 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:08.448611 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 43656us
I20260709 12:19:08.382131 24506 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:08.457587 24895 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.563s	user 0.002s	sys 0.000s
I20260709 12:19:08.463438 24815 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:08.463912 24815 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:08.464912 24815 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.466490 24815 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.472118 24817 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.488348 24802 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:08.499361 24868 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:08.499925 24868 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:08.500667 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50758.1us
I20260709 12:19:08.501838 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.302276 24780 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.348275 24814 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.439507 24673 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:19:08.383013 24901 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:08.500813 24884 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.006s
I20260709 12:19:08.444262 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.447362 20326 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:19:08.166361 24825 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:08.523387 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79281.8us
I20260709 12:19:08.488739 24808 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:08.297816 24811 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:08.513312 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 219340us
I20260709 12:19:08.533787 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:08.534557 20329 raft_consensus.cc:2368] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
I20260709 12:19:08.516918 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:08.410553 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:08.453547 24896 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.516651 24861 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:08.516010 24814 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:08.538314 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 127867us
I20260709 12:19:08.605111 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:08.531471 24768 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:08.607863 24868 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.608893 24900 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:19:08.609242 24599 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:08.516480 24506 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:08.614401 20179 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:08.528216 24884 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:08.528731 24808 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:08.524737 24835 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:08.626493 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:08.627233 20326 raft_consensus.cc:2368] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
I20260709 12:19:08.532351 24877 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.531185 24809 raft_consensus.cc:476] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 12:19:08.618050 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:08.634434 24855 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:08.615477 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:08.607718 24893 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:08.541363 24811 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.655957 24742 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:08.659340 24577 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.620508 24901 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:19:08.659061 24898 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:08.663388 24868 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.669436 24855 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:08.652205 24877 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:08.711866 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.712625 24506 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.699345 24898 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:08.718077 24898 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:08.720032 24896 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:08.700587 24808 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.726472 24808 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.696995 24742 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:08.728534 24855 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.730800 24742 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:08.703429 21037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:08.698800 24577 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.728570 24884 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:08.755983 21037 raft_consensus.cc:606] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.761133 24814 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.751176 24802 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:08.768844 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:08.771809 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 230675us
I20260709 12:19:08.775931 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:08.776099 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:08.776943 20251 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:08.763716 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 149827us
I20260709 12:19:08.783711 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:08.784471 20175 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
W20260709 12:19:08.785722 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100248us
I20260709 12:19:08.790055 20177 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:19:08.790565 20177 pending_rounds.cc:85] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:19:08.790834 20177 pending_rounds.cc:107] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:19:08.791133 20177 raft_consensus.cc:2889] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:08.794275 21036 raft_consensus.cc:2368] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14.
I20260709 12:19:08.801687 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:08.802119 20251 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:08.803988 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:08.805027 20180 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:08.805891 20327 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:08.806717 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:08.809186 20327 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:08.796347 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 567724us
I20260709 12:19:08.779942 24768 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:08.812565 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 210071us
I20260709 12:19:08.818058 20219 leader_election.cc:400] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
I20260709 12:19:08.819591 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:08.820251 20178 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:08.786984 24599 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:08.818634 20219 leader_election.cc:403] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:19:08.836364 24768 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:08.854630 24835 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 5. Current term is 6.
I20260709 12:19:08.855911 24877 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:08.816402 24883 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.856756 24899 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:08.856866 24883 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:08.857863 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44376.9us
I20260709 12:19:08.858836 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:08.866104 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44931.7us
I20260709 12:19:08.871096 20180 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:08.860908 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:08.876283 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:08.781034 24802 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.882112 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:08.884435 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:08.884716 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:08.885350 20253 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:08.885489 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:08.891212 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:08.892074 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:08.892918 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:08.897140 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:08.897778 20252 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:08.855885 24814 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:08.906797 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:08.815651 24911 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:19:08.909358 20219 leader_election.cc:400] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
I20260709 12:19:08.909705 20219 leader_election.cc:403] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:08.910179 20248 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:08.907790 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3068) took 1373 ms. Trace:
I20260709 12:19:08.908067 20323 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:19:08.881333 24815 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:08.914526 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:08.911137 20172 rpcz_store.cc:276] 0709 12:19:07.524082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.525876 (+  1794us) service_pool.cc:224] Handling call
0709 12:19:08.896965 (+1371089us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002409d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:08.897067 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302896384}
I20260709 12:19:08.919596 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:08.920264 20323 raft_consensus.cc:606] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:08.923352 20252 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:08.924629 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:08.892110 24859 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:08.925268 20180 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:08.908221 24700 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:08.928345 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:08.949810 20173 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.957499 20179 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:08.957795 24832 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:08.960083 24832 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:08.960623 24832 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:08.931654 20178 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:08.907606 24818 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:19:08.913463 24904 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:19:08.929893 24815 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:08.949556 24923 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:09.002035 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.004648 20178 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:08.926290 24811 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.949923 24859 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:08.975642 24903 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.015545 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.000937 24826 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:08.928931 24599 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.021414 20324 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.001574 24317 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:09.028753 20173 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:09.012008 24700 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:08.967707 24818 consensus_queue.cc:1243] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:09.022235 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.002825 24819 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.040927 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.022927 24909 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:09.056905 20178 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:09.061466 20324 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:09.027321 24903 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.065330 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:09.072409 24926 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:19:09.041759 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125712us
I20260709 12:19:09.016279 24675 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:09.013182 24922 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.094249 24941 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:09.095360 24941 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.095045 24922 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.095781 24938 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:09.096514 24938 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.097452 24922 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.068715 24904 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:09.092394 24942 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.098453 24904 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.099012 24742 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:09.098845 24942 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.099613 24742 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.101262 24942 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.091439 24935 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.101893 24742 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:09.102268 24825 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.059356 24909 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.095937 24941 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:09.067306 24929 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
I20260709 12:19:09.036662 24317 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.105314 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.121842 20175 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:09.098011 24922 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.033911 24826 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.112803 24700 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:09.120635 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.127405 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.099799 24938 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.121275 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:09.126144 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60914.6us
I20260709 12:19:09.129717 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.098863 24904 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.140787 20252 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:09.130401 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.141901 21037 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:09.132169 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.120800 24705 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:09.097293 24903 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.145324 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.146209 20250 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:09.133922 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.115592 24909 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.095789 24811 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.141325 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.102306 24935 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.150396 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:09.159765 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.160415 20321 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:19:09.154933 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 262933us
I20260709 12:19:09.122977 24817 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:09.164242 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:09.160468 20322 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:09.068367 24802 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:09.166002 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.848s (SENT) [suppressed 12 similar messages]
I20260709 12:19:09.171265 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:09.149820 24938 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.184078 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:09.185407 24900 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:09.185714 24946 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:09.186322 24946 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.186142 24900 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.186885 24946 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:09.189280 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:09.191699 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50479.6us
I20260709 12:19:09.070169 24815 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.135541 24922 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.194049 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:09.198647 24933 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:19:09.205397 24922 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.207469 20321 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:09.060770 24819 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.201807 24859 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.210093 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:09.156824 24705 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:09.229523 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 313939us
I20260709 12:19:09.195698 24802 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:09.210583 24884 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:09.196516 24903 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:09.247267 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.172549 24817 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.249735 21037 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:09.257717 20328 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:09.227532 24859 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:09.227829 24768 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:09.194680 24938 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:09.273646 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.273659 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.262076 24768 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.294430 24802 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:09.307518 24826 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.308280 24947 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:09.309206 24947 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:09.310081 24705 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.310352 24947 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.316267 24935 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.265585 24903 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.308391 24826 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:09.351959 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 168002us
I20260709 12:19:09.300076 24768 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.352931 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:09.357693 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.374361 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:09.382987 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 217024us
I20260709 12:19:09.383585 24859 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:09.356985 24922 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:09.375666 24742 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.384686 24824 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.394608 24922 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.406038 24935 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.376468 24826 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.446219 24952 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.446383 24928 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:09.447237 24952 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.450549 24952 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.441736 24922 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:09.463347 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 87046.2us
I20260709 12:19:09.456295 24900 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.475744 20328 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:19:09.477725 24945 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:19:09.477897 24954 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:09.478749 24808 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.000s
I20260709 12:19:09.478506 24954 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.424331 24742 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.458801 24928 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:09.494735 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 268470us
I20260709 12:19:09.458421 24935 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.496811 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:09.498872 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 102150us
I20260709 12:19:09.436825 24802 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.467519 24859 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.506458 24742 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:09.507014 24944 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:19:09.507544 24928 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.509752 24938 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.477751 24923 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
I20260709 12:19:09.470224 24819 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:09.526190 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 252619us
I20260709 12:19:09.512362 24817 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.534552 20174 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:19:09.536515 24974 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:19:09.517201 24815 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.548169 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.548899 20176 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:09.548049 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.552186 24923 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.552912 24923 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.557202 24954 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.558635 24816 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:09.559098 24816 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:09.560266 24903 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.564862 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:09.565017 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63269.7us
I20260709 12:19:09.571945 20171 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:09.572593 24923 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.574693 21037 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:09.577164 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.577802 20249 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:09.578852 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.584544 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.550016 24815 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:09.586548 24913 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.944s	user 0.002s	sys 0.003s
I20260709 12:19:09.551064 24909 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.587754 24978 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.588289 24978 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.536988 24941 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.592494 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.585204 20249 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:09.595423 24978 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:09.596211 24941 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:09.598299 24906 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 1.489s	user 0.001s	sys 0.002s
I20260709 12:19:09.565924 24903 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.600911 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:09.605502 20330 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:09.605427 20173 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:09.606547 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.566350 24819 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:09.607818 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 223057us
I20260709 12:19:09.614084 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.618058 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.618685 20253 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:19:09.613941 24819 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.624822 24923 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:09.626288 24935 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.628698 24599 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.629390 24599 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:09.631227 24825 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.001s
I20260709 12:19:09.632061 20252 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:09.634667 24909 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.611864 24903 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.638567 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.642311 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:09.648198 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.649056 20178 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:09.650966 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2826) took 1028 ms. Trace:
I20260709 12:19:09.651494 20177 rpcz_store.cc:276] 0709 12:19:08.623034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.624077 (+  1043us) service_pool.cc:224] Handling call
0709 12:19:08.649142 (+ 25065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:08.811196 (+162054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:09.650716 (+839520us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400111a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:09.650902 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313974016}
I20260709 12:19:09.607842 24816 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.656632 24946 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.642426 20175 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:09.660056 20173 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
W20260709 12:19:09.661576 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46060.9us
I20260709 12:19:09.663781 24809 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:09.664355 24832 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.004s
I20260709 12:19:09.664772 24832 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.665349 24317 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:09.663993 24923 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:09.666152 24923 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.666625 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.667342 20322 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:09.668058 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.668334 20176 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:09.668728 20321 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:09.665632 24903 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.669945 24883 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.685491 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:09.689849 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.692315 20178 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: [11.12-13.13]
I20260709 12:19:09.698683 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:09.702654 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:09.705013 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:09.705320 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.705653 20177 raft_consensus.cc:2376] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11. Re-sending same reply.
I20260709 12:19:09.713088 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:09.681236 24599 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.715960 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:09.673209 24809 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:19:09.704407 24832 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.703088 24896 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:09.703889 24317 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:09.706669 24946 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.724766 24861 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:09.746820 24855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.016s	sys 0.013s
I20260709 12:19:09.743161 24859 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:09.743937 24966 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.784173 24899 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:09.796922 24846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.847s	user 0.033s	sys 0.054s
W20260709 12:19:09.802380 24846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.853s	user 0.034s	sys 0.055s
I20260709 12:19:09.788707 24923 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.803817 24768 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.805994 24768 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.797942 24966 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.795372 24859 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.807920 24859 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.808351 24966 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:09.795779 24861 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.809098 24861 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.817147 24861 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.819252 24868 raft_consensus.cc:993] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:19:09.784523 24317 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.787926 24925 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.816286 24859 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:09.794853 24855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.017s	sys 0.014s
I20260709 12:19:09.830049 24922 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.831223 24780 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.832326 24922 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.832764 24815 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.799772 24819 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.835889 24675 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:09.836365 24675 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.837965 20253 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:09.838290 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:09.838866 20247 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.841648 20251 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:09.820257 24904 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.004s
I20260709 12:19:09.844087 24904 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.844921 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:09.845551 20325 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.846246 24904 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.847051 20179 raft_consensus.cc:2368] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18.
I20260709 12:19:09.837985 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.848505 20248 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:09.857963 20247 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:09.819770 24824 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:09.861374 20177 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:09.827894 24317 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.819420 24861 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.852447 24925 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.856346 24815 raft_consensus.cc:1081] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:19:09.879350 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:09.879949 24700 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:09.878865 24859 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.880330 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:09.884209 24815 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:09.884706 20321 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.884925 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.885424 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1158) took 1345 ms. Trace:
I20260709 12:19:09.885818 21036 rpcz_store.cc:276] 0709 12:19:08.540456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.540597 (+   141us) service_pool.cc:224] Handling call
0709 12:19:09.885224 (+1344627us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54005b68d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:09.885366 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316120832}
I20260709 12:19:09.886242 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.886919 21042 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:09.887363 20294 leader_election.cc:400] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14.
I20260709 12:19:09.887732 20294 leader_election.cc:403] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:09.887761 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.888873 24824 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14.
I20260709 12:19:09.889537 20327 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:09.889966 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.890190 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.890836 20248 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:09.890949 21041 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:09.880064 20174 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.887156 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.821561 24899 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.887948 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.898723 21037 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:09.901522 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:09.901850 24809 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:09.902379 24923 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:09.902462 24809 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:09.902995 24923 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:09.903841 24705 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:09.904259 24705 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:09.904742 24705 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.904443 24921 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:09.901988 20219 leader_election.cc:400] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
I20260709 12:19:09.908212 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.908696 20175 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:09.909673 20325 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:09.910715 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:09.910926 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.911027 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.912039 20327 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:09.914776 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:09.915859 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:09.916266 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:09.918052 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.928071 20327 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:09.928189 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:09.929226 20251 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:09.918473 24809 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:09.929606 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.919548 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.919274 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.930949 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:09.931440 20250 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:09.931625 21036 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.932578 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:09.933092 24968 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:09.933732 24968 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:09.934242 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:09.934952 20327 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:09.935540 24968 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.937949 21008 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:09.939520 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.942164 24961 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:09.919915 24958 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:09.921206 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:09.945724 20176 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:09.921396 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.922775 24923 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:09.949290 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.950338 20174 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:09.946285 21037 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:09.952909 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:09.953769 21036 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:19:09.954073 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.950948 20321 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:09.944669 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:09.951773 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57336 (request call id 62) took 1028 ms. Trace:
I20260709 12:19:09.954941 20323 rpcz_store.cc:276] 0709 12:19:08.914570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.915588 (+  1018us) service_pool.cc:224] Handling call
0709 12:19:09.942441 (+1026853us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b5400284ea0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae75520 00007f5ddaef2652 00007f5ddfec060a 00007f5dd94467d4 00007f5dd9446762 00007f5dd9446691 00007f5dd944660c 00007f5dd94458c2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:09.942721 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148614400}
I20260709 12:19:09.955482 20247 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:09.951609 24549 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:19:09.959100 24549 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:09.959518 24549 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:09.960419 24904 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:09.960887 24904 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:09.960625 24549 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.962186 24549 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:09.961282 24904 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.964982 24923 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:09.956305 24921 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:19:09.967329 24921 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:09.967753 24921 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:09.968716 24923 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:09.968925 24921 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.955188 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:09.973134 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:09.973886 21041 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:09.976455 21039 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:09.929177 24705 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:09.973326 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:09.992414 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:09.993150 20323 raft_consensus.cc:606] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:09.993577 20323 raft_consensus.cc:614] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:09.994416 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:09.995539 20247 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:09.997707 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:10.000573 20327 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:19:10.003196 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.006372 20248 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:10.006759 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.010329 21037 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:10.011405 20249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40218
I20260709 12:19:10.011670 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.012090 20249 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:09.993394 24921 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:09.996281 24835 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:09.998886 24577 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.012531 20249 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.014379 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.015974 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.016188 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.018757 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.019388 20253 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:10.021071 20256 raft_consensus.cc:2368] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:10.002508 24700 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:10.002197 24808 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:19:10.023945 24835 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:10.041671 24705 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.041394 24835 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.043772 24899 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.019491 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:10.054572 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.055343 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.057369 21008 leader_election.cc:400] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18.
I20260709 12:19:10.057839 21008 leader_election.cc:403] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:10.055320 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:10.061223 24946 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:10.064477 24946 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:10.065026 24946 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.062136 20249 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:10.055670 24987 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:19:10.079501 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:10.080423 24807 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18.
I20260709 12:19:10.081207 24807 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:10.082708 24807 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:10.083252 24807 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:10.051169 24768 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:10.051931 24700 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:10.084591 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.086031 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:10.089196 20323 raft_consensus.cc:606] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.089309 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.089577 20323 raft_consensus.cc:614] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:10.096122 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.098023 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:10.098299 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.101006 20294 leader_election.cc:400] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:10.101464 20294 leader_election.cc:403] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:10.071694 24705 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:10.108569 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.095208 24700 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.111816 20323 pending_rounds.cc:85] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 7
I20260709 12:19:10.118314 20323 pending_rounds.cc:107] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:19:10.083983 24982 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.102789 24768 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:10.099879 24940 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:19:10.120575 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.121217 20249 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.125820 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:10.119120 20323 raft_consensus.cc:2889] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:10.102630 24832 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.106570 24898 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:10.104440 24818 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:10.118301 24599 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.105646 24705 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:10.106472 24928 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:10.116375 24941 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.150972 24941 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.153290 24941 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.160043 24925 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.137817 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:10.161545 20327 raft_consensus.cc:606] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.161880 20327 raft_consensus.cc:614] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:10.083508 24317 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.116820 24918 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:10.112897 24796 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.126597 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:10.133306 24832 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.106880 24675 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.148912 24920 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:10.134990 24818 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:10.149891 24934 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.169s	user 0.006s	sys 0.000s
I20260709 12:19:10.150162 24705 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:10.122810 24819 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.129170 24898 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.188978 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:10.168936 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.168296 24768 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.186334 21041 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:10.194109 24768 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:10.194415 24675 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.194626 24768 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.195066 24768 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.196297 24317 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.168267 24796 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.201159 24832 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.205229 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:10.208092 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:10.215111 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 116874us
I20260709 12:19:10.216615 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.223665 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.173333 24818 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:10.173871 24920 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:10.173105 24918 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:10.234704 24796 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.234936 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.190107 24898 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.125097 24982 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.242636 24825 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:10.244192 24825 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:10.244628 24825 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:10.245589 24982 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.246243 24982 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.247714 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:10.227216 24843 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:10.249141 24815 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:10.250968 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 850) took 1476 ms. Trace:
I20260709 12:19:10.251670 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.191478 24927 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.253717 20326 rpcz_store.cc:276] 0709 12:19:08.774622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.775493 (+   871us) service_pool.cc:224] Handling call
0709 12:19:08.786912 (+ 11419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:08.811333 (+ 24421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:08.811365 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:08.821890 (+ 10525us) log.cc:844] Serialized 26 byte log entry
0709 12:19:08.890136 (+ 68246us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:08.890196 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.890290 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:10.120947 (+1230657us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:10.250596 (+129649us) raft_consensus.cc:1685] finished
0709 12:19:10.250630 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:10.250903 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2084,"raft.queue_time_us":2264,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":15497,"spinlock_wait_cycles":5027712,"thread_start_us":6576,"threads_started":1,"wal-append.queue_time_us":131928}
I20260709 12:19:10.256016 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:10.256660 20321 raft_consensus.cc:606] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.257027 20321 raft_consensus.cc:614] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:10.235322 24920 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.232344 24742 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.150794 24807 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.226040 24819 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.263085 21038 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:10.251113 24903 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:10.287045 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.290009 21043 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:10.250969 24843 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:10.236842 24904 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.288817 24669 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:19:10.277807 24941 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.289535 24903 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:10.260231 24942 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:19:10.277321 24877 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:19:10.308750 20173 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:10.296526 24925 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.276450 24742 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.317513 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.318791 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.319181 21043 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:10.315533 24599 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.320138 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:10.320938 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:10.323051 24910 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.320148 24599 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.324137 24877 consensus_queue.cc:1243] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:10.327848 24843 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.329054 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.329212 24843 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.332283 24910 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.334491 24910 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.307518 24918 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:10.336094 25014 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:19:10.308202 25004 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:19:10.340626 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.341296 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:10.320313 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.343437 21043 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:10.351712 20325 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:10.312065 24903 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.260039 24927 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.355629 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.360857 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:10.361565 20321 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.357095 20326 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:10.306051 24506 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:19:10.369665 20330 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:10.306427 24768 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:10.373611 25007 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:19:10.377576 24819 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.378911 24904 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.353856 24910 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.344123 24925 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.370303 24835 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.387619 24904 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.401151 24904 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.406215 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:10.409415 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.410706 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.411248 21035 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:10.413489 24742 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:10.426175 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.416725 24899 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:10.424149 20329 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:10.412832 24317 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:10.403277 24904 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.428766 21035 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:10.396721 25009 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.363593 24967 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:19:10.440022 20325 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:10.389393 24901 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.431366 20321 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:10.371766 24700 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.442866 21035 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:10.456715 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 248698us
I20260709 12:19:10.457911 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:10.459852 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:10.438406 24947 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.462177 21035 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.463382 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.464376 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.389132 24946 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.469244 24937 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:10.472544 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:10.473268 21043 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:10.478765 24927 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.420090 24815 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:19:10.480677 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.482012 24946 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.458971 25009 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.441462 24317 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:10.438202 24986 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:19:10.486016 21035 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:10.487785 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.485127 24705 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.490866 24705 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:10.492758 24925 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.492901 24700 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.433730 24835 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.496676 24835 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.498337 20255 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:10.502563 24768 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.503863 24947 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.466714 25011 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:10.506425 20178 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:10.499972 24317 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.469033 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:10.515321 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.516614 21037 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: [11.12-13.13]
I20260709 12:19:10.471124 24924 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:10.484807 25009 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.512993 25010 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.527905 25010 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.530296 25010 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.522064 24768 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.532939 24768 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.535089 24768 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.461499 24901 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.540256 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.515528 25011 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.551769 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.536753 24317 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.474154 24920 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.583316 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.584306 20252 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:10.589318 24947 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.595556 24826 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.601118 20249 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:10.592725 24700 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.604236 24700 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.606380 24700 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.610788 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.611748 20172 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11.
I20260709 12:19:10.553588 25011 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.583828 24807 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:10.629603 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:10.633414 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.636037 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.586635 24768 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.580756 24705 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:19:10.590657 25010 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:10.590353 24924 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:10.645871 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.648818 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.651010 24920 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.630962 24903 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.653340 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.653335 24903 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.661671 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:10.672801 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.677073 20323 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:10.679381 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:10.635421 24904 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:10.676532 24700 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:10.699996 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.667932 24903 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:10.658695 24807 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:10.703300 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:10.720640 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.705811 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:10.644657 24768 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:10.733680 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.734791 20326 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:10.735430 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:10.752169 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46460us
I20260709 12:19:10.697387 24941 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.759012 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:10.666488 25010 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.700452 24952 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:10.760821 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.770241 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.770866 20256 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.762929 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:10.764392 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:10.767634 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.767577 21041 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:10.769387 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.692987 24904 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.745188 24700 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:10.796705 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.768666 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:10.815660 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.841450 21043 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.771920 20324 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:10.842162 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:10.842377 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:10.843183 20323 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.817544 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.843973 20248 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:10.817643 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.817900 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.845465 20254 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:10.817533 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.846314 20249 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.818661 20326 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.832584 24901 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.834367 24768 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:10.764919 24917 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:10.848587 20256 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:10.794528 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:10.860841 24946 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.861641 24917 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.862522 20252 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 12:19:10.866084 25010 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:10.831384 24807 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.870146 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:10.752257 24924 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.871927 21043 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:10.762687 24925 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:10.878098 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.887176 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.887851 20326 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
W20260709 12:19:10.878904 25019 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:19:10.896749 20249 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:10.901036 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.773348 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:10.888614 20247 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:10.907685 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.909273 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:10.908299 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:10.914463 20171 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:10.881006 24946 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.816044 24952 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:10.988471 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:10.880204 24925 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:11.021377 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:10.916837 24825 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.672s	user 0.014s	sys 0.000s
I20260709 12:19:10.894045 24817 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 12:19:11.025961 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:11.027079 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 152422us
I20260709 12:19:11.087003 20326 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:11.093271 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:11.024276 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:10.990576 24898 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.738s	user 0.004s	sys 0.009s
I20260709 12:19:11.067337 20247 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:11.084568 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:11.108369 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.121665 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:11.105427 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 90838.4us
I20260709 12:19:11.124064 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:11.134532 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.147886 20179 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:10.959043 20323 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:11.154613 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.069665 24925 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:11.102257 24818 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.850s	user 0.013s	sys 0.000s
I20260709 12:19:11.075681 24917 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.173266 25011 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:11.143906 25021 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.475s	user 0.000s	sys 0.001s
W20260709 12:19:11.167796 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59555.9us
I20260709 12:19:11.175351 20171 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:11.172400 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.175463 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.151889 20295 leader_election.cc:400] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11.
I20260709 12:19:11.181414 20295 leader_election.cc:403] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:11.124387 24946 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.124140 24780 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:11.181335 20252 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:11.194794 24969 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:11.085129 24825 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.118192 24898 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:11.212654 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60975.6us
I20260709 12:19:11.210901 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:11.175827 24955 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:11.158033 24910 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:19:11.209431 24780 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:11.239538 20249 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:11.083932 24700 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.239580 20250 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:11.176884 24818 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.207419 24969 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:11.248474 20251 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 12:19:11.216128 24811 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11.
I20260709 12:19:11.216298 24957 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:19:11.264427 20252 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:11.266613 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:11.267517 20179 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:11.215204 24946 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.270161 20177 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:11.249800 24780 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:11.276453 25027 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:19:11.278236 24898 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:11.282764 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 787) took 1171 ms. Trace:
I20260709 12:19:11.282872 20174 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:11.285687 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.283231 20173 rpcz_store.cc:276] 0709 12:19:10.111049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.113489 (+  2440us) service_pool.cc:224] Handling call
0709 12:19:11.282543 (+1169054us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000c5dd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:11.282701 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418915200}
I20260709 12:19:11.290351 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:11.317476 24317 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.001s
I20260709 12:19:11.347589 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:11.361246 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:11.353638 25023 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:19:11.369906 24815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.047s	sys 0.044s
W20260709 12:19:11.370335 24815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.047s	sys 0.044s
I20260709 12:19:11.330686 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:11.372232 24825 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.344141 24549 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:11.339530 25024 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
I20260709 12:19:11.336282 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 786) took 1228 ms. Trace:
I20260709 12:19:11.274586 24969 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.373759 20179 raft_consensus.cc:2368] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:11.376132 20178 rpcz_store.cc:276] 0709 12:19:10.108140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.108292 (+   152us) service_pool.cc:224] Handling call
0709 12:19:11.336071 (+1227779us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54003917d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:11.336214 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912842624}
I20260709 12:19:11.380811 24742 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:11.382936 20176 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:11.381253 24742 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:11.386088 20178 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:11.384918 25032 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:11.392710 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:11.394027 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 260395us
I20260709 12:19:11.397013 20178 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:11.391381 24969 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:11.375919 24946 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.373663 24549 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:11.397826 25032 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.409683 25032 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:11.411006 25033 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:19:11.416662 20179 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:11.396624 24817 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:11.428035 24817 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.430277 24817 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.432730 20179 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:11.424378 24925 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.424943 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.426086 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:11.437584 20249 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:11.403492 24816 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:11.449172 20252 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:11.506044 20249 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:19:11.506676 20249 pending_rounds.cc:85] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 11
I20260709 12:19:11.506973 20249 pending_rounds.cc:107] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:19:11.507272 20249 raft_consensus.cc:2889] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:11.507692 20249 pending_rounds.cc:107] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:19:11.508001 20249 raft_consensus.cc:2889] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:11.473403 25032 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:11.440742 24925 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.482796 25035 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:11.527446 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:11.541853 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:11.542645 21043 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:11.577219 21041 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:11.586418 20250 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:11.586638 20252 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:11.460582 24742 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.585041 25035 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.580133 24807 raft_consensus.cc:2764] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:11.485410 24549 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.533946 25032 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.604198 24599 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.606415 24742 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:11.621407 24924 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:11.631403 24817 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:11.633908 24599 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.652508 25035 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.682945 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3139) took 1007 ms. Trace:
I20260709 12:19:11.683169 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.683933 24910 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:11.684439 24910 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.685091 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.686636 24910 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:11.689460 24960 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:11.691061 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.696992 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:11.697937 20325 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:11.683403 20328 rpcz_store.cc:276] 0709 12:19:10.675636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.676202 (+   566us) service_pool.cc:224] Handling call
0709 12:19:10.676489 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.676728 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:11.085726 (+408998us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.310500 (+224774us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.681891 (+371391us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b180000b680. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:19:11.682336 (+   445us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.682514 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:11.682567 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:11.682612 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.682676 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:11.682883 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19886,"prepare.queue_time_us":604296,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1568,"raft.queue_time_us":378107,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":1564,"spinlock_wait_cycles":185727488,"thread_start_us":617274,"threads_started":2,"wal-append.queue_time_us":281183}
I20260709 12:19:11.705335 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.713022 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 884) took 1159 ms. Trace:
I20260709 12:19:11.687474 24910 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:11.713445 20327 rpcz_store.cc:276] 0709 12:19:10.553848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.584675 (+ 30827us) service_pool.cc:224] Handling call
0709 12:19:10.585014 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:10.585338 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.585358 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:10.588759 (+  3401us) log.cc:844] Serialized 52 byte log entry
0709 12:19:10.819634 (+230875us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b180009f2e0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:19:11.198680 (+379046us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:11.403167 (+204487us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.705322 (+302155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.705418 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:11.705467 (+    49us) raft_consensus.cc:1685] finished
0709 12:19:11.712802 (+  7335us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:11.712960 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301858,"prepare.queue_time_us":98907,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":2618,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9388,"spinlock_wait_cycles":4019456,"thread_start_us":543710,"threads_started":2,"wal-append.queue_time_us":681902}
W20260709 12:19:11.735680 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.654455 24817 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.653203 24924 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:11.745793 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.660076 24599 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.748644 20328 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:11.711654 24981 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.755192 25048 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:11.755470 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87643.9us
I20260709 12:19:11.791590 20327 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:19:11.791123 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 98340.5us
W20260709 12:19:11.796473 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 110263us
I20260709 12:19:11.802084 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:11.806638 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.804656 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.793355 25032 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.756531 24981 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.755924 25048 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.824769 25056 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:11.832419 25055 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:11.817916 24925 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.854563 25054 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:11.855204 25054 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.856221 25056 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:11.858422 25054 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:11.847817 25044 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.101s	user 0.001s	sys 0.001s
W20260709 12:19:11.861879 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 57311us
I20260709 12:19:11.863086 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:11.868570 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.871236 24917 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:11.871857 24917 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:11.872758 24917 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.879390 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.846379 25050 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:11.901345 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 64952.4us
I20260709 12:19:11.866796 25047 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.906219 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:11.874688 24825 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:11.849848 24807 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:19:11.910647 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:11.898468 24599 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.897689 25055 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:11.907717 24825 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.934345 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:11.804020 25052 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 12:19:11.914913 24955 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:11.917476 25056 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:11.918876 25059 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:11.924005 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:11.925158 25048 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.944072 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.925904 24817 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.944343 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:11.929054 24780 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.001s
I20260709 12:19:11.945179 20248 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:11.945075 24780 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:11.945268 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.912178 25047 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:11.955868 25025 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.932s	user 0.007s	sys 0.002s
I20260709 12:19:11.913811 24910 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:11.929793 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.930300 25061 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:11.930603 20220 leader_election.cc:400] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:11.959404 20220 leader_election.cc:403] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:11.905558 25050 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.931030 25065 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.931704 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.931901 24924 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.933032 24981 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:11.933272 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:11.930634 24599 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:11.972502 24599 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:11.973271 20250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1142) took 1422 ms (client timeout 1537 ms). Trace:
W20260709 12:19:11.973747 20250 rpcz_store.cc:269] 0709 12:19:10.550911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.551424 (+   513us) service_pool.cc:224] Handling call
0709 12:19:11.973052 (+1421628us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540024efd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:11.973178 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579866880}
I20260709 12:19:11.936851 20249 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:19:11.939131 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.874549 24925 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.958555 20251 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:11.916450 25053 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:11.960289 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1175) took 1406 ms. Trace:
W20260709 12:19:11.975984 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 168123us
I20260709 12:19:11.947451 24780 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:11.955317 25047 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.975481 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:11.982319 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2852) took 1349 ms. Trace:
I20260709 12:19:11.982719 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:11.943596 25056 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:11.982751 20172 rpcz_store.cc:276] 0709 12:19:10.632937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.633176 (+   239us) service_pool.cc:224] Handling call
0709 12:19:11.982121 (+1348945us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400102f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:11.982254 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217289472}
W20260709 12:19:11.983922 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 150181us
I20260709 12:19:11.987262 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:11.985277 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:11.989282 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:11.962908 25048 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:11.980264 21038 rpcz_store.cc:276] 0709 12:19:10.551349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.551463 (+   114us) service_pool.cc:224] Handling call
0709 12:19:10.551764 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:10.552001 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.552026 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:10.552471 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:19:10.691790 (+139319us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:10.691834 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:10.691907 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:11.871391 (+1179484us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:11.956971 (+ 85580us) raft_consensus.cc:1685] finished
0709 12:19:11.957010 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:11.957343 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21866240,"thread_start_us":98916,"threads_started":1,"wal-append.queue_time_us":300535}
I20260709 12:19:11.964363 25055 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:11.958058 24955 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:11.975426 24910 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:11.995780 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:12.008044 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:11.998787 24969 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.002s
I20260709 12:19:12.011893 20178 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:19:12.012269 20178 pending_rounds.cc:85] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:19:12.012490 20178 pending_rounds.cc:107] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:19:12.012732 20178 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.012826 24955 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.007033 24910 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:12.014358 24910 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.007100 25055 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.016243 24599 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.017674 25055 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.018213 25050 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.018859 24825 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.979961 24817 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.004578 24700 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:12.019647 24817 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.020262 24780 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:12.020714 24780 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:12.021091 24780 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.021950 24817 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.022641 25064 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:12.023618 24904 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:12.024258 25022 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 1.206s	user 0.006s	sys 0.004s
I20260709 12:19:12.024135 24981 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:11.980216 25053 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:12.025226 25053 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:12.028716 24816 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.574s	user 0.004s	sys 0.008s
I20260709 12:19:11.992936 24924 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:12.029368 20180 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:12.029649 24924 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:12.030093 24924 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.031701 24903 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.030342 24780 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.033238 24903 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.004549 25047 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:19:12.034741 24780 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.031400 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.030614 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1138) took 1607 ms. Trace:
W20260709 12:19:12.030903 20180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3108) took 2027 ms (client timeout 2170 ms). Trace:
I20260709 12:19:12.040216 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:12.037298 20180 rpcz_store.cc:269] 0709 12:19:10.003836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.004011 (+   175us) service_pool.cc:224] Handling call
0709 12:19:12.030704 (+2026693us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54002c4554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:12.030842 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4638288640}
I20260709 12:19:12.000332 25032 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:12.050544 25037 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 12:19:12.051308 24957 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:12.051715 24599 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:12.031858 24901 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.051895 24957 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.052989 24700 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:12.054093 24700 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.054947 24957 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.037021 20253 rpcz_store.cc:276] 0709 12:19:10.422830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.423310 (+   480us) service_pool.cc:224] Handling call
0709 12:19:10.423657 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:10.424086 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.424129 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:10.435274 (+ 11145us) log.cc:844] Serialized 26 byte log entry
0709 12:19:10.587044 (+151770us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:10.587506 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:10.587610 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:11.964126 (+1376516us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:12.030290 (+ 66164us) raft_consensus.cc:1685] finished
0709 12:19:12.030314 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.030545 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4220,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4867,"spinlock_wait_cycles":158365440,"thread_start_us":114912,"threads_started":1,"wal-append.queue_time_us":360746}
I20260709 12:19:12.057524 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2298) took 1165 ms. Trace:
I20260709 12:19:12.058159 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.059275 24957 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.057914 20255 rpcz_store.cc:276] 0709 12:19:10.892442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.195504 (+303062us) service_pool.cc:224] Handling call
0709 12:19:11.195815 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:11.196027 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:11.196052 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:11.196611 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:19:11.446295 (+249684us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:11.446348 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.446414 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:12.049784 (+603370us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:12.057241 (+  7457us) raft_consensus.cc:1685] finished
0709 12:19:12.057262 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.057469 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29280640,"thread_start_us":249196,"threads_started":1,"wal-append.queue_time_us":398519}
I20260709 12:19:12.054746 24549 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:12.063000 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.064170 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.065491 25048 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:11.975179 25065 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.069032 24901 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:12.069482 24901 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.069837 24901 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:12.069994 25065 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:11.993052 25056 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:12.076284 25009 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:12.076967 25009 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:12.041241 20171 raft_consensus.cc:2368] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
W20260709 12:19:12.080245 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 88133.4us
I20260709 12:19:12.080889 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.082585 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2849) took 1451 ms. Trace:
I20260709 12:19:12.087644 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.088443 20171 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:12.089450 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.083021 20174 rpcz_store.cc:276] 0709 12:19:10.626812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.627644 (+   832us) service_pool.cc:224] Handling call
0709 12:19:11.282679 (+655035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:11.283346 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.078377 (+795031us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000c5dd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:12.078617 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505563392}
I20260709 12:19:12.103215 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.104770 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:12.107237 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.108316 24898 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:12.109105 24898 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:12.110522 24898 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.112962 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.115687 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.118009 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.119520 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.120494 20325 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:12.122058 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.124722 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.126232 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.127077 20321 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:12.128883 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:12.133337 20327 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:19:12.136270 20173 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:12.136832 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:12.138577 20171 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:12.138695 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:12.139074 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.139853 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.141067 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.137732 20249 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
I20260709 12:19:12.143239 20180 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:12.143519 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 79430.7us
I20260709 12:19:12.144410 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.143087 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.145366 20179 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:12.148171 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.149133 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.090517 25032 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:12.160921 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.141294 24928 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:12.164086 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 247003us
I20260709 12:19:12.078341 25009 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.106340 24979 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:19:12.157778 24922 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:12.172938 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.174180 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.177347 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.164445 24969 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:12.179979 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.177114 24899 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:12.165020 24925 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.166445 24928 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:12.168722 25069 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:12.179069 25052 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.204188 24960 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.204075 25032 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.204861 24960 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.208653 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.208904 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.210494 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:12.211266 21038 raft_consensus.cc:2368] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:12.176163 24780 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.230283 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:12.231541 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.231815 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.182377 24899 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.182801 24904 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:12.243091 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:12.241307 21037 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:12.187938 24928 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:12.241993 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.254928 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.208352 25045 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:12.198477 24826 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.212386 24925 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:12.198603 25069 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.184162 24922 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:12.261689 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.256608 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.257344 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.319240 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.253120 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.263815 25066 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.263862 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.264487 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.265105 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.323076 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:12.266330 20175 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:12.269214 24904 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:12.270503 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.328307 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.273789 25056 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.187208 25065 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:19:12.236075 24742 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:19:12.275995 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.332050 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.333243 20321 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:12.276603 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:12.334429 20330 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:12.259806 20322 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:12.284631 20324 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:19:12.285413 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.287106 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:12.259783 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78630.1us
I20260709 12:19:12.310806 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.312340 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:12.314697 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.320147 20174 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:19:12.242889 24817 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.244159 24317 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:12.343036 24317 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.344466 20173 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:12.265893 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.345504 20172 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:12.328948 20323 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:12.305289 24818 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.236404 24807 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:19:12.260128 24888 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:12.203994 25052 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.347807 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.351109 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:12.330543 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 92944.3us
I20260709 12:19:12.311476 24925 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:12.361038 20324 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:12.365588 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.316915 25045 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:12.243534 25063 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 12:19:12.321127 25069 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:12.369369 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:12.367663 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.260058 24780 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 12:19:12.371526 20327 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:12.380610 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 795) took 1625 ms. Trace:
I20260709 12:19:12.397811 20177 rpcz_store.cc:276] 0709 12:19:10.755154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.376293 (+621139us) service_pool.cc:224] Handling call
0709 12:19:12.073189 (+696896us) spinlock_profiling.cc:243] Waited 941 us on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:19:12.073473 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.073757 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:12.335419 (+261662us) log.cc:844] Serialized 14 byte log entry
0709 12:19:12.380173 (+ 44754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.380251 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:12.380315 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.380404 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.380537 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9043,"prepare.queue_time_us":126504,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":114,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":2164096,"thread_start_us":194856,"threads_started":2}
I20260709 12:19:12.383710 20220 leader_election.cc:400] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:19:12.384891 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.394960 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.399955 20220 leader_election.cc:403] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:12.401998 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.398761 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.396178 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:12.402892 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.403422 20249 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.403549 21042 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:12.405869 21043 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:12.408998 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.409243 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:12.316640 24901 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.371917 24925 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:12.348852 24904 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.332094 25066 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.568011 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:12.398026 24855 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:12.602905 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 193963us
I20260709 12:19:12.412765 25046 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.607030 20247 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:12.616422 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:12.405431 24742 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.625677 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.401639 25054 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.631946 20249 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:12.412914 24825 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.609954 24506 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:19:12.605535 25064 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:12.659987 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 43724.1us
I20260709 12:19:12.661607 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:12.562906 24817 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:12.615562 24816 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:12.626911 24826 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.567211 24859 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:19:12.511646 25070 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9.
I20260709 12:19:12.615368 24954 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:12.674044 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 263879us
I20260709 12:19:12.665175 25071 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.689890 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:12.665913 25032 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.511338 24922 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.690809 24780 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:12.710325 24780 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.710443 25066 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.710727 24780 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:12.650725 24742 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.712838 24904 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.713511 24742 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.693363 24816 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.715847 24954 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.716495 25056 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:12.718086 24954 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:12.676173 25074 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.359s	user 0.000s	sys 0.000s
I20260709 12:19:12.694408 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.658674 25045 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.689483 24826 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.704860 24910 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.705224 24817 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.706225 25072 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:12.706326 25081 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 12:19:12.707062 25075 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 12:19:12.707388 24903 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.669185 25047 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:12.728571 25084 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:19:12.655797 25054 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.723459 24899 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.725104 24901 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.725832 24317 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.726769 25052 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:12.719305 24924 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.002s
W20260709 12:19:12.730255 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 105842us
W20260709 12:19:12.720830 25078 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:19:12.728039 25053 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.005s
W20260709 12:19:12.722216 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 96669.3us
I20260709 12:19:12.753540 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:12.736968 25076 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:19:12.734108 25070 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.734526 25072 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.781391 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.778764 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.768537 24903 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:12.786984 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 120769us
I20260709 12:19:12.744071 24825 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:19:12.796855 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:12.808568 24826 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:12.809652 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56226.1us
I20260709 12:19:12.811635 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:12.795377 25099 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:12.803107 24903 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.805956 25104 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:12.791009 25072 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:12.810858 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:12.822892 24825 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:12.823295 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.823501 24825 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.824007 24825 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.826970 20219 leader_election.cc:400] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
I20260709 12:19:12.827765 25071 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:12.828193 25071 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:12.829197 25103 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:12.829130 25071 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.777025 24924 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.816751 25102 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:12.834025 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.769675 25095 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:19:12.835366 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.835537 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:12.839530 21042 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:12.839901 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.840659 20177 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:12.843436 24901 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:12.843886 24901 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.844240 24901 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:12.844798 24928 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 12:19:12.845254 24928 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.848887 25054 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.849182 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2867) took 1459 ms. Trace:
I20260709 12:19:12.831786 24700 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:19:12.849568 20178 rpcz_store.cc:276] 0709 12:19:11.390235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.399178 (+  8943us) service_pool.cc:224] Handling call
0709 12:19:11.399589 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.013228 (+613639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.848936 (+835708us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54000c62d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:12.849117 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407155456}
I20260709 12:19:12.783594 25053 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.850832 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.851272 20326 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:12.852264 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:12.853685 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.811844 25056 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:19:12.854839 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.853685 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.851432 20178 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:12.860988 24817 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.861575 21042 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:12.857877 20175 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:12.866873 25047 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:12.870842 24825 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.873930 24925 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.875748 24928 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:12.875934 25096 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:19:12.876762 20254 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:12.831782 25071 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.866178 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:12.879139 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 43845.5us
I20260709 12:19:12.878332 24811 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:12.833374 25104 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:12.889151 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.893909 20254 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:12.899330 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:12.903422 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:12.902563 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:12.905308 20323 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:12.906388 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:12.901299 20254 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.910044 20254 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.911458 24817 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.912082 24817 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:12.914785 24817 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:12.900722 25104 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.884663 24818 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:12.915557 25095 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:12.900127 24922 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:12.915743 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:12.917750 24825 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.888656 24700 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:12.904450 25054 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:12.919608 20177 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:12.904527 24811 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.857874 24901 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:12.925565 24898 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:12.930403 20254 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:19:12.971225 20254 pending_rounds.cc:85] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 10
I20260709 12:19:12.969539 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.971639 20254 pending_rounds.cc:107] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:19:12.971911 20254 raft_consensus.cc:2889] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.972427 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:12.949230 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:12.967514 24922 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.976261 24922 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:12.927150 25101 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:12.980890 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:12.981647 20323 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.985095 21042 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:12.927314 24815 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:12.985956 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 148608us
I20260709 12:19:12.906265 25047 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:19:12.936088 24903 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:12.933481 25104 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:12.965354 24910 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.972848 24898 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:12.992708 24815 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.048691 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.049671 20171 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:12.965348 24818 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.057477 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:13.061703 20323 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:13.029507 25095 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:13.062510 25082 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.030424 24700 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.030351 25101 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.035683 25053 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:13.063128 25082 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.068629 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:12.980152 25045 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:19:13.069288 20179 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:13.063139 25095 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.051996 24815 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.075735 25118 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:13.076382 25043 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:19:13.076344 25118 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.078900 25118 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.080948 24700 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.067586 25101 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:13.104943 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.107491 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.122107 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.127058 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:13.128814 25045 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.133795 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.135670 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.137183 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.141134 20179 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:13.039855 24910 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.056492 24780 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.149822 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.151955 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:13.101257 25053 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.153532 21039 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:13.155907 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.158083 21034 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:13.158110 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:13.160439 20329 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:13.160923 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.163712 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:13.163923 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.164251 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.149696 24825 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.146865 25102 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.181034 20174 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:13.152686 24925 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.183391 24811 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.196188 24811 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.196669 24811 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.198822 24811 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.164578 24817 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:13.200814 24924 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.129496 25045 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.203748 25045 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.148259 24898 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.204785 24898 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.184844 21040 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:19:13.185163 24825 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.186893 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.188365 21039 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:13.189294 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.191154 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.159271 25112 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.220082 25112 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.177100 24969 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:13.225054 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.225404 25082 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.226749 21040 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:13.163552 24928 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:13.241509 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 50443.2us
I20260709 12:19:13.247131 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:13.247534 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.251363 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.251890 20252 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:19:13.253329 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:13.254487 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.255884 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.256543 20248 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:19:13.257607 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.181758 24904 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:13.241824 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.266100 20247 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:13.268023 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.248252 24954 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:13.250425 21040 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:13.162163 25053 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.301601 20247 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:13.227443 25112 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.249656 24969 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.307703 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:13.265976 25069 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.854s	user 0.012s	sys 0.003s
I20260709 12:19:13.312525 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:13.304972 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.214591 25102 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.268249 25032 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:13.273694 25082 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:13.301118 24924 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.325511 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 697) took 1019 ms. Trace:
I20260709 12:19:13.299583 25095 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.332178 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.336447 20255 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:13.263522 24815 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.265380 24928 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.263527 25072 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.314518 24920 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.351393 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.319705 25112 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.267309 24925 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:13.322345 24817 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:13.329340 25082 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.353960 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:13.333238 21036 rpcz_store.cc:276] 0709 12:19:12.306477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.308839 (+  2362us) service_pool.cc:224] Handling call
0709 12:19:12.324340 (+ 15501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.346846 (+ 22506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.346889 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.346937 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:12.346991 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.325262 (+978271us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5400662454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:13.325314 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:13.325449 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51222912}
I20260709 12:19:13.355084 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:13.334133 25032 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:13.314033 24904 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:19:13.314312 25121 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:19:13.357321 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.322502 25069 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.334794 24811 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:13.361644 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.364513 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.365839 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.339920 25122 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.360450 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.372444 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.377681 20256 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:13.377269 20324 raft_consensus.cc:2410] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:19:13.381700 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.358703 24818 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.365870 25082 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.395596 20325 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:13.381276 25122 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.362136 25112 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.344559 25095 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.360764 24817 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.355196 24920 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.398926 20329 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:19:13.416157 24922 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.438822 24815 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:13.438949 25095 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.440814 24928 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.431758 24817 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.446256 25032 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:13.402146 25116 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:19:13.432946 20329 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 7
I20260709 12:19:13.380681 24910 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.434528 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.382814 24811 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.454489 24825 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.455171 24920 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.396003 24780 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.461284 25069 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:13.468704 20329 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:19:13.481156 20329 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:13.485415 24952 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.487740 20251 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:13.491206 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.491895 20250 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:13.495412 24901 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.501775 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.502477 20329 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:13.504422 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.505052 20326 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:13.508723 25112 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.510043 25053 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.513295 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:13.418438 20255 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:13.471686 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.471746 20324 raft_consensus.cc:2410] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:13.473645 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3148) took 1221 ms. Trace:
I20260709 12:19:13.515990 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:13.516237 20327 rpcz_store.cc:276] 0709 12:19:12.252614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.252763 (+   149us) service_pool.cc:224] Handling call
0709 12:19:12.253036 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.397529 (+144493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.473290 (+1075761us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000cf654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:13.473559 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272048384}
I20260709 12:19:13.479809 24811 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.517836 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.518486 20326 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:13.521988 25102 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.524396 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.525349 24960 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.528746 24960 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:13.531026 25072 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.539742 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.523341 24816 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.544585 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.545284 20249 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:13.548637 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.551735 24816 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:13.552361 24816 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.552893 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.553732 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.554137 24904 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:13.554767 24904 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.560339 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.561007 25055 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:13.561928 20249 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:13.562218 25055 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:13.564726 25101 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.565855 20249 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:13.566799 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.567222 20247 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:13.563148 25055 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.569078 25055 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:13.569738 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:13.570526 25057 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:13.561491 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.572237 20256 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.572927 24904 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.573764 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.487185 25122 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.574765 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:13.561365 20254 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:13.575750 25057 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:13.578423 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:13.580983 24816 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.581194 25092 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:13.581610 25092 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:13.581981 25092 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:13.586658 20256 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:13.587402 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.592422 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:13.591204 25092 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.618080 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:13.618835 24780 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:13.594136 24955 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:13.619252 24780 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.619449 24955 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:13.619740 24780 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:13.620450 24955 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.622670 25121 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:13.623152 25121 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.618497 25092 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:13.598294 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1199) took 1368 ms. Trace:
I20260709 12:19:13.603853 24816 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:13.623683 24952 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:13.624106 21038 rpcz_store.cc:276] 0709 12:19:12.229829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.229985 (+   156us) service_pool.cc:224] Handling call
0709 12:19:13.598093 (+1368108us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54005d5a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:13.598230 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687753600}
I20260709 12:19:13.625243 24816 consensus_queue.cc:1243] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:13.625767 24818 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:13.597574 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:13.626159 24818 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:13.626647 25057 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:13.627131 24818 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.628306 24818 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:13.613587 24917 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:13.628993 24922 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.629290 24917 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.554080 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.619810 20175 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:13.622546 24924 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:13.633468 25121 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:13.623387 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:13.634491 24924 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:13.634915 24924 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.635303 24924 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:13.639626 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.641048 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.641741 20254 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:13.641587 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.642879 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.594334 24925 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:13.643939 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:13.644150 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.612967 20323 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:13.659127 20322 raft_consensus.cc:2410] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:13.647154 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:13.614353 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:13.663414 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49146.9us
I20260709 12:19:13.666868 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:13.668538 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.669011 20324 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:13.646567 20250 raft_consensus.cc:2376] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9. Re-sending same reply.
I20260709 12:19:13.671281 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.672271 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.672290 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.677860 20325 raft_consensus.cc:2368] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:19:13.692128 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:13.693023 21036 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:13.693904 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2873) took 1444 ms. Trace:
I20260709 12:19:13.694331 20173 rpcz_store.cc:276] 0709 12:19:12.249415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.249527 (+   112us) service_pool.cc:224] Handling call
0709 12:19:12.265755 (+ 16228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.344892 (+ 79137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.693592 (+1348700us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54000a5d54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:13.693809 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180541696}
I20260709 12:19:13.696722 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:13.692710 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.697677 20176 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:13.702533 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.649025 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:13.596679 25101 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:13.707373 20250 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:13.709672 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.710485 20250 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.711715 20253 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:13.700374 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:13.712697 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.714310 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:13.715119 20324 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:13.587155 25082 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.719296 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.720134 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.721570 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.727543 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.716671 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.730193 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.730795 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.731926 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.732532 21043 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:13.731259 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:13.729595 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 80682.6us
I20260709 12:19:13.734625 25050 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:13.737138 24901 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:13.662545 24317 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:13.746359 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.747566 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:13.743494 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:13.743718 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.749830 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:13.746891 25112 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:13.746021 24904 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:13.754532 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:13.814993 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 65234.1us
W20260709 12:19:13.815243 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 60781.3us
I20260709 12:19:13.755960 24922 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:13.711138 24917 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:13.711122 25066 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:19:13.715515 24961 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:19:13.747135 24413 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:13.726666 25045 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:19:13.710757 24971 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
W20260709 12:19:13.741096 25104 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 12:19:13.771270 24954 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.772325 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.866691 21036 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:13.841882 24981 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:13.746476 25122 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:13.697763 25092 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:13.777801 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.539470 24817 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.786953 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:13.793881 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:13.894011 20179 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:13.856978 25047 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:13.799743 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.800326 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:13.800835 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:13.791956 25094 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:13.804253 20175 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:13.817807 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:14.185967 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 368242us
I20260709 12:19:13.818720 20250 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:13.819032 20256 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:13.841081 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.845746 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:13.801898 24898 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:19:13.816393 25082 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:13.821063 25103 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:13.803799 24780 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.738595 25099 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:14.210947 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 365300us
I20260709 12:19:13.821461 25112 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:13.848496 24960 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:13.892405 20253 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:13.898885 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 98660.1us
W20260709 12:19:14.101722 20251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.101s	sys 0.164s
W20260709 12:19:14.214490 20251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.114s	sys 0.181s
I20260709 12:19:13.874966 25104 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.215307 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:13.861209 25121 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:13.873766 24981 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.856990 24969 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:19:13.917761 25047 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:13.888278 24954 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.169843 20173 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 7: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:13.876822 24413 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:14.200519 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 357287us
I20260709 12:19:14.236606 20180 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:14.199776 25103 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:14.181556 25128 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.288s	user 0.000s	sys 0.009s
I20260709 12:19:14.171645 25122 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:14.223665 24925 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.182464 25094 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.246085 24817 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.240289 25103 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.216902 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:14.219183 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:14.217681 25082 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:14.181119 24901 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:14.203518 24917 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.204562 25065 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:14.221382 24981 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.219791 24960 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:14.180068 25055 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.611s	user 0.015s	sys 0.002s
W20260709 12:19:14.262600 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 43527.5us
W20260709 12:19:14.263456 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46637.7us
I20260709 12:19:14.268124 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.239704 25072 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:19:14.278781 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1822) took 1064 ms. Trace:
I20260709 12:19:14.278931 20252 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:14.279181 20255 rpcz_store.cc:276] 0709 12:19:13.213841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.213971 (+   130us) service_pool.cc:224] Handling call
0709 12:19:14.278551 (+1064580us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54000497d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:14.278714 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179928320}
I20260709 12:19:14.276667 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:14.289903 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 103209us
I20260709 12:19:14.294210 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.296128 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.296795 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.297654 20171 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:14.297775 20176 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:14.298197 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:14.302107 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.272121 24817 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:14.304248 25047 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:14.304553 24817 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.305084 24817 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:14.305858 24924 consensus_meta.cc:287] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.670s	user 0.014s	sys 0.005s
I20260709 12:19:14.306322 24924 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.308804 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3139) took 1319 ms. Trace:
I20260709 12:19:14.309206 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:14.309211 20174 rpcz_store.cc:276] 0709 12:19:12.989898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.116731 (+126833us) service_pool.cc:224] Handling call
0709 12:19:13.117094 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.181548 (+ 64454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.308519 (+1126971us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b54002409d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:14.308742 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111235968}
I20260709 12:19:14.266949 25122 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.266753 25065 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:14.311371 20176 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:14.275074 24925 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:14.346052 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:14.304306 24818 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.675s	user 0.017s	sys 0.003s
W20260709 12:19:14.308878 25130 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:19:14.339552 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45962.4us
I20260709 12:19:14.305891 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:14.308593 24924 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.359591 24924 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.360159 24924 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.289166 25032 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:14.364012 24954 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.365231 24817 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.365661 24780 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.366503 24780 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.339701 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 799) took 1535 ms. Trace:
W20260709 12:19:14.359694 25136 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:19:14.367545 24817 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:14.367352 20172 rpcz_store.cc:276] 0709 12:19:12.804800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.861305 (+ 56505us) service_pool.cc:224] Handling call
0709 12:19:12.861641 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:12.862021 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.862053 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:12.874753 (+ 12700us) log.cc:844] Serialized 52 byte log entry
0709 12:19:12.926430 (+ 51677us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:12.967724 (+ 41294us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.287084 (+1319360us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54001ec6a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae73733 00007f5ddaef8dbf 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c
0709 12:19:14.287143 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.287232 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:14.287282 (+    50us) raft_consensus.cc:1685] finished
0709 12:19:14.339450 (+ 52168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.339637 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2829,"prepare.queue_time_us":42053,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":68910,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":22493,"spinlock_wait_cycles":113373440,"thread_start_us":175554,"threads_started":2,"wal-append.queue_time_us":162190,"wal-append.run_cpu_time_us":3081,"wal-append.run_wall_time_us":1129820}
I20260709 12:19:14.374590 25094 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:14.384954 25121 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.387603 24960 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:14.298436 24413 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.277387 24904 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:19:14.258960 25112 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.394091 24826 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:14.394573 24826 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:14.271551 24901 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:14.398151 24317 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:14.398581 24317 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:14.291700 24898 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 12:19:14.399827 24898 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:14.400214 24898 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:14.401046 24898 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.402357 24898 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:14.404117 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1895) took 1043 ms. Trace:
I20260709 12:19:14.404498 20322 rpcz_store.cc:276] 0709 12:19:13.361194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.361314 (+   120us) service_pool.cc:224] Handling call
0709 12:19:14.403898 (+1042584us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003aded4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:14.404049 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649865472}
I20260709 12:19:14.407701 24955 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.256655 25062 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 12:19:14.414108 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.418272 25055 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.418802 25055 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.398629 24901 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:14.422626 20177 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:19:14.424104 20177 pending_rounds.cc:85] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 7
I20260709 12:19:14.424357 20177 pending_rounds.cc:107] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:19:14.424610 20177 raft_consensus.cc:2889] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:14.343173 25065 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:14.430302 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 192818us
I20260709 12:19:14.432335 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.434005 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:14.435020 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:14.421669 25122 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:14.458405 25099 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:14.462386 25132 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:19:14.463748 25104 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.465543 25055 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:14.459386 25099 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:14.483995 20251 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:14.435837 24960 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:14.438344 24917 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:14.497119 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:14.497865 20322 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:14.435297 24742 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:19:14.504951 25099 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:14.508240 24954 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.510915 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:14.511080 24954 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.511857 24917 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:14.512742 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 166776us
I20260709 12:19:14.512925 24917 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.513587 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.513854 24954 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:14.514389 25082 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.514935 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.511746 25091 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:14.515707 25091 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.516193 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:14.517483 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:14.517799 24925 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.518072 24818 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:14.518616 24818 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:14.519599 24818 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.522032 24816 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:14.509550 20248 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:14.422266 24317 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.511734 20251 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:14.525532 24742 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:14.529111 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.549614 20329 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:14.531217 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.532843 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:14.533144 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:14.550719 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.395438 24826 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.540078 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:14.541903 20249 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:14.556548 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:14.558338 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:14.559141 20249 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:14.545302 20253 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:14.547631 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.563746 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.552120 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.553802 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.570861 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.481015 25122 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.549222 24742 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:14.517783 25091 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:14.575209 24780 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.538154 25052 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:14.578877 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 303680us
I20260709 12:19:14.581648 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:14.570806 25092 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.570982 25140 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.571691 24317 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.591471 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:14.586603 25091 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:14.593516 25091 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:14.593925 25091 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:14.594338 25122 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:14.595359 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:14.598222 25147 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.600975 25146 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:14.564754 24954 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:19:14.604342 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 265738us
I20260709 12:19:14.610666 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.644025 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:14.582008 25150 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:14.658504 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:14.574774 24742 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.588158 25092 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:14.580793 25052 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:14.580562 25104 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:19:14.687361 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:14.671268 20172 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:14.673025 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:14.691227 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44479.3us
I20260709 12:19:14.676213 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.678735 20174 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:14.601064 25145 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:19:14.674732 20171 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:14.665340 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:14.658811 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 73273.7us
I20260709 12:19:14.700037 20173 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:14.701678 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.688148 20251 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:14.702636 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:14.703302 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:14.703882 20179 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.692759 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:14.706302 20174 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:14.690701 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:14.708982 20178 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:14.711614 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:14.717935 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.719185 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:14.657918 25050 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:14.658243 25122 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.731034 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:14.733071 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:14.734094 20248 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:14.735229 20256 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
W20260709 12:19:14.748241 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 390619us
I20260709 12:19:14.751031 24899 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.753569 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:14.592659 25140 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:14.757627 20173 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:14.670020 24817 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:14.809965 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.727885 25121 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:14.737787 24742 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:14.816772 20173 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:19:14.767004 25135 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:19:14.829653 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 80265.3us
I20260709 12:19:14.754631 24960 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:14.831120 20249 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:14.832369 20219 leader_election.cc:400] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:19:14.834746 20219 leader_election.cc:403] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.753808 24955 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:14.651101 25099 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.745851 24969 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:14.833153 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 102209us
W20260709 12:19:14.851183 20219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.930s (SENT) [suppressed 1 similar messages]
I20260709 12:19:14.754776 25094 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 12:19:14.880846 20249 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:14.825719 25121 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.699774 25150 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:14.902858 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 326860us
W20260709 12:19:14.920214 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 169868us
I20260709 12:19:14.921857 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:14.840227 24898 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.834215 24960 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:14.873939 24899 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.923271 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:14.818200 24817 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.924401 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:14.924470 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:14.873739 25112 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 6. Current term is 7.
I20260709 12:19:14.863214 24979 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:14.822278 20179 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:14.928735 21035 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:14.981017 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:14.930611 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:14.939729 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 198552us
I20260709 12:19:14.923601 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:14.888429 25148 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.906813 25121 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:14.863586 24955 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.986393 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:14.993659 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 106454us
I20260709 12:19:14.975706 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:14.882344 24969 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.831073 25052 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.973332 24960 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.975301 25104 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.973392 25149 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:15.017939 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 153101us
I20260709 12:19:15.004562 25102 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:14.973094 24898 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.039439 25183 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:19:14.999133 25094 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:19:15.041565 25102 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:15.056838 25112 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:15.057292 25112 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:15.058106 24826 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:15.058331 25112 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.060706 25150 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.028128 24961 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:15.064185 24961 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:15.065321 24961 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.066588 25070 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:15.067165 25070 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:15.026198 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 175050us
W20260709 12:19:15.042763 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 115878us
I20260709 12:19:15.091347 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.091620 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.065127 25092 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:14.988593 24899 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.048585 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 714) took 1411 ms. Trace:
I20260709 12:19:15.093076 21041 rpcz_store.cc:276] 0709 12:19:13.637175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.637909 (+   734us) service_pool.cc:224] Handling call
0709 12:19:13.638199 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.638555 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:13.638601 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:14.661702 (+1023101us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b2c000bb028. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:19:14.662395 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:19:14.926336 (+263941us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:19:14.926380 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.926462 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:15.048249 (+121787us) raft_consensus.cc:1685] finished
0709 12:19:15.048275 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.048517 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":78,"spinlock_wait_cycles":56150272,"thread_start_us":263543,"threads_started":1,"wal-append.queue_time_us":384001}
I20260709 12:19:15.106420 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:15.107178 21043 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:15.110057 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:15.049860 25134 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.868s	user 0.012s	sys 0.001s
W20260709 12:19:15.052735 25154 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 12:19:15.071664 24925 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.001s
W20260709 12:19:15.052124 25152 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:15.131000 21039 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:15.131196 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.045447 24898 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.048839 24955 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:15.144747 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 145545us
I20260709 12:19:15.148613 21043 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:15.028648 25104 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.068367 25070 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.125660 25112 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:15.156687 25102 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.160547 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1180) took 1429 ms. Trace:
I20260709 12:19:15.162552 25148 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:15.216748 20253 rpcz_store.cc:276] 0709 12:19:13.731218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.747337 (+ 16119us) service_pool.cc:224] Handling call
0709 12:19:15.160328 (+1412991us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000d8754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:15.160471 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331419904}
I20260709 12:19:15.217051 25148 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.164582 25052 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:15.168998 25179 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.220074 25179 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.222326 25179 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:15.170706 25160 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.436s	user 0.002s	sys 0.000s
I20260709 12:19:15.172529 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.174682 24917 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.174610 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:15.176733 25159 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.443s	user 0.001s	sys 0.000s
I20260709 12:19:15.177431 25176 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:15.177552 25162 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:15.178551 25172 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:15.178828 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:15.178977 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53513.1us
I20260709 12:19:15.179780 25122 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:15.182130 20322 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:15.184207 20248 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:19:15.190713 25064 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:15.193351 25146 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:15.194099 25186 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:14.999809 24979 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.157258 21041 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:15.142059 24925 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.250059 25122 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.204953 24955 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.029017 25149 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.259336 25102 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:15.242611 25182 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:15.251626 25140 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.251223 25146 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:15.242846 24917 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.284456 25155 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:15.270223 24955 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.301163 24917 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:15.263928 25186 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:15.317289 25147 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:15.317726 25147 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:15.318610 25147 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.318847 25186 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:15.318787 24955 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.303263 25149 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.290939 25148 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.304153 25145 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:15.306130 25092 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.306936 25047 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:15.449519 25047 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:15.311655 24969 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.450565 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:15.381431 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2896) took 1602 ms. Trace:
I20260709 12:19:15.451735 20175 rpcz_store.cc:276] 0709 12:19:13.779326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.779470 (+   144us) service_pool.cc:224] Handling call
0709 12:19:13.784888 (+  5418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:14.189781 (+404893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.380471 (+1190690us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54001d24d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:15.381119 (+   648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44023680}
W20260709 12:19:15.385004 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:15.308290 24981 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.026s	user 0.009s	sys 0.003s
W20260709 12:19:15.391896 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 389471us
I20260709 12:19:15.454994 24981 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.456147 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:15.245805 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:15.401970 20326 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
W20260709 12:19:15.423712 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.459517 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:15.459643 25032 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:15.412343 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:15.425865 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:15.460533 25047 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.461503 20179 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:15.462755 25047 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:15.433380 24817 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.436143 24818 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.441854 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:15.465041 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.464579 24818 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.378568 20077 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 6 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:15.443074 20174 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:15.444255 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:15.447201 20176 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:15.315886 24899 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:15.459328 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 213468us
I20260709 12:19:15.448141 24925 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.467633 20173 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:15.467501 24925 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.468922 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:15.309257 24979 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:15.273454 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 271828us
I20260709 12:19:15.461261 20329 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:15.382298 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2882) took 2394 ms. Trace:
I20260709 12:19:15.471149 20180 rpcz_store.cc:276] 0709 12:19:12.801782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.856470 (+ 54688us) service_pool.cc:224] Handling call
0709 12:19:12.856768 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:14.241325 (+1384557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.195433 (+954108us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540031a1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:15.195676 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3167984000}
I20260709 12:19:15.326808 24924 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.479885 24979 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:15.480823 24979 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.481949 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:15.482368 20077 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:15.431241 24780 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.488058 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:15.488190 24780 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.490496 20180 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:15.490903 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:15.491099 24780 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.434551 24816 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.492234 24816 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.495884 24979 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.492599 24925 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.498466 24818 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.500108 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.503865 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.504191 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:15.329030 25050 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 12:19:15.270823 25064 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:15.310951 25065 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.875s	user 0.006s	sys 0.006s
I20260709 12:19:15.320641 25070 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:15.325256 25091 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.004s
W20260709 12:19:15.303117 25103 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.032s	user 0.011s	sys 0.000s
I20260709 12:19:15.327997 25104 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.332876 25145 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:15.311995 25146 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.324887 25147 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:15.297647 25155 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:15.308746 25156 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
W20260709 12:19:15.308682 25168 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:19:15.504694 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45491.6us
I20260709 12:19:15.276531 25182 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:15.523494 24742 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.013s
I20260709 12:19:15.339385 25121 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.529932 24816 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.534721 25062 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:15.542889 25062 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:15.543735 25062 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:15.545631 25121 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.547000 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:15.550572 25099 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:15.529968 24960 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.552125 25153 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:15.552577 25153 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.553030 25153 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:15.552671 25099 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:15.553509 24960 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:15.554476 24960 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:15.555100 25099 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:15.561841 25148 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:15.577346 24903 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.012s	sys 0.014s
I20260709 12:19:15.555552 24960 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:15.555919 24952 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:15.561653 25122 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:15.538890 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:15.560348 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 148567us
I20260709 12:19:15.528308 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:15.535058 25050 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:15.583112 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.593933 25064 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.580555 20077 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:15.595463 25061 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:15.595711 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 107943us
W20260709 12:19:15.596484 24903 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.013s	sys 0.015s
I20260709 12:19:15.596174 20077 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 10 to 11, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.597604 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:15.597944 25112 raft_consensus.cc:2764] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:19:15.598699 25183 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.600049 20173 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:15.593945 20324 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:19:15.601562 20324 pending_rounds.cc:85] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 8
I20260709 12:19:15.601814 20324 pending_rounds.cc:107] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:19:15.602109 20324 raft_consensus.cc:2889] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:15.602983 24317 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.012s
I20260709 12:19:15.603699 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.606050 20250 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:15.598397 20077 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 8 to 10, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 10 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:15.607395 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.587637 25121 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:15.579914 25099 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.617203 25056 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:15.618300 24742 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:15.618957 24742 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:15.619904 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 90165.6us
W20260709 12:19:15.620323 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 73524.4us
I20260709 12:19:15.626118 24742 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.629170 24888 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:19:15.632434 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1914) took 1102 ms. Trace:
I20260709 12:19:15.632884 20324 rpcz_store.cc:276] 0709 12:19:14.529898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.530012 (+   114us) service_pool.cc:224] Handling call
0709 12:19:14.530333 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.602710 (+1072377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.632093 (+ 29383us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540022e054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:15.632352 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402611584}
I20260709 12:19:15.633898 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:15.625547 25103 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.635993 25065 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.637804 25103 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.638311 25065 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.638556 25103 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:15.639362 20255 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:15.640347 20254 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:15.640450 25145 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.642498 25145 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:15.542765 25091 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.624179 25099 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:15.635074 25062 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.652374 25057 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:15.652650 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:15.653091 24961 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.653391 25170 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:15.654357 24954 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:15.655861 25194 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:15.656915 25146 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:15.663812 25170 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.665159 25062 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.666683 25170 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:15.657289 25155 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.599401 25183 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.663071 24954 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.670855 24954 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:15.671756 25155 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:15.667205 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:15.669808 24961 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.663861 25194 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.672564 25183 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.681507 25194 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.682376 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:15.683343 25064 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:15.685721 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 88324.5us
I20260709 12:19:15.613684 25148 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.663304 25057 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:15.688596 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54997.7us
I20260709 12:19:15.689491 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:15.690832 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:15.692229 25183 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:15.693485 20324 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:15.693702 21041 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:15.692373 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.692263 25050 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:19:15.697856 21036 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:15.681512 25199 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:15.698553 24961 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:15.699385 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:15.699982 20325 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:15.704001 24904 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:15.704766 25148 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.712975 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.716742 25091 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:15.717885 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 72318.6us
I20260709 12:19:15.717801 25207 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:15.721024 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:15.724664 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.728744 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:15.733644 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.735481 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:15.734679 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:15.741720 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:15.742033 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.747795 21034 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:15.748695 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.748970 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:15.748867 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:15.748872 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:15.750581 21041 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:15.750605 21040 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:15.754099 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:15.755162 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1181) took 1284 ms. Trace:
I20260709 12:19:15.755525 20254 rpcz_store.cc:276] 0709 12:19:14.471002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.476114 (+  5112us) service_pool.cc:224] Handling call
0709 12:19:14.476481 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.640835 (+1164354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.754873 (+114038us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002ddf54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:15.755080 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675610496}
I20260709 12:19:15.763675 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:15.764432 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:15.764889 25102 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:15.764330 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:15.765599 25102 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.776950 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:15.777223 24898 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:15.778002 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.778985 20325 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:15.779516 25050 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:15.777844 24898 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:15.780442 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:15.782359 25052 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.013s
I20260709 12:19:15.782994 25047 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:15.755945 25057 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:15.784075 25047 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:15.784897 25047 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:15.786219 25056 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:15.786609 25056 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:15.789145 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 1844) took 1202 ms. Trace:
I20260709 12:19:15.789525 20255 rpcz_store.cc:276] 0709 12:19:14.587252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.587416 (+   164us) service_pool.cc:224] Handling call
0709 12:19:14.587795 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.639856 (+1052061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.788808 (+148952us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003caad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:15.789063 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417431424}
I20260709 12:19:15.790599 25070 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:15.791312 24981 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:15.794956 25056 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:15.805459 20077 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 9 to 12, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:15.808101 25182 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:15.818856 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:15.780408 25102 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:15.821130 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.820686 20325 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:15.775801 25148 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:15.848801 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.851820 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.853432 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.855888 24904 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:15.852805 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.855502 24952 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:15.865931 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.863543 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:15.866093 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:15.904171 20077 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 4 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:16.022882 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:16.048812 25197 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.076220 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:15.815444 25103 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 12:19:16.163841 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 303647us
I20260709 12:19:16.023535 21038 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:15.845021 24903 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:16.155762 25147 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:16.165185 20255 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:16.171471 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:16.171641 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:16.168286 25070 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:16.171705 25197 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.172569 20326 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:19:16.178746 20173 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
W20260709 12:19:16.263410 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 448788us
I20260709 12:19:16.164247 25122 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.282882 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:16.289171 20329 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:16.314332 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 308) took 10727 ms. Trace:
W20260709 12:19:16.317940 24954 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.646s	user 0.014s	sys 0.000s
I20260709 12:19:16.318413 24954 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.324163 25207 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:16.324465 25122 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.324982 25207 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.326606 24888 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.326910 25122 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.327893 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1213) took 1406 ms. Trace:
I20260709 12:19:16.328393 25050 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:16.328311 21038 rpcz_store.cc:276] 0709 12:19:14.921361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.921557 (+   196us) service_pool.cc:224] Handling call
0709 12:19:16.327681 (+1406124us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540056c7d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:16.327814 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981833984}
I20260709 12:19:16.329150 25050 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:16.327400 24888 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.314822 20075 rpcz_store.cc:276] 0709 12:19:05.587199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.590890 (+  3691us) service_pool.cc:224] Handling call
0709 12:19:16.314033 (+10723143us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:08.498071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:08.498749 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:08.498791 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:19:08.498810 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:08.720708 (+221898us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:08.720810 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:08.720838 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:19:08.722425 (+  1587us) tablet.cc:701] Row locks acquired
0709 12:19:08.722440 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:19:08.722598 (+   158us) write_op.cc:270] Start()
0709 12:19:08.722727 (+   129us) write_op.cc:276] Timestamp: P: 1783599548722548 usec, L: 0
0709 12:19:08.722745 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:19:08.723492 (+   747us) log.cc:844] Serialized 7860 byte log entry
0709 12:19:09.404826 (+681334us) op_driver.cc:464] REPLICATION: finished
0709 12:19:09.720377 (+315551us) write_op.cc:301] APPLY: starting
0709 12:19:09.724375 (+  3998us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:10.050406 (+326031us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:10.050530 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:10.246171 (+195641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:10.246514 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:19:10.246560 (+    46us) write_op.cc:312] APPLY: finished
0709 12:19:10.295708 (+ 49148us) log.cc:844] Serialized 180 byte log entry
0709 12:19:10.469061 (+173353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:10.469289 (+   228us) write_op.cc:454] Released schema lock
0709 12:19:10.469358 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:10.474345 (+  4987us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:10.474393 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2312,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":289974,"apply.run_cpu_time_us":69000,"apply.run_wall_time_us":760739,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":440131,"prepare.run_cpu_time_us":28623,"prepare.run_wall_time_us":390908,"raft.queue_time_us":136233,"raft.run_cpu_time_us":8675,"raft.run_wall_time_us":249901,"replication_time_us":654088,"thread_start_us":780443,"threads_started":5,"wal-append.queue_time_us":463177,"wal-append.run_cpu_time_us":28164,"wal-append.run_wall_time_us":2343056}]]}
I20260709 12:19:16.186705 24898 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:16.338212 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55441.9us
I20260709 12:19:16.339129 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:16.342684 20251 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:16.376438 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:16.364974 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:16.360736 20256 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:16.293718 25065 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:16.348768 25062 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.384764 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 227422us
I20260709 12:19:16.268965 24903 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.351253 25102 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:16.388782 20253 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:16.392938 25064 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:16.293979 25147 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.269143 24952 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.422000 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:16.388572 25103 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:16.393076 24954 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.308156 24904 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.468559 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:16.482429 20330 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:16.482164 25065 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.484364 24903 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.485057 24903 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.485378 25146 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.821s	user 0.014s	sys 0.001s
I20260709 12:19:16.485705 24903 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.486411 25147 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:16.487108 25197 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.488049 24742 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.488876 25145 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.005s
I20260709 12:19:16.488689 24742 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:16.489815 25155 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.818s	user 0.017s	sys 0.002s
I20260709 12:19:16.490029 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:16.490684 20328 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
W20260709 12:19:16.491667 25047 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.001s
I20260709 12:19:16.491858 25064 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.480229 25062 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.492210 25047 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:16.492674 24904 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.494349 25062 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:16.494572 25047 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:16.495042 24903 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:16.496320 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 96206.7us
I20260709 12:19:16.497008 24952 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.497793 24952 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:16.498540 24952 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:16.504601 25153 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.951s	user 0.005s	sys 0.012s
I20260709 12:19:16.505198 25153 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.484496 25065 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.508198 25065 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:16.509246 25065 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:16.510926 25065 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:16.525713 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 114601us
I20260709 12:19:16.495199 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:16.488931 25212 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:19:16.539626 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:16.494392 25064 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.552232 20254 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:16.528095 25052 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:16.546190 25155 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.550643 25153 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.555032 25145 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.560047 25199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.004s	sys 0.013s
I20260709 12:19:16.568452 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:16.562181 25147 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.554173 25047 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:19:16.578001 25199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.004s	sys 0.013s
I20260709 12:19:16.567229 25064 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:16.593794 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.585589 25052 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:16.601037 25217 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:19:16.602185 24952 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.604765 25056 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:16.590050 25153 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.593400 25064 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.621083 24742 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.591506 25047 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.598768 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.583876 25155 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.613152 25052 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:16.582878 25145 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.585083 25147 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.619854 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.638310 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:16.644274 20328 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:16.645787 25153 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.648283 25153 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:16.652839 25099 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.979s	user 0.015s	sys 0.000s
I20260709 12:19:16.653246 25155 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.653448 25099 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.655812 20176 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:16.656778 25099 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:16.665570 25182 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.668015 20330 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:16.676246 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:16.677016 20328 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:16.674587 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.670085 25064 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.687693 25092 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.687885 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:16.688783 20323 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:16.686813 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:16.666471 25182 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.692870 20174 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:16.694121 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:16.694929 20321 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:16.695698 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:16.689180 25145 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:16.689468 25047 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.688501 25092 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.690193 25147 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:16.684508 25052 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.707391 25050 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:16.708999 25145 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:16.722186 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 444772us
I20260709 12:19:16.725016 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:16.712389 25050 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:16.734697 20180 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:16.741539 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.708768 25147 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:16.740281 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.744897 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.726713 25145 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.755692 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:16.757157 25226 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.753219 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:16.782388 20179 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:16.754221 25145 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:16.799273 20177 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:16.800371 25052 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:16.792996 25147 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.810599 20174 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:16.803295 25147 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.757932 25226 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.795295 25032 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.842834 25032 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.845320 25032 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.845902 25032 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:16.846501 25032 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:16.857265 20180 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
W20260709 12:19:16.858458 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 105462us
I20260709 12:19:16.870857 20323 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:19:16.916015 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 404106us
W20260709 12:19:16.917157 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.929503 25032 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.930323 25032 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:16.851974 25182 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.934166 25226 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.934820 25092 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:16.872310 25147 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:16.850896 25047 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:19:16.955353 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:16.956280 21036 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:16.959002 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:16.959779 21038 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:16.935916 25147 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:16.999603 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 431353us
I20260709 12:19:17.001015 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.006915 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.007798 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:16.950659 25227 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.006306 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3200) took 1111 ms. Trace:
I20260709 12:19:16.946024 25155 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.011816 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.007084 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.016836 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:16.966221 25091 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.996546 25147 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.023579 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:17.039076 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.013360 20327 rpcz_store.cc:276] 0709 12:19:15.846615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.865652 (+ 19037us) service_pool.cc:224] Handling call
0709 12:19:15.921786 (+ 56134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:16.333094 (+411308us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:16.558855 (+225761us) log.cc:844] Serialized 14 byte log entry
0709 12:19:16.956230 (+397375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:16.956288 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:16.956338 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:16.956417 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:16.958332 (+  1915us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412468,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2111,"raft.queue_time_us":13092,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":33776,"thread_start_us":613451,"threads_started":2}
I20260709 12:19:17.042306 20253 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:19:17.043426 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.042702 20321 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:17.025753 24960 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.051999 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.035630 25225 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:17.038643 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4170503120001285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
I20260709 12:19:17.058856 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.029867 25091 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.063392 25207 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.063815 25219 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:17.064399 25091 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.048707 25092 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:17.065248 25092 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:17.066403 25210 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.772s	user 0.004s	sys 0.018s
I20260709 12:19:17.066973 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.067714 21037 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:17.071767 25225 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.074275 25225 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.056285 24979 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.076504 24979 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.076890 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:17.078176 24979 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:17.078387 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:17.078598 24979 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:17.081198 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.080338 20328 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:17.092391 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.053221 24742 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:17.105185 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.107328 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.067440 25092 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:17.111105 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52366.2us
I20260709 12:19:17.110147 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.108119 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:17.089447 24981 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:17.048488 25155 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.112155 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.040840 25227 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.101954 24742 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.130075 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.131007 20321 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:17.132351 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:17.134356 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.140240 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.080941 24960 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.064417 25219 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.145187 24961 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:17.150664 24961 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:17.151049 24961 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.154563 20253 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:17.139647 24742 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.119014 25220 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:17.160037 25220 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:17.161114 25220 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.165474 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:17.167352 25147 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.168561 20326 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:17.169061 24888 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.120072 25182 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.196898 25065 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.197290 25182 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.197587 25065 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.126667 25226 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.129163 25225 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.199954 25199 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.199818 20324 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:17.201061 24981 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.200693 25199 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.201498 24981 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:17.176482 25032 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:17.178795 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.202389 25032 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.204464 25032 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.207150 25047 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.212839 25065 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.139894 25233 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 12:19:17.193081 25212 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:19:17.192736 24742 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.193282 20250 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:17.234969 20253 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:17.096294 24979 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.196177 24960 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.199812 25092 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.187922 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.190465 25155 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.213902 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.187979 25222 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.128415 25091 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:17.214919 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 68531.7us
I20260709 12:19:17.225606 20180 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:17.194916 24961 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.210981 24981 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.247695 20326 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 4.
I20260709 12:19:17.200555 25225 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.233016 25153 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.199898 25226 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.235483 25099 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.211463 25145 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:17.285313 20144 connection.cc:256] RPC call timeout handler was delayed by -1.021050311999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2396s for a response
I20260709 12:19:17.276604 25091 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:17.289580 25148 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.259392 25052 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.285760 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:17.290831 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 158585us
W20260709 12:19:17.296712 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 162827us
I20260709 12:19:17.297467 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.299353 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.300143 20174 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:17.295455 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:17.284193 25065 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.288257 25099 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.305382 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.304832 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.308571 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.309861 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.291170 25147 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.293140 25050 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.280422 25047 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.312371 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.311908 20180 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:17.328616 20171 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.318743 20172 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:17.318627 25050 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.304497 25052 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.315747 25065 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.322846 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.323889 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.324010 25194 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.324625 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.324913 25219 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.325510 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.363729 20250 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:17.327299 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.285735 25222 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.315651 24979 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.284361 25153 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.296695 24960 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.284138 25092 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.337457 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.350196 25091 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.351702 25099 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.362047 25057 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.304775 25246 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.301808 25148 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.379781 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.366657 20252 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:17.371976 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.367834 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.316278 25220 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.404328 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:17.404767 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.405248 20253 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:17.386312 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:17.386904 25238 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:19:17.389345 25052 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.390964 20179 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:17.391891 25245 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:17.392779 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55408us
I20260709 12:19:17.381937 20256 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:17.394474 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 89728.3us
I20260709 12:19:17.353775 25194 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.417894 25194 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.397358 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.423905 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.353149 25226 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.400760 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.432502 20249 raft_consensus.cc:2410] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:19:17.391867 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.434414 20251 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:17.435743 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.436543 20251 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:17.437678 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:17.438386 20251 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.401638 24888 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.440501 24888 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.441974 20171 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:17.315287 25064 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 12:19:17.408560 20324 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:17.444216 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.398883 25057 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.411005 25148 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.412108 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.413067 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.401165 25199 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.396380 25246 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.450304 25246 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.450322 20175 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:17.413892 25065 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.396477 25219 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:17.451916 25219 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.452416 25219 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.408928 20180 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.392401 25103 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.417076 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.400967 25227 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.455687 25103 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:17.456343 25103 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.458614 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.460078 24742 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.461102 24961 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.462257 25145 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.384218 24960 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.463644 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.465328 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.466732 20254 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:17.467690 25225 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.467985 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.470386 25245 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.471879 20178 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:17.471199 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.476941 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.479266 25147 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:17.480034 25147 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:17.481132 25147 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.433336 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:17.484028 20247 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.447172 25057 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.485842 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.495175 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.495855 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.496382 20178 raft_consensus.cc:2368] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:19:17.497754 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.501178 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.501477 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.501992 20324 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:17.502164 20326 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:17.503221 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.504102 20330 raft_consensus.cc:2368] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9.
I20260709 12:19:17.506891 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.384912 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:17.510812 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 129293us
I20260709 12:19:17.469635 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:17.516710 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 99685us
I20260709 12:19:17.519707 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.518244 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.521075 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.525832 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.526235 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.526870 20174 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.522755 25065 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.528138 25065 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:17.528645 25065 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.524978 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.525866 25050 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.531704 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.532459 20176 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:17.521999 25057 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:17.533474 25057 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.533865 25057 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.529994 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:17.539501 20174 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:17.539618 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.543397 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.544318 20178 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.546555 25182 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.550467 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.550621 25050 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:17.551261 20173 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:17.551190 25050 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:17.551735 25052 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:19:17.552197 25052 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:17.552270 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.552675 25052 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:17.552779 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.553494 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.553939 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.554216 20176 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:17.554557 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:17.555071 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.555667 25225 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:17.555099 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.560273 20248 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:17.557637 20176 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:17.562572 20327 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:17.568567 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.558986 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.569247 20175 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:17.569841 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:17.573933 20247 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:17.538288 25199 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.535518 24981 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.575404 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.579233 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.578040 20173 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:17.586313 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.587322 20180 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:17.589018 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.546862 25244 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.595227 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.591334 20179 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.544584 25047 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.577524 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.594468 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:17.596647 20175 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:17.522574 24961 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:19:17.552214 25050 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:17.615707 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.586766 24888 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.604281 20330 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:17.605544 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:17.624646 21038 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.624245 25057 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.626814 25057 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.606362 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:17.624282 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:17.627661 20326 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:17.629303 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:17.630177 24952 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:17.632953 24952 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:17.634189 24952 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:17.635316 24952 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.576311 25148 raft_consensus.cc:2764] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:19:17.612205 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.640352 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.604907 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.643061 21036 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:17.607125 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:17.645143 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.641003 25099 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.596740 25253 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.648548 25222 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.649238 25245 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.650998 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.651196 25092 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.652031 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.652741 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.653831 20251 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:17.654282 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.655800 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.658392 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.608436 25244 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.658919 25047 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:17.686482 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.687335 20324 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:17.683935 20330 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:17.665508 20326 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:19:17.587942 25233 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:17.673635 25099 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.668669 21038 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:17.661164 20178 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:17.594770 25064 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:17.659308 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:17.653396 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:17.703904 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:17.704100 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 44892.4us
I20260709 12:19:17.675761 21040 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:17.578728 25199 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:17.678627 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.679641 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.681107 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:17.705946 20323 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.681928 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.684487 20327 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:17.695142 20325 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:17.695454 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:17.691943 24960 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.699498 25183 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:17.674916 25253 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:19:17.701584 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.699744 25153 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.705616 20329 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:17.712605 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.715726 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.707501 20177 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:17.714148 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.716821 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.719292 20330 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:19:17.724772 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.685494 25047 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:17.692231 24888 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:17.724761 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.703332 25099 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.731112 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:17.736997 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 83698us
I20260709 12:19:17.707170 25199 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.707018 25064 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:17.715983 25183 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:17.743719 24888 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:17.746810 25200 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:17.752507 20175 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:17.753028 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.717713 25233 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:17.759935 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 212216us
I20260709 12:19:17.729751 25047 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:17.762563 20323 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:17.767462 25200 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.772856 25200 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.773118 24888 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.773803 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.774700 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.762353 25064 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.718078 25253 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.776106 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:17.778995 25170 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:17.779201 25233 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.767484 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:17.724963 25245 raft_consensus.cc:2764] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:19:17.770836 20179 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:17.783149 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:17.780735 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51327.7us
I20260709 12:19:17.785082 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:17.788836 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 44749.4us
I20260709 12:19:17.787218 25050 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.791687 25225 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.779313 25101 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:17.792161 25225 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.792613 25225 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.792718 25050 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.792380 25101 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:17.794569 25101 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.797379 25050 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.799535 24979 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:17.792374 25052 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.801661 21041 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 5: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:17.801919 25052 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.802568 25052 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:17.802907 25052 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:17.784281 25170 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:17.807952 25170 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.812453 25243 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:17.812852 25243 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:17.813757 25243 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.814848 25243 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.816295 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:17.816921 21040 raft_consensus.cc:2376] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15. Re-sending same reply.
I20260709 12:19:17.817307 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.817687 25183 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.819023 25183 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:17.743799 25194 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.826249 25194 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.840179 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:17.842664 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53206.5us
I20260709 12:19:17.850117 25219 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.853446 25219 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.854848 25246 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.856386 21036 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:17.861054 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.861867 20326 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:17.849963 25222 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:17.867067 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82073.4us
I20260709 12:19:17.867091 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.871026 25064 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.873888 25101 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.874445 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.876004 25064 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.876866 25246 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.879333 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.880183 21039 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:17.880281 25064 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:17.881136 25064 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:17.882123 25064 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.884169 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.885448 25246 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:17.886911 25155 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:17.888181 25092 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:17.888486 25101 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.889974 25092 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:17.859508 25052 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.890446 25092 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.888530 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:17.894476 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.909469 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.907725 25182 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:17.914026 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 43910.2us
I20260709 12:19:17.923257 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:17.924091 25245 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:17.924834 25245 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:17.928216 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.915746 25222 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:17.933791 25240 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.933840 25222 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.934664 25222 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:17.934363 25240 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.937043 25240 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:17.938359 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:17.939322 21040 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:17.940862 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.941836 25240 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.942296 25240 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.942689 25240 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.948258 25092 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:17.910709 25155 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.951431 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.955106 20325 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:17.952481 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:17.959206 25153 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.932452 25147 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:17.894574 25170 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:17.959708 25153 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:17.959942 25147 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:17.960220 25153 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.961009 25147 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.961687 25170 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:17.953517 25207 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.926549 25219 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:19:17.964742 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.975711 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.977015 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:17.974503 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 193020us
I20260709 12:19:17.981287 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:17.925838 25245 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:17.997742 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:17.998675 20325 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:17.957608 25244 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.028293 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:17.962761 25240 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:18.037815 25065 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.006s
I20260709 12:19:17.997893 24960 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:18.054370 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49435.7us
I20260709 12:19:18.060534 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.002295 25145 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:18.003752 25064 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:18.054908 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:18.064970 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:18.052455 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:18.065698 20251 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:18.048290 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:18.003983 25091 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:18.057221 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:18.057883 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:18.060844 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.061558 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:17.979727 25246 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:18.064193 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:18.064953 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:18.055492 25103 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.011s
I20260709 12:19:18.063745 25220 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:18.069952 20253 raft_consensus.cc:2368] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
W20260709 12:19:18.070659 25260 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:19:18.071015 25064 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.062882 24960 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:18.076884 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:18.119263 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 56021.9us
I20260709 12:19:18.120651 20251 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:18.121680 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.076969 25052 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:18.119320 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.078223 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:18.133472 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 55338.3us
I20260709 12:19:18.078562 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:18.080276 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:18.135433 20175 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:18.079010 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:18.080600 20172 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:18.063241 25065 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.079726 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:18.082966 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:18.095412 20252 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:18.037653 25032 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:19:18.100428 25057 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.081318 25263 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:18.132576 20322 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.080932 20179 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:18.134449 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:18.151189 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.114076 25103 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.167304 25240 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.149001 24903 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:18.149526 25182 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:18.170444 20256 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:18.132683 24960 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:18.136617 25207 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:18.133500 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:18.181066 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47654.7us
I20260709 12:19:18.175125 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:18.151867 25219 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:18.191833 20175 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:18.179286 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.159694 25246 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:19:18.180440 25182 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.193084 25182 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:18.193647 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.194525 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.194670 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:18.196530 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:18.197154 25065 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.219403 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:18.215008 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:18.192185 25226 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:18.182510 25091 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:18.233188 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:18.201525 24888 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:18.211189 24961 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:18.237501 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:18.210099 25277 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:18.208304 25050 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:18.235921 20328 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:18.241056 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.241757 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:18.260452 20327 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:18.243810 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.174443 25057 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.239051 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:18.241515 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 122268us
I20260709 12:19:18.182811 25263 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.230891 25219 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:18.233506 25091 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:18.270533 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:18.220983 25207 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:18.233441 25092 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:18.274988 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.253624 25277 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.251444 25278 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:18.233776 25200 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.273880 24961 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:18.290983 25091 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:18.314790 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 180473us
I20260709 12:19:18.305577 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.293222 25207 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.293668 25246 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:18.316618 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 79202.2us
I20260709 12:19:18.293471 25092 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:18.319166 20328 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:18.319700 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:18.275103 24981 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:19:18.308779 25277 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:18.324958 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.336185 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.336860 20330 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:18.293592 25047 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.318955 25207 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.349900 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:18.350849 21034 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:18.352352 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.349658 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:18.354616 25270 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:19:18.354918 25057 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:18.332163 25050 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:18.359840 25050 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.360244 25050 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:18.363847 25271 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:19:18.368220 25279 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.368355 25064 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.369669 25222 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:18.372051 25268 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:19:18.332199 25032 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:18.378301 25183 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.002s
I20260709 12:19:18.381671 25182 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.383796 25289 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:19:18.384521 25182 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.384447 21038 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:18.388003 25200 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.388976 20326 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:18.389884 21007 leader_election.cc:400] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
I20260709 12:19:18.390199 21007 leader_election.cc:403] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:18.317175 25278 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:18.391297 25222 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.392549 25278 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.393399 21034 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:18.394418 20322 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:18.396123 25052 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
W20260709 12:19:18.363986 25273 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:19:18.401537 25277 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.403303 24961 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.316896 25282 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:18.407912 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:18.408499 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:18.427789 20247 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:18.429741 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 104867us
I20260709 12:19:18.447615 20325 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:18.346819 25246 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:18.457795 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 278637us
I20260709 12:19:18.461517 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:18.425793 25282 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:18.424527 24981 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.427412 25057 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:19:18.475124 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.480370 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:18.438766 25155 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:18.492360 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:18.485848 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 188911us
I20260709 12:19:18.460115 25103 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.485337 20247 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:18.475662 25219 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:19:18.499212 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.427647 25153 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.502961 20321 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:18.448958 25243 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:19:18.476598 25282 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:18.494791 25199 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.005s
I20260709 12:19:18.492084 25277 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.528282 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:18.529603 25047 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.529621 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:18.481637 24981 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.503729 25233 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.503707 25280 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:18.500953 25226 raft_consensus.cc:2764] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:19:18.546265 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:18.475399 25092 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.472620 25283 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:19:18.510141 25240 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.537621 24888 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:18.573354 20177 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:18.534194 25243 consensus_queue.cc:1243] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:18.576005 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:18.516160 25199 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:18.659789 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 83921.4us
W20260709 12:19:18.657387 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 108020us
I20260709 12:19:18.677032 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.685552 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:18.686265 20256 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:18.686745 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.688020 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.689810 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:18.693013 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 215027us
I20260709 12:19:18.550710 25148 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:19:18.693818 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:18.659125 25253 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.883s	user 0.019s	sys 0.010s
I20260709 12:19:18.696992 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:18.703589 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.664001 25280 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:18.748682 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.553185 25233 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.575198 25240 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:18.833132 25290 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 12:19:18.834331 25288 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:19:18.931026 20327 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
I20260709 12:19:18.931605 20327 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:18.682238 25064 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:18.861336 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 156474us
I20260709 12:19:18.691602 25207 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.683074 25276 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.296s
I20260709 12:19:18.750907 25091 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:18.952338 21008 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.016s	sys 0.026s
I20260709 12:19:18.891484 20324 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:18.953123 20173 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:18.659320 25293 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:18.673607 25246 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.708777 25253 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.956239 20329 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:18.956959 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:18.922873 20256 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:18.945855 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:18.906244 25099 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.134s	user 0.014s	sys 0.000s
I20260709 12:19:18.700141 25284 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:18.951578 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:18.952783 21008 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.016s	sys 0.026s
I20260709 12:19:18.954319 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:18.965902 20327 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:18.965806 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 554943us
I20260709 12:19:18.954988 25153 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.970252 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:18.978786 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:18.979647 25240 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:18.980507 25297 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:19:18.981738 25148 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:18.982402 25148 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:18.985291 25148 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:18.985427 25091 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:18.986862 25299 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:19:18.965193 25279 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.008s
I20260709 12:19:18.987732 25279 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:18.988440 25300 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:19:18.991703 24981 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:18.993526 25050 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.633s	user 0.015s	sys 0.006s
I20260709 12:19:18.993947 25050 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.923672 24888 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:18.996572 25233 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.998211 25207 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:18.979647 20178 raft_consensus.cc:2368] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10.
I20260709 12:19:19.001710 20173 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:19.006884 20327 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
W20260709 12:19:19.009778 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.011813 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.012571 20330 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:19.014793 20178 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:18.979383 25199 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.032712 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:19.035019 25050 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.035838 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:19.037663 21038 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.038569 21041 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:19:19.048019 25290 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:19:19.052131 20172 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:19.052225 20178 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:19:19.053043 25225 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.260s	user 0.018s	sys 0.000s
W20260709 12:19:19.054719 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.036123 25253 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:18.967900 25099 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.055907 21038 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:19.059990 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.053505 25225 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.066123 25295 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:19:19.060689 25280 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.072994 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.063129 25207 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:19:19.076110 24903 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:19.076522 24903 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:19.076750 25145 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.009s	user 0.006s	sys 0.007s
W20260709 12:19:19.076987 25219 consensus_meta.cc:287] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 12:19:19.077230 25145 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:19.077450 24903 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.078593 24903 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.081755 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:19.075093 20328 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.084295 20323 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:19.085886 25278 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:19.086766 25099 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:19.088037 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.088052 25263 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.095162 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2380) took 1037 ms. Trace:
I20260709 12:19:19.101572 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:19.099391 20247 rpcz_store.cc:276] 0709 12:19:18.057772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.057919 (+   147us) service_pool.cc:224] Handling call
0709 12:19:19.094931 (+1037012us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000d8c54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:19.095083 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639853440}
I20260709 12:19:19.107427 20176 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:19.108443 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.109138 20173 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:19.112362 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.077425 25219 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:19.062687 25064 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:19.110670 25263 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.119925 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.131104 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.128229 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:19.108158 24981 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:19.103704 25293 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:19.116888 25295 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:19.116021 25222 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:19.134642 25091 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:19.186524 24888 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:19.190056 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.193001 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:19.193692 21038 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:19.196777 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.196266 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:19.137967 25263 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.197431 20254 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:19.198747 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.202282 20173 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:19.201651 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:19.200193 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.203258 20328 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.201256 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:19.199677 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.203465 20178 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:19.203729 25315 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:19.205542 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.521s (SENT)
I20260709 12:19:19.205667 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:19.201004 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:19.189889 25318 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:19.206459 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:19.471535 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:19.477628 25323 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:19:19.378335 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.242906 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:19.479626 20256 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:19.245114 20329 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:19.248587 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.432525 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.449805 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.482911 20253 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.242733 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.241780 20247 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:19.483875 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.401685 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:19.262614 25305 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.270s	user 0.000s	sys 0.004s
I20260709 12:19:19.483523 20173 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
W20260709 12:19:19.331414 21008 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.561s (SENT)
I20260709 12:19:19.485435 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:19.188920 25284 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:19.484059 20327 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:19.488245 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.185501 25103 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:19:19.263274 25314 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:19:19.436513 24960 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.226s	user 0.015s	sys 0.000s
I20260709 12:19:19.502128 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.283687 25280 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:19.503003 20178 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:19.494911 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 289387us
W20260709 12:19:19.497761 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 159815us
I20260709 12:19:19.495216 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:19.500581 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 294252us
I20260709 12:19:19.504599 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:19.505201 20324 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.503899 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:19.507486 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.194459 24981 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.302s
I20260709 12:19:19.424283 25320 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.511647 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.455565 25225 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.427443 25263 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:19.515861 21008 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.578s (SENT)
W20260709 12:19:19.516831 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.618s (SENT)
I20260709 12:19:19.500157 25050 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:19.499864 25065 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:19.519237 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.500487 25099 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:19.522624 20174 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:19.509559 25294 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:19.509076 24960 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.512501 25183 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:19.512338 25281 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:19.520701 25155 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.490284 25315 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.530911 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:19.389618 25293 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.265741 25064 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.522541 25050 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:19.539901 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.518970 25280 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.539532 25155 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.509667 25103 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.529572 25294 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.550068 20322 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:19.560380 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 953) took 1383 ms. Trace:
I20260709 12:19:19.550024 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.542817 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:19.528740 25099 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.501626 25318 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.553483 25050 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:19.555426 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2966) took 1090 ms. Trace:
I20260709 12:19:19.556092 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.573798 20180 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:19.574620 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.557263 20172 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:19.557549 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 825) took 1056 ms. Trace:
I20260709 12:19:19.564649 20324 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:19.522379 25246 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:19:19.560752 20321 rpcz_store.cc:276] 0709 12:19:18.176625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.176774 (+   149us) service_pool.cc:224] Handling call
0709 12:19:18.177247 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:18.503343 (+326096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.560130 (+1056787us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400409cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:19.560315 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748549888}
I20260709 12:19:19.537181 25310 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.566977 25065 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:19.523391 25320 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.592602 20256 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:19.592825 20249 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.562093 25057 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:19.572213 20171 rpcz_store.cc:276] 0709 12:19:18.465158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.465281 (+   123us) service_pool.cc:224] Handling call
0709 12:19:18.491774 (+ 26493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:18.503972 (+ 12198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:18.504007 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:18.514262 (+ 10255us) log.cc:844] Serialized 26 byte log entry
0709 12:19:18.694946 (+180684us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:18.694984 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:18.695047 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:19.246952 (+551905us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:19.553413 (+306461us) raft_consensus.cc:1685] finished
0709 12:19:19.553437 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:19.555349 (+  1912us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1977,"raft.queue_time_us":2064,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4267,"spinlock_wait_cycles":36133248,"thread_start_us":139341,"threads_started":1,"wal-append.queue_time_us":399500}
I20260709 12:19:19.575320 20179 rpcz_store.cc:276] 0709 12:19:18.501660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.501794 (+   134us) service_pool.cc:224] Handling call
0709 12:19:18.509778 (+  7984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:18.722145 (+212367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:18.892302 (+170157us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:18.928624 (+ 36322us) log.cc:844] Serialized 26 byte log entry
0709 12:19:19.056125 (+127501us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:19.056162 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.062596 (+  6434us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:19.557327 (+494731us) raft_consensus.cc:1685] finished
0709 12:19:19.557349 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:19.557487 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18048,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":1408,"thread_start_us":283362,"threads_started":2,"wal-append.queue_time_us":148268}
W20260709 12:19:19.586251 20323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3217) took 1795 ms (client timeout 1964 ms). Trace:
I20260709 12:19:19.589053 25318 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.531798 25311 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:19:19.559607 25284 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.593916 20329 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:19.554433 25307 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:19.564749 25294 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:19.601567 20323 rpcz_store.cc:269] 0709 12:19:17.782744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.782899 (+   155us) service_pool.cc:224] Handling call
0709 12:19:19.577430 (+1794531us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002daad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:19.577601 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987841408}
I20260709 12:19:19.594424 25065 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:19.670197 25065 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.673484 25280 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.674250 25320 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.604415 25199 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:19.676070 25199 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.678391 25199 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.678658 25099 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:19.600665 25057 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:19.679901 25057 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.680914 25057 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.647789 25050 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:19.616173 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.598970 25310 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.626822 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:19.684294 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.760s (SENT)
I20260709 12:19:19.684872 20328 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:19.550515 25183 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.648236 20179 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:19.646204 20249 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:19.648052 20253 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:19.648988 20322 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:19.651885 20329 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:19.660430 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.660686 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.692221 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.692801 20178 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:19.665150 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.665750 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:19.693418 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.694103 20248 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:19.694200 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.694873 20321 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:19.694905 20328 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:19.695911 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.696322 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.696889 20253 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:19.666559 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.667119 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:19.699584 21034 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:19.667500 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.668431 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:19.605075 25282 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.056s	user 0.012s	sys 0.000s
I20260709 12:19:19.636621 24960 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:19.689875 25307 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:19.710163 21038 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:19.715701 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.690356 25310 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.728865 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.731524 21038 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:19.735023 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:19.621522 25155 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.735821 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:19.739164 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.739164 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:19.740973 20328 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:19.741310 20178 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:19.736358 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:19.736699 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:19.736735 20323 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:19:19.746016 20254 raft_consensus.cc:2368] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:19.746528 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.747619 20256 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:19.750870 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:19.751889 20253 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:19.755009 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70739.9us
I20260709 12:19:19.756083 20172 raft_consensus.cc:2410] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:19:19.756196 25307 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.761582 25183 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.761785 24960 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.762599 20178 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:19.762421 24960 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:19.765921 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.767645 21043 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:19.768975 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:19.768947 20178 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:19:19.770845 21008 leader_election.cc:336] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.773s (SENT)
W20260709 12:19:19.772143 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.861s (SENT)
I20260709 12:19:19.772576 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.774711 20179 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:19.778951 20253 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:19.786755 20253 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:19.790343 20172 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:19.790939 20328 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
W20260709 12:19:19.777860 20220 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.107s (SENT)
I20260709 12:19:19.792169 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.724401 25282 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.811143 20256 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:19.792865 25317 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:19.835034 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 57215.1us
I20260709 12:19:19.836238 20252 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:19.839404 20256 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:19.843819 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.849154 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:19.850858 25183 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.851255 25310 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:19.851457 25183 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.852420 25310 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:19.852847 25310 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:19.853953 25183 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.853808 25310 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:19.857071 25317 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:19:19.859107 21043 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:19.859691 21039 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:19.860985 25282 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:19.861863 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:19.862669 21041 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:19.865589 25103 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.868832 25092 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.876828 25050 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:19.838207 25311 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:19.903993 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:19.837567 25293 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.919412 20144 connection.cc:256] RPC call timeout handler was delayed by -1.473737906000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:19:19.920023 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2541379060000963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:19:19.920415 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2388379060000716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 12:19:19.920794 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2010379060002379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:19:19.921156 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1965379060002306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:19:19.921523 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1605379060001724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:19:19.921890 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1569379060001665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 12:19:19.922253 20144 connection.cc:256] RPC call timeout handler was delayed by -1.12813790600012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 12:19:19.923060 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0633379060002426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:19:19.923436 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0228379060001771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 12:19:19.937891 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 125016us
I20260709 12:19:19.905858 25050 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:19.958801 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:19.909914 25313 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:19.965907 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:19.917725 25318 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:19.969183 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.971309 20255 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:19.917743 25282 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:19.948577 25153 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.973897 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.905925 25294 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.907831 25064 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:19:19.983355 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:19.910138 25293 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:19.965153 25313 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:19.967875 25227 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:20.012490 20321 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:20.019774 25307 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:20.022455 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.071s (SENT)
W20260709 12:19:20.023389 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.097s (SENT) [suppressed 32 similar messages]
I20260709 12:19:20.027101 25065 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.027839 25340 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:20.028298 25340 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:19.987679 25050 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:20.028682 25340 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:20.029337 25050 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.029873 25065 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.032361 25313 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.033489 25313 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:19.989391 25153 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.041244 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2965) took 1576 ms. Trace:
I20260709 12:19:20.041615 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3231) took 1365 ms. Trace:
I20260709 12:19:20.042002 20177 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:20.044190 25334 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:19:20.045809 25263 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.041620 20175 rpcz_store.cc:276] 0709 12:19:18.464756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.464944 (+   188us) service_pool.cc:224] Handling call
0709 12:19:18.465401 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:18.472249 (+  6848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:18.472295 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:18.472861 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:19:19.850632 (+1377771us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18003a8ac0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:19:19.962282 (+111650us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:19.962336 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.962436 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:20.040924 (+ 78488us) raft_consensus.cc:1685] finished
0709 12:19:20.040949 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.041178 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7244,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":18736,"spinlock_wait_cycles":4552448,"thread_start_us":111470,"threads_started":1,"wal-append.queue_time_us":1538023}
I20260709 12:19:19.967396 25225 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:19:19.983933 25329 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:20.049937 25329 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.050417 25317 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:19:20.053483 25294 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:19.990520 25311 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:19.990473 25282 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.042049 20322 rpcz_store.cc:276] 0709 12:19:18.676544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.676767 (+   223us) service_pool.cc:224] Handling call
0709 12:19:20.041431 (+1364664us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54000ce754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:20.041548 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006227328}
W20260709 12:19:20.105170 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 115352us
I20260709 12:19:20.103576 25295 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.134861 20144 leader_election.cc:400] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9.
I20260709 12:19:20.115775 25153 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.176026 20324 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:20.176231 20179 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:20.143244 25170 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:20.147168 25263 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:20.151122 25328 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:19:20.160048 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.161002 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:20.159411 20175 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:20.172451 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.173094 24960 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:20.173470 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.136132 25315 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:20.180778 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47197.5us
I20260709 12:19:20.186050 20176 raft_consensus.cc:2368] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:20.198099 25091 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:20.198683 25091 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.200026 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.201253 25091 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.201529 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:20.202286 20325 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:20.202208 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:20.203048 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 219742us
I20260709 12:19:20.203439 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.204262 20330 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:20.204236 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:20.205155 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:20.206753 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:20.214036 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:20.181531 25170 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:20.135389 25295 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.220634 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:20.221499 20322 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.227782 25244 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:20.228174 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.229310 20329 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:20.194773 24960 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:20.218040 25155 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:19:20.209067 25282 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.214545 25339 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:20.223321 25289 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:20.194384 25280 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:19:20.223868 25293 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:20.223011 25246 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:19:20.217067 25317 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:19:20.257539 25345 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:20.258041 25345 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.258371 25345 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:20.263844 25225 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:20.245930 24960 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.264439 25225 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.266484 25225 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.266964 24960 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.267831 25339 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:20.268857 25339 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.271869 25170 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.273027 25170 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:20.275134 25329 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:20.283718 25057 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.602s	user 0.016s	sys 0.000s
I20260709 12:19:20.288996 25295 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.252128 25282 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:19:20.292737 25103 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:20.293298 25103 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:20.297899 20322 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:20.267036 25225 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:20.294346 25103 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.305248 25103 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:20.304049 25225 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:20.310886 25225 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.313011 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:20.313831 20173 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:20.345000 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.352447 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 145756us
W20260709 12:19:20.361726 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 148224us
W20260709 12:19:20.374477 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.391188 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.391772 20173 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:20.397481 25352 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:20.399811 25225 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.371977 25289 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:20.367991 25357 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:20.417820 20248 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:20.419637 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.422515 20249 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:20.421931 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 843) took 1342 ms. Trace:
W20260709 12:19:20.424612 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 71162.8us
W20260709 12:19:20.424687 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.427249 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.429610 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:20.430379 20248 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:20.425223 20177 rpcz_store.cc:276] 0709 12:19:19.079658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.079849 (+   191us) service_pool.cc:224] Handling call
0709 12:19:20.041730 (+961881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.042538 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.421739 (+379201us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540031b5d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:20.421873 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211342592}
W20260709 12:19:20.433643 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 172766us
I20260709 12:19:20.427955 20255 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:20.435658 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:20.430555 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:20.426671 25092 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.554s	user 0.015s	sys 0.001s
I20260709 12:19:20.446825 21036 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:20.451828 21039 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 12:19:20.446964 20295 leader_election.cc:400] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:20.447525 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:20.367537 25317 consensus_queue.cc:1243] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:20.417062 25148 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:20.453822 20295 leader_election.cc:403] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.451937 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:20.457057 21041 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:20.448207 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.458015 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.458894 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:20.458695 20252 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:19:20.432967 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 242896us
I20260709 12:19:20.465480 20294 leader_election.cc:400] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 8 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:20.464871 21038 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:20.447530 25349 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.467988 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.411343 25340 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.471266 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:20.453769 25199 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.456342 24960 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:20.477548 21036 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:20.450765 25313 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:19:20.460305 25091 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:20.450733 25244 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:19:20.488234 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.468365 25317 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:20.504601 25317 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:20.496336 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.483130 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:20.492102 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:20.494809 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.511663 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.486274 25282 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.496032 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.488397 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.503413 20253 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:20.464128 25263 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:19:20.504031 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.462615 25148 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.516237 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:20.514894 21041 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:20.525151 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.525372 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:20.488858 25350 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:20.490811 25357 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:20.534622 25357 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.486377 25199 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:20.540910 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.542095 25350 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:20.542721 21043 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:20.526580 20255 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:20.522495 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.519121 20247 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:20.545676 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.486311 25349 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.483039 25354 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9.
I20260709 12:19:20.524056 25348 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:20.532608 25347 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:19:20.496111 25358 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.542853 25350 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:20.523224 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:20.544076 20249 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:20.549997 21041 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:20.553278 21036 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:20.555821 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:20.563464 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.568696 21043 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.569476 25350 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.512681 25289 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.571079 25349 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.581902 25349 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:20.582477 25349 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.523793 25282 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.585263 25349 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.585861 25282 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:20.586753 25282 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.586449 25358 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.587245 25282 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.587832 21039 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:20.588816 25358 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:20.591344 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 125015us
I20260709 12:19:20.589358 25282 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:20.560205 25348 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:20.592410 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:20.604795 25313 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:20.605429 25313 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:20.592303 25364 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.610531 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.613320 20177 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:20.614313 21043 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:19:20.612567 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 96465.8us
W20260709 12:19:20.607615 25363 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:19:20.599956 25348 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:20.619141 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.619845 20177 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:20.616629 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:20.631373 25225 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:20.636732 25227 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:20.637338 25227 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:20.638459 25227 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:20.640981 25148 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.642751 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.643541 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.644326 20329 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:20.658839 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:20.656165 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.665772 20321 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:20.666522 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:20.606412 25313 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.612007 25364 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.669046 20328 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:20.675891 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.668329 25282 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:20.682638 25227 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:20.689112 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:20.668931 25345 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.693003 25350 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.694325 25345 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:20.681103 25349 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:20.695884 21038 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:19:20.678037 25340 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:20.696413 25147 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:20.696923 25147 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.697264 25147 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:20.673053 25370 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.702943 20330 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:20.712107 25350 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:20.712788 25370 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.713335 25354 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:20.714017 25354 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:20.715219 25370 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:20.711234 25358 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.716432 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:20.709362 25362 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:20.735628 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.723552 25289 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:20.729233 25370 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:20.709473 25349 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:19:20.723949 25358 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.739404 25350 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:19:20.749042 25364 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:20.749555 25289 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.739945 25282 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:19:20.745602 25370 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.765877 25370 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.769060 25289 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:20.769459 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.770283 20172 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:20.770427 25317 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.771600 25317 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.743400 25362 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.776182 25225 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:20.786273 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.792680 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.791661 25354 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
W20260709 12:19:20.795221 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 337391us
I20260709 12:19:20.799975 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:20.801452 25286 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:20.802140 25286 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:20.790326 25358 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:20.819386 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:20.826535 25388 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:20.826261 25282 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:20.901394 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 135506us
I20260709 12:19:20.902050 25282 consensus_queue.cc:1243] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:20.902565 25392 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:20.902686 25282 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:20.832239 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.852388 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:20.830801 25348 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:20.862145 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 135050us
I20260709 12:19:20.905943 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:20.903062 25392 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:20.860208 25355 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:20.896102 25339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.034s	sys 0.018s
I20260709 12:19:20.914270 25199 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:20.915872 25289 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:20.933472 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 81233.8us
I20260709 12:19:20.917585 25057 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:20.918795 25225 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:20.920209 20172 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:20.922988 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.924520 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:20.925848 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.925136 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.924789 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:20.944620 20253 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:20.931686 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.935223 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:20.935140 25289 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.935947 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:20.947894 20325 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:19:20.948007 20328 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:20.803325 25286 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:20.936656 25294 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:20.937309 25295 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:20.941725 25370 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:20.951478 20322 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:19:20.936494 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:20.934599 25339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.034s	sys 0.018s
I20260709 12:19:20.903800 25387 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:20.956563 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.964952 20174 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:20.964838 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:20.957278 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:20.957856 21034 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:20.966893 21034 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:20.962556 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:20.926735 25355 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:20.980588 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.949059 25057 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.947412 25225 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:20.898653 25388 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:21.012038 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:20.959745 25294 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.967746 21034 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.012982 20171 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:21.025413 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.032502 20176 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:20.988106 25351 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:20.990128 25355 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:20.989888 25244 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:21.009351 25057 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.982178 25387 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:21.042120 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.028438 25294 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.992154 25313 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:19:20.991428 25147 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.054973 25370 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:21.065593 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.040165 25091 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:21.040225 25244 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.076475 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.086362 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.092265 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.079365 25310 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.095445 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.012950 25392 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.092818 25324 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:21.087497 25244 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:21.086861 25091 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:21.091457 25199 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:21.100247 24960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.010s
W20260709 12:19:21.089005 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 104798us
I20260709 12:19:21.093300 25353 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.181926 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.101037 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.194506 20172 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.096843 25103 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:21.178658 24960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.000s	sys 0.011s
I20260709 12:19:21.140162 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:21.188750 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.099726 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.200549 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.217764 20255 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
W20260709 12:19:21.202523 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.103245 25148 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:21.112203 25366 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.130030 25091 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.086210 25225 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.179333 25324 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:21.233170 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 270668us
I20260709 12:19:21.201772 25351 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:21.250681 25147 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.114989 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.203814 25392 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:21.252702 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 137802us
I20260709 12:19:21.214315 25348 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:21.222483 24960 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:21.254281 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:21.255249 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.037761 25358 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:19:21.256589 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.259013 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.265074 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.266922 25092 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:21.270186 25295 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:21.224680 25103 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:21.304922 20173 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:19:21.302059 20220 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.553s (SENT)
W20260709 12:19:21.306134 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.306573 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.580s (SENT)
W20260709 12:19:21.307133 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50630us
W20260709 12:19:21.307443 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.590s (SENT)
I20260709 12:19:21.237649 25148 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:21.325528 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.249265 25351 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.272011 25289 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:21.102514 25387 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.338140 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.339861 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.340759 20173 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:21.336248 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:21.196786 25353 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.348943 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.350049 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.351586 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.316419 25064 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:21.301491 25199 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:21.303126 25295 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:21.332450 25225 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:21.177268 25388 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.322666 25092 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:21.335088 25155 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.361330 25148 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:21.364115 25317 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.592s	user 0.004s	sys 0.008s
I20260709 12:19:21.375849 25103 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.376863 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.366665 20172 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:21.236680 25366 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:21.368533 25396 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:19:21.371755 25199 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.378778 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.335621 25358 consensus_queue.cc:1243] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:21.338745 25351 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.382411 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:21.385715 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.390120 20174 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:21.359190 25387 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:21.367028 25355 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.378398 25295 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.377802 25092 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:21.397187 20321 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:21.398048 25386 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:21.398460 25386 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:21.400950 21034 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.402221 25355 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:21.405243 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.405879 20175 raft_consensus.cc:2376] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13. Re-sending same reply.
I20260709 12:19:21.406064 25353 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.406810 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.406885 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.408207 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.409202 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.410282 20175 raft_consensus.cc:2376] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13. Re-sending same reply.
I20260709 12:19:21.376816 25324 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.414101 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.416944 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.417785 20174 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:21.390352 25388 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.418766 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.421605 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:21.422062 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.422497 20172 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:21.423123 20174 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:21.423520 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.409740 25362 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:21.425572 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 285512us
I20260709 12:19:21.433446 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.433939 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.434599 20180 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:21.430684 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:21.431550 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.426903 20172 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:21.434288 20175 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:19:21.437194 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.437537 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.437949 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1235) took 1007 ms. Trace:
W20260709 12:19:21.440073 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81502.2us
I20260709 12:19:21.443148 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.444774 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.445513 20172 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:21.446538 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.446915 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.447906 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.448763 20174 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:21.449841 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.462354 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.386297 25155 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.465121 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:21.467180 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 158761us
I20260709 12:19:21.413249 25405 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:21.470084 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.470374 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.472309 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.473570 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.477730 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.472240 20175 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:21.482124 20327 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:21.487993 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.489784 20175 raft_consensus.cc:2376] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13. Re-sending same reply.
I20260709 12:19:21.490260 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.495160 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.495716 20322 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:21.495965 20180 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:21.466233 25170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:19:21.442194 25392 raft_consensus.cc:2764] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:19:21.381531 24960 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.448769 20172 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:21.499884 20327 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:19:21.514207 20322 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:21.505121 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.514375 20256 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:21.503072 20329 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:21.514472 20327 pending_rounds.cc:85] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 10
I20260709 12:19:21.540814 20327 pending_rounds.cc:107] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:19:21.541327 20327 raft_consensus.cc:2889] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:21.493113 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 234568us
W20260709 12:19:21.512853 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 130556us
I20260709 12:19:21.529237 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2407) took 1088 ms. Trace:
I20260709 12:19:21.540479 20326 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:21.471879 25349 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:19:21.538825 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:21.507419 20330 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:21.474563 25348 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:19:21.543476 20249 rpcz_store.cc:276] 0709 12:19:20.423498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.429178 (+  5680us) service_pool.cc:224] Handling call
0709 12:19:21.511587 (+1082409us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b540004c754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:21.511700 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197315456}
I20260709 12:19:21.556002 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.557277 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.565181 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.565145 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.543407 25344 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.572141 20175 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.572144 25344 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.568784 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.542428 25310 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:21.569528 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.577859 25398 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:21.536428 25064 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:21.554200 20180 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:21.583043 20175 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:21.583715 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:21.586336 25398 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:21.497344 25227 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:19:21.588088 25348 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:21.588582 25348 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:21.588965 25348 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:21.589130 25227 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:19:21.589583 25227 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:21.590404 25227 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.598095 25348 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.566269 25349 consensus_queue.cc:1243] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 19.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:19:21.600185 25286 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.600445 25348 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.600951 25286 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.605330 25280 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:21.605751 25280 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:21.606668 25280 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.609637 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:21.612818 25412 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:19:21.615257 25227 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:19:21.623514 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.624341 20172 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
W20260709 12:19:21.625590 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53894.4us
I20260709 12:19:21.630257 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:21.630650 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:21.631152 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.488281 25386 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:21.643512 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 205442us
W20260709 12:19:21.644244 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.644692 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.651783 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.653702 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:21.657110 20220 leader_election.cc:336] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.900s (SENT)
W20260709 12:19:21.658629 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.934s (SENT)
W20260709 12:19:21.660145 20220 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.988s (SENT)
W20260709 12:19:21.661872 20220 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.006s (SENT)
W20260709 12:19:21.663070 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 124397us
I20260709 12:19:21.664002 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:21.665160 20220 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:21.666272 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.629426 25310 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:21.668025 21042 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:21.669539 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:21.635499 25289 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:21.671207 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.670032 20177 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:21.674576 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:21.661010 25280 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:21.686998 20177 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:21.685405 20174 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:19:21.687444 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.713131 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.666421 25386 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.684382 21042 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:21.585357 25064 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.711668 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:21.566140 25408 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:19:21.662752 25170 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:21.662910 25313 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.646426 25398 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:19:21.742843 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.719775 20177 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:21.647485 25355 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:19:21.679639 25404 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.686090 25366 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:21.724496 21039 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:19:21.725947 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 95403.7us
I20260709 12:19:21.650722 25419 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
W20260709 12:19:21.733220 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68121.9us
W20260709 12:19:21.736438 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.755249 20329 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:21.756784 20177 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:21.673868 25348 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:21.763676 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.764937 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:21.728935 25057 consensus_meta.cc:287] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.011s
I20260709 12:19:21.672382 25409 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:19:21.685925 25182 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:19:21.718987 25418 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:21.762846 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.777235 21039 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:21.763129 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:21.778455 20326 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 9: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:21.769145 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.780040 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.780246 25425 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:21.780625 20329 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:21.774250 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.750118 25405 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:21.776360 21008 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.601s (SENT)
I20260709 12:19:21.783233 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:21.783834 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:21.772182 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:21.786075 21008 leader_election.cc:336] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.663s (SENT)
I20260709 12:19:21.786181 20255 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:21.787779 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:21.788530 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.789208 20249 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:21.791510 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1241) took 1275 ms. Trace:
I20260709 12:19:21.792038 25170 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:21.791952 20256 rpcz_store.cc:276] 0709 12:19:20.516433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.516556 (+   123us) service_pool.cc:224] Handling call
0709 12:19:21.791338 (+1274782us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54001ca054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:21.791451 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226023168}
I20260709 12:19:21.767973 25155 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.793751 25408 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:21.797250 25417 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:21.797621 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.798851 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:21.673722 25389 consensus_queue.cc:1175] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8aef67aa330543a191ab5ab5dc30e84c" responder_term: 13 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:19:21.802062 25413 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:21.749504 25313 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.778453 25057 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.808957 25313 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.809955 25057 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:21.813493 25244 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.005s
I20260709 12:19:21.813970 25244 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.815114 20323 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:21.440282 21034 rpcz_store.cc:276] 0709 12:19:20.430437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.431065 (+   628us) service_pool.cc:224] Handling call
0709 12:19:20.431454 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.957751 (+526297us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b540056c320. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefa1c0 00007f5ddaefb231 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c
0709 12:19:21.400425 (+442674us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5800936ed0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae540aa 00007f5ddaed6447 00007f5ddaeeefe7 00007f5ddaef07de 00007f5ddaefab49 00007f5ddaefb416 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4
0709 12:19:21.419029 (+ 18604us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:21.419954 (+   925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.437626 (+ 17672us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:21.437682 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.437768 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.437893 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":967,"raft.queue_time_us":422,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11626,"spinlock_wait_cycles":205602944}
I20260709 12:19:21.785344 25405 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:21.816231 25405 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.819754 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:21.782155 25310 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.827674 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.758352 25422 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:21.831640 20329 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:21.831442 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 43757.4us
I20260709 12:19:21.839617 20329 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:19:21.832552 20251 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:19:21.840955 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:21.842227 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.777024 25418 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:21.850101 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 138594us
W20260709 12:19:21.857940 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 85838us
I20260709 12:19:21.881145 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:21.862672 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.884707 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:21.888991 20322 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:21.892558 20171 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:21.824391 25400 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.887297 25353 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:21.877672 25351 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.910238 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.811376 25092 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.905195 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.905797 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:21.904062 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:21.908481 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.904040 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.902063 20329 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:21.904350 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:21.919430 21034 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.915385 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.920909 20177 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:21.925055 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.929064 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:21.929656 21038 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:21.936306 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:21.761389 25404 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.901074 25225 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:19:21.961030 25225 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:21.961422 25225 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:21.962224 25225 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.905248 25353 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:21.963853 25353 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.964111 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:21.965031 25092 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.965725 25092 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:21.966109 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.966769 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.967000 20250 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:21.968091 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:21.968432 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:21.969244 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.969851 25428 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.970504 25428 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:21.971050 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:21.904883 25263 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.971819 25263 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.937001 21037 raft_consensus.cc:2376] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7. Re-sending same reply.
I20260709 12:19:21.973368 25183 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:21.973973 25263 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:21.973922 25183 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.974560 25263 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.905148 25390 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.975847 25310 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:21.975925 25390 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.977485 25310 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:21.978179 25390 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:21.977977 25310 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.900759 25421 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.191s
I20260709 12:19:21.898445 25387 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:21.980752 25428 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:21.982343 20177 raft_consensus.cc:2368] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
I20260709 12:19:21.982839 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:21.987264 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.987792 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:21.988176 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.891989 25418 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.988080 20176 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:21.906607 25408 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:21.908763 25351 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:21.909564 25244 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:21.991221 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.000166 25310 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:21.905340 25427 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.163s
I20260709 12:19:21.975033 25263 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.035854 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3207) took 1067 ms. Trace:
I20260709 12:19:22.036396 20171 rpcz_store.cc:276] 0709 12:19:20.968062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.088745 (+120683us) service_pool.cc:224] Handling call
0709 12:19:22.035635 (+946890us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000c6cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.035778 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377223552}
I20260709 12:19:21.995007 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.004456 25401 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:22.005453 25429 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:19:22.007457 25404 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:22.009387 25294 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.932s	user 0.013s	sys 0.000s
I20260709 12:19:22.009788 20326 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:22.052424 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:21.909816 25400 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.944622 25313 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:22.016000 25091 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.004s
I20260709 12:19:22.016682 25183 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:22.017980 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.067128 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.023629 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.025341 25344 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.040470 25351 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:22.032225 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:21.963416 25225 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:22.044740 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.044953 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.053067 20171 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:22.055944 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 176102us
I20260709 12:19:22.082422 25418 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:21.943176 21034 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:22.042448 25310 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:22.043223 25401 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:22.083673 25401 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:22.083808 25404 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:22.085367 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:22.082988 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:22.087456 25344 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.087883 25310 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:22.088941 25310 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:22.059757 25388 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.000s
I20260709 12:19:22.074601 20325 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:19:22.082942 20171 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:22.026250 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.100522 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.090242 25404 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:22.100878 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.093472 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:22.098384 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.060377 25313 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.091920 25344 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:22.101166 20256 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:22.111920 25344 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:22.112308 25344 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:22.113155 25344 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.057350 25339 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:22.114490 25344 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:22.114599 25339 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.102183 20326 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:22.091159 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.103116 25313 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:22.074118 25349 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.103713 25057 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:22.104391 25170 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:19:22.109468 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3202) took 1142 ms. Trace:
I20260709 12:19:22.109576 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.111042 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.116130 20173 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:22.115484 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.117458 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.103395 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.124176 20256 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:22.133702 20171 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:22.125137 21037 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:22.058360 25294 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.102034 25404 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.129508 20322 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:22.136175 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.124323 20251 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:22.143071 25388 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:22.130301 20176 rpcz_store.cc:276] 0709 12:19:20.966815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.039105 (+ 72290us) service_pool.cc:224] Handling call
0709 12:19:22.109272 (+1070167us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54001d2ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.109380 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744438528}
I20260709 12:19:22.145649 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.146024 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:22.146268 20176 raft_consensus.cc:2376] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14. Re-sending same reply.
I20260709 12:19:22.147159 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.147706 20176 raft_consensus.cc:2376] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14. Re-sending same reply.
I20260709 12:19:22.148232 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:22.148317 25388 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.148514 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.149959 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.150383 25404 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:22.151000 20176 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:22.152328 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.153766 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.158424 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.158583 25280 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:22.160261 25280 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.161021 25353 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.162578 25280 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.159101 25388 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:22.163281 25388 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.163843 20176 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:22.163923 25388 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:22.129868 25057 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.164752 25057 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:22.165668 20220 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.757s (SENT)
I20260709 12:19:22.167232 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.128501 25310 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:22.071337 25091 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.170862 25091 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.130887 25182 consensus_queue.cc:1243] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:22.173122 25339 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.173481 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.179014 25182 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.180142 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:22.181500 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70561.5us
W20260709 12:19:22.182705 25423 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.461s	user 0.002s	sys 0.000s
W20260709 12:19:22.183145 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.183748 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.183815 25170 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:22.184279 25263 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.125809 25099 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:22.185765 25099 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:22.186751 25099 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.188167 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.188905 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.188124 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:22.190737 25295 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
I20260709 12:19:22.191160 25339 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:22.191161 25295 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:22.193109 20324 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:22.193482 20330 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.094063 25351 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.195204 25295 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:22.195873 21034 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:22.188488 25400 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:22.196861 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57737.9us
I20260709 12:19:22.204272 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.205950 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:22.210494 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:22.163259 25353 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.214314 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:22.217128 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.202342 25280 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.223109 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.126860 25405 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.227849 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:22.227626 20253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.012s	sys 0.016s
I20260709 12:19:22.229707 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3217) took 1216 ms. Trace:
I20260709 12:19:22.225427 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.216099 25227 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:22.171449 20171 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:22.240229 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.255736 20254 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:22.220212 25244 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:22.230756 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.240664 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:22.230027 20253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.012s	sys 0.016s
I20260709 12:19:22.247215 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.213698 25386 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:19:22.245272 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.871s (SENT)
I20260709 12:19:22.245800 20251 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.227171 25428 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:22.231552 25432 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.225052 25438 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:22.259181 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.224539 25370 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:22.261583 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:22.304893 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74215.3us
I20260709 12:19:22.230906 20179 rpcz_store.cc:276] 0709 12:19:21.013559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.610986 (+597427us) service_pool.cc:224] Handling call
0709 12:19:21.611436 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.621402 (+  9966us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:22.011692 (+390290us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.229357 (+217665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:22.229416 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.229462 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.229530 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.229646 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193239,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":96,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6131,"thread_start_us":596463,"threads_started":2}
I20260709 12:19:22.306453 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.249763 25418 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.248037 25280 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.247876 25434 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:22.312481 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51257.4us
I20260709 12:19:22.277977 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.361785 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.362494 20171 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 5.
I20260709 12:19:22.277191 20178 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:19:22.323799 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.364558 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.368327 25390 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:19:22.349110 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 90041.6us
I20260709 12:19:22.257063 25404 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.256551 25351 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.259907 25387 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:22.268864 25428 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:22.376009 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.424170 20171 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:22.425490 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.426201 20171 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.426895 20171 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:22.268013 25339 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.373443 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.360077 25182 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:22.268280 25294 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.245415 25227 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.436260 20179 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:22.428354 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:22.395432 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.384126 25246 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.376670 25441 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:22.370028 25389 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:22.304508 25432 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.359242 25244 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:22.305051 25438 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:22.379516 25295 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:22.440559 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 67244.4us
I20260709 12:19:22.382854 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.381467 25183 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:22.430826 25428 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:22.468660 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 85938.1us
I20260709 12:19:22.471200 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:22.470005 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:22.473410 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 112935us
I20260709 12:19:22.473734 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.444676 25419 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:22.483104 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.484511 20177 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:19:22.484319 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.486470 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.444752 25437 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:22.497176 20177 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:22.469913 25280 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:22.504657 20177 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:19:22.453316 25438 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:22.476684 25386 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.514745 20220 leader_election.cc:400] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:22.493594 25441 raft_consensus.cc:2764] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:19:22.528767 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.531394 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.532200 20253 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:22.488289 25389 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:22.488325 25370 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.447463 25246 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.475226 25295 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.548375 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.547834 25405 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.556016 20249 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:22.556799 25313 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.563277 25428 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.564989 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3266) took 1002 ms. Trace:
I20260709 12:19:22.565559 20330 rpcz_store.cc:276] 0709 12:19:21.562925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.563065 (+   140us) service_pool.cc:224] Handling call
0709 12:19:21.563380 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.193924 (+630544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.564629 (+370705us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54001419d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:22.564883 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448658816}
I20260709 12:19:22.567431 25428 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.567827 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:22.570815 21039 raft_consensus.cc:606] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.571070 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3192) took 1608 ms. Trace:
I20260709 12:19:22.571657 20174 rpcz_store.cc:276] 0709 12:19:20.962739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.499311 (+536572us) service_pool.cc:224] Handling call
0709 12:19:21.685054 (+185743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.712364 (+ 27310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.570767 (+858403us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54000a5350. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.570960 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426233088}
I20260709 12:19:22.573622 20174 raft_consensus.cc:1217] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-9.10]   Dedup: 8.9->[9.10-9.10]
I20260709 12:19:22.574251 20174 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: [8.9-9.10]
W20260709 12:19:22.578233 25447 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:19:22.581745 20324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 976) took 1654 ms (client timeout 1569 ms). Trace:
W20260709 12:19:22.582165 25436 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:19:22.543008 25444 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 12:19:22.569439 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.594044 20174 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:19:22.594444 20174 pending_rounds.cc:85] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:19:22.594694 20174 pending_rounds.cc:107] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:19:22.541110 25280 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:22.582208 20324 rpcz_store.cc:269] 0709 12:19:20.927306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.927441 (+   135us) service_pool.cc:224] Handling call
0709 12:19:22.581500 (+1654059us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003985d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.581646 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868075776}
I20260709 12:19:22.568594 20253 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:22.594944 20174 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:22.569905 25313 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:22.597589 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094b66f474ed4806afc377722fa74020"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:22.609365 20330 raft_consensus.cc:606] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.599725 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:22.599454 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125299us
I20260709 12:19:22.610431 20330 raft_consensus.cc:614] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:22.545519 25448 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 12:19:22.615501 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.613171 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:22.540760 25148 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:19:22.619694 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:22.604225 25433 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 12:19:22.546720 25310 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:19:22.624541 20255 raft_consensus.cc:2368] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:19:22.596777 25263 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.629438 21040 pending_rounds.cc:85] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 9
I20260709 12:19:22.648581 21040 pending_rounds.cc:107] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:19:22.629596 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.630535 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.633996 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.642117 25313 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:22.642254 25443 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 12:19:22.645587 25446 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:19:22.656044 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.656057 20253 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:22.650573 21035 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 5.
W20260709 12:19:22.637272 25445 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:19:22.649024 21040 raft_consensus.cc:2889] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:22.659005 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:22.662930 21036 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:22.663249 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.657519 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.664228 20324 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:22.664584 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.648661 25362 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:22.670143 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:22.666676 25388 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 12:19:22.666446 25183 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:22.593900 25244 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.679613 20180 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:22.675050 21039 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 8 to 11, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:22.668593 25404 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.667914 25400 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:22.673807 25362 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.661576 25313 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.481926 25354 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 8 to 11, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:22.676581 25227 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.702782 20253 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.722373 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.722970 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:22.722976 20248 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:22.708201 20180 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:22.705073 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:22.713609 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.699285 25401 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.005s
I20260709 12:19:22.722846 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:22.724464 20255 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:22.689810 25400 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.719295 25362 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:22.732848 25400 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:22.733526 25449 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:22.733932 25449 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:22.694707 25339 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.695608 25432 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.729504 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:22.680532 25388 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.678232 25183 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.730558 25286 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:22.731911 25313 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:22.728529 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.742910 25429 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:22.744555 20324 raft_consensus.cc:606] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.766108 25429 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:22.734862 25449 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.767544 25449 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:22.767099 25429 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.739447 20177 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:22.727398 25404 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:19:22.751765 25225 consensus_meta.cc:287] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.000s
I20260709 12:19:22.749688 25457 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:19:22.771138 25457 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:22.771492 25457 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:22.754664 25450 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 12:19:22.758325 25454 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:19:22.759052 20294 leader_election.cc:400] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:19:22.778043 20294 leader_election.cc:403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:19:22.759637 25397 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:22.760736 25438 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.763897 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3216) took 1750 ms. Trace:
I20260709 12:19:22.765465 25286 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:22.776368 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 289995us
I20260709 12:19:22.777554 20171 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:22.778838 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:22.780694 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 93112.3us
I20260709 12:19:22.783100 20175 rpcz_store.cc:276] 0709 12:19:21.013072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.584176 (+571104us) service_pool.cc:224] Handling call
0709 12:19:21.584545 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.717665 (+133120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.717700 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.729154 (+ 11454us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.045936 (+316782us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:22.072794 (+ 26858us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.073111 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.073223 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.763661 (+690438us) raft_consensus.cc:1685] finished
0709 12:19:22.763683 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.763831 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13561,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":4095,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":2732,"thread_start_us":402170,"threads_started":2,"wal-append.queue_time_us":456407}
I20260709 12:19:22.784917 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.786051 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:22.786571 20324 raft_consensus.cc:606] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.786559 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.745968 25339 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.743026 25401 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.778885 25246 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.784433 25404 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:22.795276 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:22.796772 25057 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 12:19:22.797261 25057 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.798393 21041 raft_consensus.cc:2368] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:19:22.798702 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:22.801069 20173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3209) took 1832 ms (client timeout 1988 ms). Trace:
I20260709 12:19:22.786973 25295 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:22.801522 20173 rpcz_store.cc:269] 0709 12:19:20.968576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.351311 (+382735us) service_pool.cc:224] Handling call
0709 12:19:22.800890 (+1449579us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001d24d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.801010 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753259264}
I20260709 12:19:22.803511 20172 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:22.804390 25438 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.806313 25339 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.810472 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 1954) took 1565 ms. Trace:
I20260709 12:19:22.810858 20323 rpcz_store.cc:276] 0709 12:19:21.245241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.245363 (+   122us) service_pool.cc:224] Handling call
0709 12:19:21.255011 (+  9648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.815497 (+560486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.810217 (+994720us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400141ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:22.810407 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287563520}
I20260709 12:19:22.812865 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.814962 25461 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.820174 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.790146 25473 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:22.825277 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.828583 21034 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:22.828279 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:22.790549 25313 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.827468 25310 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:22.832647 25310 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.832947 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.834774 25310 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.835970 25388 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.837872 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.787510 25362 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.840878 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.841872 20220 leader_election.cc:400] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:22.841910 21039 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:22.843936 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:22.792583 25432 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:19:22.846408 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.846678 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.848562 21042 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:22.850050 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.850708 21039 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:22.851922 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.853355 20174 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:22.853734 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.854403 21043 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:22.854967 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.857455 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3233) took 1821 ms. Trace:
I20260709 12:19:22.857872 20172 rpcz_store.cc:276] 0709 12:19:21.035799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.655854 (+620055us) service_pool.cc:224] Handling call
0709 12:19:22.803182 (+1147328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.803937 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.857245 (+ 53308us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001d24d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.857391 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604160896}
I20260709 12:19:22.843139 25441 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:22.859967 25441 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.860380 25441 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:22.866006 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.853027 25473 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.867991 25313 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.868172 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.868414 25473 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.868589 25313 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.869796 25419 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:22.854425 25401 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.870862 25313 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:22.871230 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.870848 25473 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.872184 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3197) took 1906 ms. Trace:
I20260709 12:19:22.872627 20178 rpcz_store.cc:276] 0709 12:19:20.965549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.186523 (+1220974us) service_pool.cc:224] Handling call
0709 12:19:22.276929 (+ 90406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.363427 (+ 86498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.871964 (+508537us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54002378d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:22.872116 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207109888}
I20260709 12:19:22.875675 25405 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:22.879516 25064 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:22.861414 25225 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:22.880119 25064 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:22.880378 25225 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.881090 25064 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:22.882628 25225 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.883451 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.884497 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 974) took 1961 ms. Trace:
I20260709 12:19:22.846237 25457 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.884895 20321 rpcz_store.cc:276] 0709 12:19:20.923223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.923540 (+   317us) service_pool.cc:224] Handling call
0709 12:19:20.923948 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.397645 (+473697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.884286 (+1486641us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400409cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:22.884437 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083272576}
I20260709 12:19:22.885643 25457 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:22.864880 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:22.891389 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.892191 20174 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:22.893115 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:22.894013 25344 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.003s
I20260709 12:19:22.867702 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.900992 20248 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:22.906402 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:22.916486 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:22.917536 20321 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:22.918913 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:22.923614 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:22.926162 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:22.926949 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.927285 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.927959 20322 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:22.931870 21042 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 7: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:22.943686 25225 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:22.961207 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.961464 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.966176 20330 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:22.966288 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.969626 25390 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:22.970299 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:22.970331 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.971977 25390 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:22.971143 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.972445 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:22.974159 25400 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.975206 25390 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:22.975909 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:22.976364 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52889.8us
I20260709 12:19:22.976728 25390 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:22.977128 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:22.977212 25400 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:22.977332 25225 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:22.977982 25390 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:22.978392 25390 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.978729 25390 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:22.979110 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:22.980139 25225 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:22.980551 25225 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:22.980973 25225 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:22.988690 25390 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:22.989902 21034 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:22.991119 25339 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:22.991520 25390 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:22.992410 25457 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:19:22.994167 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 63716us
W20260709 12:19:22.994102 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 69603.3us
I20260709 12:19:22.995743 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.996685 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:22.997653 20172 raft_consensus.cc:2410] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:19:22.999094 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:22.999732 20328 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:23.000654 20323 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:23.002013 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:23.002528 20324 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:19:22.996443 20174 raft_consensus.cc:2955] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 8 to 11, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:22.916612 25422 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:23.004805 20329 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:23.001866 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:22.928993 25289 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.013324 20323 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:22.992820 25457 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:22.997658 25353 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.021301 25170 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:22.917091 25199 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:19:23.008033 25369 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:23.044613 20324 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:23.029825 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:22.998800 25434 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:19:23.049867 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:23.032159 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:23.060981 20180 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:23.051039 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:23.000732 25310 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:19:22.996948 25344 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:19:22.993040 25432 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:19:23.002985 25418 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:19:23.061908 21035 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:23.004336 25462 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.050s
W20260709 12:19:23.058620 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 70387.2us
I20260709 12:19:23.052068 25429 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:23.078950 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:23.080111 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85220.7us
I20260709 12:19:23.045857 25422 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:23.053978 25369 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:23.032159 25289 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.053417 25353 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.123574 21035 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:23.071729 25404 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:19:23.099010 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:23.127789 20178 raft_consensus.cc:2376] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16. Re-sending same reply.
I20260709 12:19:23.073334 25438 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:23.129997 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.076946 25148 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:23.135965 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.122004 25432 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.071352 25400 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:23.066589 25351 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:23.098342 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:23.077827 25362 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.126246 20180 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:19:23.140709 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 61831.6us
I20260709 12:19:23.154484 20322 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:23.100934 25429 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:23.134378 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 66373.2us
I20260709 12:19:23.130396 25438 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:23.162587 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.163874 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.172449 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:23.102439 25227 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:23.129643 25387 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.162716 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.238765 20176 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:23.243577 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.097954 25246 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:19:23.080066 25434 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:19:23.113066 25225 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.143172 25369 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.261370 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:23.282793 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 120162us
I20260709 12:19:23.152619 25351 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:23.152745 25400 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:23.283951 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:23.290642 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.292490 20176 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:23.294100 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1253) took 1357 ms. Trace:
I20260709 12:19:23.294605 21038 rpcz_store.cc:276] 0709 12:19:21.932188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.932359 (+   171us) service_pool.cc:224] Handling call
0709 12:19:21.932771 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.992276 (+ 59505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.992318 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.992912 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.240738 (+247826us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:22.464097 (+223359us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.596414 (+132317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.242039 (+645625us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b54005b68d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:23.242114 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.242181 (+    67us) raft_consensus.cc:1685] finished
0709 12:19:23.287392 (+ 45211us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.289231 (+  1839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70907,"prepare.queue_time_us":306885,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":96716,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"spinlock_wait_cycles":135625472,"thread_start_us":488832,"threads_started":3,"wal-append.queue_time_us":335291}
W20260709 12:19:23.283784 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 200229us
I20260709 12:19:23.297580 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.299021 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.307446 20175 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:23.154551 25432 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.291642 25324 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:23.100812 25457 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.334267 20176 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:19:23.299201 25400 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:23.293785 25351 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:23.340167 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.342490 20176 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:23.344270 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:23.274006 25227 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.308462 25346 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:23.339732 25488 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:19:23.345715 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.347553 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.284915 25387 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.334868 25313 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:23.362901 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.351377 20176 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:23.334565 25362 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:19:23.298409 25422 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.397919 20253 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:19:23.402033 25432 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.402792 25432 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:23.351475 25346 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:23.387893 25449 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.004s
I20260709 12:19:23.391475 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:23.392215 20178 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:23.390780 20176 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:23.392916 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:23.393167 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:23.412612 20248 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:23.358282 25354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35936 (request call id 0) took 4277 ms. Trace:
I20260709 12:19:23.390265 20180 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:23.357860 25244 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:23.335062 25438 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:23.351900 25324 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:19:23.422441 20180 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:19:23.424729 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 125806us
W20260709 12:19:23.432595 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.433141 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.419539 20174 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:23.408181 25346 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:23.407394 25418 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.403323 25432 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.464355 25432 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:23.468447 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.358098 25429 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.414623 25388 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:23.474501 20324 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:23.478153 25103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.720s	user 0.027s	sys 0.040s
W20260709 12:19:23.478510 25103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.027s	sys 0.040s
I20260709 12:19:23.466059 25438 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:23.474009 25432 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:23.484117 25497 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:23.484531 25476 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 12:19:23.485401 25483 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:19:23.483438 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.479069 25289 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:23.489522 25489 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 12:19:23.545768 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71340.8us
I20260709 12:19:23.538502 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2417) took 1891 ms. Trace:
I20260709 12:19:23.563519 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:23.531083 20247 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:23.561748 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.564940 20247 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:23.564886 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:23.488401 25495 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:19:23.567313 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:23.517930 25491 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:19:23.563290 20252 rpcz_store.cc:276] 0709 12:19:21.647105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.649229 (+  2124us) service_pool.cc:224] Handling call
0709 12:19:21.649539 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.027847 (+378308us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b4800202458. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:19:22.875488 (+847641us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b18003e2960. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaef0bfb 00007f5ddaefb64b
0709 12:19:22.875669 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.875702 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.876381 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.050478 (+174097us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:23.076213 (+ 25735us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.076406 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.076491 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.538137 (+461646us) raft_consensus.cc:1685] finished
0709 12:19:23.538194 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.538413 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11362,"prepare.queue_time_us":25687,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":104724,"raft.run_cpu_time_us":2562,"raft.run_wall_time_us":307334,"spinlock_wait_cycles":44119552,"thread_start_us":242462,"threads_started":2,"wal-append.queue_time_us":255804}
I20260709 12:19:23.562476 25501 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:19:23.489349 25227 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:23.575017 25479 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:19:23.493893 25499 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:23.576874 25499 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.485803 25496 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:23.518119 25170 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:23.517230 25392 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:23.494056 25225 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.566071 20247 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:23.592331 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 109994us
I20260709 12:19:23.538769 25497 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.567116 25280 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:23.570070 25437 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:23.620302 25437 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:23.595625 25392 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:23.621212 25437 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.593894 25501 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:23.594151 25418 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:23.601840 25505 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:23.607889 25387 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.582132 25496 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.590458 25253 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:23.614405 20247 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:23.615654 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:23.592937 25170 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:23.618985 25497 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.619693 25405 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:23.503693 25432 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.627441 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:23.625195 25441 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.764s	user 0.014s	sys 0.000s
W20260709 12:19:23.630219 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62930us
I20260709 12:19:23.624104 25437 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:23.635524 25506 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.628610 25170 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.625257 25253 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:23.643263 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:23.635593 25472 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.810s	user 0.002s	sys 0.008s
I20260709 12:19:23.624153 25499 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:23.631877 25403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.024s	sys 0.075s
I20260709 12:19:23.630496 25418 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:23.647871 20247 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:19:23.662982 20247 pending_rounds.cc:85] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 9
I20260709 12:19:23.663265 20247 pending_rounds.cc:107] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:19:23.663518 20247 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:23.664569 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2421) took 1893 ms. Trace:
I20260709 12:19:23.664978 20247 rpcz_store.cc:276] 0709 12:19:21.771311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.771452 (+   141us) service_pool.cc:224] Handling call
0709 12:19:21.771763 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.530921 (+1759158us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54003c3320. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefa1c0 00007f5ddaefb231 00007f5ddaef7d8f 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c
0709 12:19:23.664226 (+133305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.664495 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920624512}
I20260709 12:19:23.644134 25103 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:23.672343 25170 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:23.674188 25064 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:23.676810 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:23.679853 25475 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.797s	user 0.004s	sys 0.000s
I20260709 12:19:23.680675 25494 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:23.681252 25494 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.681699 25494 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:23.684473 25504 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:19:23.641721 25438 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:19:23.689169 20174 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:19:23.664002 25403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.027s	sys 0.081s
W20260709 12:19:23.667847 25430 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:19:23.624790 25392 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.637370 25441 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.693408 25462 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:23.666388 25422 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:23.700870 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:23.702713 21038 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:23.703145 25498 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:23.695654 25339 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.706530 25339 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.707170 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:23.707808 21038 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:23.708833 25339 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:23.709949 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.712154 25057 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.715847 25462 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:23.716267 25346 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.716897 25462 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.718568 25346 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.720000 25253 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.721096 25253 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:23.722409 25199 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:23.722947 25199 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:23.723634 25405 consensus_queue.cc:1175] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "85fa447fc35d4f88ab7c85630749ec78" responder_term: 15 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:23.643685 25506 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.701822 25496 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.647406 25324 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:19:23.731855 25289 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:23.772895 25289 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.735740 25427 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:23.776029 25427 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.778867 25427 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.741591 25103 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:23.784926 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:23.786262 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 992) took 1129 ms. Trace:
I20260709 12:19:23.786654 20326 rpcz_store.cc:276] 0709 12:19:22.656508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.657943 (+  1435us) service_pool.cc:224] Handling call
0709 12:19:22.658361 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.658793 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.658834 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.659441 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.777603 (+118162us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:22.777650 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.777724 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.634922 (+857198us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:23.780617 (+145695us) raft_consensus.cc:1685] finished
0709 12:19:23.780644 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.786189 (+  5545us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1794,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1970,"spinlock_wait_cycles":10658688,"thread_start_us":97615,"threads_started":1,"wal-append.queue_time_us":110455}
I20260709 12:19:23.790225 25092 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:23.794677 25351 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.782382 25392 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:23.781093 25496 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.804124 25496 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:23.804441 25400 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.806834 25400 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.810249 25403 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:23.810853 25403 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.813103 25403 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:23.816543 25470 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.985s	user 0.009s	sys 0.009s
I20260709 12:19:23.818212 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1259) took 1189 ms. Trace:
W20260709 12:19:23.818977 25474 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.950s	user 0.009s	sys 0.001s
I20260709 12:19:23.820590 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:23.821415 20327 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:23.821854 20327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 1959) took 2066 ms (client timeout 1580 ms). Trace:
W20260709 12:19:23.820725 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3240) took 1696 ms (client timeout 2151 ms). Trace:
W20260709 12:19:23.822230 20327 rpcz_store.cc:269] 0709 12:19:21.755091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.764605 (+  9514us) service_pool.cc:224] Handling call
0709 12:19:23.820438 (+2055833us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5800150698. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:19:23.821786 (+  1348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4422400}
W20260709 12:19:23.822781 20179 rpcz_store.cc:269] 0709 12:19:22.124264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.364032 (+239768us) service_pool.cc:224] Handling call
0709 12:19:23.820511 (+1456479us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b54000a6254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:23.820664 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161831808}
I20260709 12:19:23.830111 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:23.830927 20326 raft_consensus.cc:606] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.849193 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:23.818567 21040 rpcz_store.cc:276] 0709 12:19:22.628629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.628896 (+   267us) service_pool.cc:224] Handling call
0709 12:19:22.629231 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.661571 (+ 32340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.661622 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.665599 (+  3977us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.746728 (+ 81129us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:22.753756 (+  7028us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.753999 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.754078 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.815995 (+1061917us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:23.817906 (+  1911us) raft_consensus.cc:1685] finished
0709 12:19:23.818005 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.818148 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6773,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":83,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":22127488,"thread_start_us":72046,"threads_started":1,"wal-append.queue_time_us":159612}
I20260709 12:19:23.416116 25354 rpcz_store.cc:276] 0709 12:19:19.072565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.072704 (+   139us) service_pool.cc:224] Handling call
0709 12:19:19.094179 (+ 21475us) log.cc:844] Serialized 501 byte log entry
0709 12:19:19.476865 (+382686us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:23.349390 (+3872525us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139191,"raft.queue_time_us":47218,"raft.run_cpu_time_us":13829,"raft.run_wall_time_us":538045,"spinlock_wait_cycles":28780672,"thread_start_us":42860,"threads_started":1,"wal-append.queue_time_us":106440,"wal-append.run_cpu_time_us":3232,"wal-append.run_wall_time_us":1277866}
I20260709 12:19:23.806866 25496 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.727355 25422 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:23.857110 25512 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:19:23.866528 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:23.861824 25511 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:19:23.853128 25432 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.884421 25506 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.862613 25289 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.893119 25441 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:23.896071 25351 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.898751 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:23.899596 25438 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:23.907194 20327 raft_consensus.cc:606] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:23.907599 20327 raft_consensus.cc:614] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:23.909149 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:23.911886 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:23.915313 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:23.917120 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:23.917728 20327 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:23.919081 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.893275 25422 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:23.903244 25494 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.939188 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:23.940240 20255 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:23.900731 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:23.923914 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:23.942310 20251 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:23.926273 20256 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:23.937269 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.944417 20174 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:23.945648 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:23.946362 20174 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:23.949723 20174 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:19:23.950754 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:23.955740 25199 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.956923 20172 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:23.957023 25513 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.958036 20172 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:23.958271 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:23.959034 20254 raft_consensus.cc:2368] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:23.959731 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:23.960255 21035 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:23.958070 25513 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:23.961673 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:23.960726 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:23.962514 20249 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:23.962883 20253 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 7.
I20260709 12:19:23.963850 20329 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:23.964570 25419 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.964691 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:23.968582 20327 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:23.968997 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:23.969599 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:23.970554 20175 pending_rounds.cc:85] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:19:23.970641 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:23.971046 20175 pending_rounds.cc:107] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:19:23.971344 20175 raft_consensus.cc:2889] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:23.972519 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:23.973383 20329 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:23.970106 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:23.977196 20327 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 6: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:23.982741 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.987635 20174 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
W20260709 12:19:24.008352 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.011104 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:24.012395 25352 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:24.012799 25352 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.013044 21007 leader_election.cc:400] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:24.012792 25346 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:24.013401 21007 leader_election.cc:403] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:24.014263 21007 leader_election.cc:400] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:24.014516 21007 leader_election.cc:403] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:24.013232 25352 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:24.016094 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46079.8us
I20260709 12:19:23.847915 25369 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.019656 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:24.030396 20327 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:24.035409 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:23.962517 25513 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:24.044864 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.050181 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:24.051182 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.052313 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:24.053241 20327 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:24.056645 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:24.057786 20173 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:23.965090 25419 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.060632 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:24.062191 20324 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:24.067591 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:24.072952 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.043722 25437 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:24.087761 21035 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:24.049103 25449 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:24.098448 20328 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:24.089452 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54112.4us
I20260709 12:19:24.101856 20252 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:24.044023 25441 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.102046 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:24.104055 20327 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:24.106398 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.063596 25490 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:24.063437 25324 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.071412 25253 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:24.118590 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:24.125151 25437 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:24.162325 20220 leader_election.cc:336] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.151s (SENT)
W20260709 12:19:24.309588 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 182491us
I20260709 12:19:24.241865 25183 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:24.244180 25509 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 12:19:24.217756 25494 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:24.121938 25092 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.318990 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.319547 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.320149 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:24.321117 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.323747 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:24.293001 20174 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:24.325395 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:24.325963 20174 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:24.221995 25170 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.324484 25324 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.329238 25324 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.338287 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:24.102813 25441 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.096781 25346 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:24.103188 25057 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:24.300606 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:24.302054 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:24.366367 21036 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:24.303676 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:24.312269 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:24.313695 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 195169us
I20260709 12:19:24.317945 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:24.319725 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.340067 21042 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:24.370512 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.369000 21037 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:24.310272 25462 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.375260 25422 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:24.375804 25351 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:24.375962 25422 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.377185 25437 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.378754 25422 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:24.379459 25422 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:24.381922 25422 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.365305 25324 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.362533 25506 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:19:24.384433 25422 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:24.385102 25422 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.385718 25422 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.379755 25225 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.388027 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:24.388199 25225 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.390906 25225 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.388885 20172 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 6: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:24.391464 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:24.392570 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:24.392720 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:24.395759 25388 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:24.396225 25388 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:24.396411 25527 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:19:24.396628 25388 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.397709 25418 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:24.398187 25418 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:24.399364 25418 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.401185 25496 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.401896 25496 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.406117 25496 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.407179 25427 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:24.407614 25427 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:24.375326 25392 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:24.408532 25427 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.408820 25392 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.410013 25427 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.375288 25462 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.411535 25392 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:24.413292 25462 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.413326 25320 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.418002 25422 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.419263 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.415295 25320 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.420073 20256 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:24.420970 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.421396 25320 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.422040 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.423096 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.423741 20255 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:24.424566 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.426097 20251 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:19:24.340605 25170 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.429540 25170 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:24.362835 25494 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:24.430274 25494 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.430629 25494 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:24.437045 20256 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 5.
I20260709 12:19:24.445658 20249 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:24.288676 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.317215 25183 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.442673 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.453619 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.339998 25064 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:24.456518 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 168002us
I20260709 12:19:24.368371 25057 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.328150 25092 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.462394 25432 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:24.466897 25432 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.467290 25432 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:24.468189 25092 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:24.469168 25518 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:19:24.449090 25369 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:24.448684 25324 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.470602 25324 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.465039 25441 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.465260 21035 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:24.465512 25057 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:24.466084 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.466197 25533 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:24.464227 25462 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:24.475456 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1281) took 1644 ms (client timeout 1649 ms). Trace:
I20260709 12:19:24.478116 20247 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:24.478060 21034 rpcz_store.cc:269] 0709 12:19:22.831070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.839606 (+  8536us) service_pool.cc:224] Handling call
0709 12:19:24.475237 (+1635631us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54005d5a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:24.475388 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321959296}
W20260709 12:19:24.479202 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.460529 25422 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:24.465075 25183 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.478610 25441 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.460866 25280 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 12:19:24.498929 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 380829us
I20260709 12:19:24.484092 25253 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.484849 25422 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.485122 25533 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:24.462752 25064 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.507431 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:24.491427 25289 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.516073 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:24.498697 25392 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.509943 25422 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:24.526611 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.532848 25520 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:19:24.504283 25441 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:24.536867 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:24.539939 21042 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:24.520090 25200 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:24.543315 25200 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:24.544314 25200 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.544740 25494 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.546973 25494 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:24.553171 25441 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:24.553335 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:24.528702 25392 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.554123 20173 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:24.555007 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:24.555557 20173 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:24.556299 25392 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.557461 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.565163 20247 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
W20260709 12:19:24.557896 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 3021) took 2554 ms (client timeout 2640 ms). Trace:
W20260709 12:19:24.566435 20171 rpcz_store.cc:269] 0709 12:19:22.003277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.427516 (+424239us) service_pool.cc:224] Handling call
0709 12:19:24.557678 (+2130162us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54003e6f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:24.557817 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776361728}
I20260709 12:19:24.567093 25392 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.567672 25392 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:24.570703 25392 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.558627 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:24.571283 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.556623 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:24.557071 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.575959 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.534916 25324 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:24.571736 25225 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:24.519001 25289 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.535090 25352 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:24.576757 25401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.693s	user 0.019s	sys 0.019s
I20260709 12:19:24.664019 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3267) took 1740 ms. Trace:
I20260709 12:19:24.576526 25310 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:19:24.591293 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.643801 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.690501 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.706979 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:24.702821 25522 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:19:24.716729 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1286) took 1019 ms. Trace:
I20260709 12:19:24.717327 21041 rpcz_store.cc:276] 0709 12:19:23.697607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.697758 (+   151us) service_pool.cc:224] Handling call
0709 12:19:23.703834 (+  6076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.848539 (+144705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.848578 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:23.853753 (+  5175us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.124592 (+270839us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:24.124636 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.124707 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:24.702070 (+577363us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:24.716260 (+ 14190us) raft_consensus.cc:1685] finished
0709 12:19:24.716294 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.716630 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5279,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"spinlock_wait_cycles":80811776,"thread_start_us":399395,"threads_started":2,"wal-append.queue_time_us":455103}
W20260709 12:19:24.708935 25401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.826s	user 0.019s	sys 0.020s
I20260709 12:19:24.709154 25225 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.714035 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.564637 25280 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:24.724323 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:24.581231 25432 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:24.672952 25534 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:19:24.699522 25529 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260709 12:19:24.696346 25353 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:24.696789 25457 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:24.695683 25419 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:24.731690 25449 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.010s
I20260709 12:19:24.951884 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:24.709859 25310 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.971607 20253 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:19:24.972261 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.029s	sys 0.080s
I20260709 12:19:24.581836 25362 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:24.958580 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:24.731612 25490 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.000s
I20260709 12:19:24.960647 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:24.972997 21041 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:24.973421 21035 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:24.583099 25462 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:24.736688 25392 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:24.978892 20173 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:24.730911 25496 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:24.964910 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.972631 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.029s	sys 0.080s
I20260709 12:19:24.992000 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:24.992199 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 668503us
I20260709 12:19:24.992913 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:24.983793 20322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3278) took 2014 ms (client timeout 1918 ms). Trace:
W20260709 12:19:25.008061 20322 rpcz_store.cc:269] 0709 12:19:22.969212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.970038 (+   826us) service_pool.cc:224] Handling call
0709 12:19:24.983512 (+2013474us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002b5f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:24.983691 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370852096}
I20260709 12:19:24.709632 20321 rpcz_store.cc:276] 0709 12:19:22.923266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.924683 (+  1417us) service_pool.cc:224] Handling call
0709 12:19:22.925011 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:22.929661 (+  4650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.929708 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:22.965206 (+ 35498us) log.cc:844] Serialized 52 byte log entry
0709 12:19:22.990719 (+ 25513us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.990771 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.990844 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:24.562022 (+1571178us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b1800397cc0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dd92a6 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9
0709 12:19:24.661787 (+ 99765us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b24003bcbe8. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9 00007f5dd7e4aa55 00007f5dd7e49fb0 00007f5ddaac0488 00007f5ddaac0be8 00007f5ddaa98398 00007f5ddaa9376a 00007f5ddaa92bb6
0709 12:19:24.663745 (+  1958us) raft_consensus.cc:1685] finished
0709 12:19:24.663769 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.663948 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2596,"raft.queue_time_us":64966,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6388,"spinlock_wait_cycles":14379136,"thread_start_us":25117,"threads_started":1,"wal-append.queue_time_us":15212}
I20260709 12:19:25.016201 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae0621ca652d416d9284323ec7eb2363 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:25.017110 20063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 304502us
I20260709 12:19:25.018087 25289 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:24.980147 25310 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:24.989751 25449 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:24.980043 25462 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.978283 25362 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.023293 25462 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:24.990252 25506 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.034742 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2445) took 1124 ms. Trace:
I20260709 12:19:24.745308 25280 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:24.978814 25392 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:25.040902 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.006155 25496 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.048820 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3263) took 1116 ms. Trace:
I20260709 12:19:25.011003 25490 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:25.054231 20175 rpcz_store.cc:276] 0709 12:19:23.932225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.935635 (+  3410us) service_pool.cc:224] Handling call
0709 12:19:23.970361 (+ 34726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.979147 (+  8786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.979187 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:23.979778 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.238268 (+258490us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:24.238308 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.238394 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:24.698831 (+460437us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:25.019606 (+320775us) raft_consensus.cc:1685] finished
0709 12:19:25.019628 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.048718 (+ 29090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116028288,"thread_start_us":182970,"threads_started":1,"wal-append.queue_time_us":353287}
I20260709 12:19:25.035519 20248 rpcz_store.cc:276] 0709 12:19:23.910637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.915062 (+  4425us) service_pool.cc:224] Handling call
0709 12:19:23.964114 (+ 49052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.964482 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:23.964512 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:23.965020 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.449087 (+484067us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:24.449137 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.449230 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.034521 (+585291us) raft_consensus.cc:1685] finished
0709 12:19:25.034543 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.034682 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27478,"raft.queue_time_us":1108,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10151,"thread_start_us":483700,"threads_started":1,"wal-append.queue_time_us":555645}
I20260709 12:19:24.625461 25533 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.013178 25225 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.020917 25200 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.024506 25103 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.088625 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:25.056970 25549 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.091264 25549 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.091686 25549 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:25.098042 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109153us
I20260709 12:19:25.033756 25362 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:25.056277 25532 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.435s	user 0.000s	sys 0.001s
I20260709 12:19:25.053896 25392 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.055861 25496 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.105377 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.106127 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:25.059253 25473 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:25.114187 21034 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:19:25.110275 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 386029us
I20260709 12:19:25.122064 20254 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:25.102412 25103 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.123301 25103 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.120903 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:25.123791 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:25.125509 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.127728 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 893) took 1969 ms. Trace:
I20260709 12:19:25.128548 20180 rpcz_store.cc:276] 0709 12:19:23.158038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.423537 (+265499us) service_pool.cc:224] Handling call
0709 12:19:23.719200 (+295663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:23.719750 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:23.720132 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 12:19:24.330621 (+610489us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b180045a840. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:19:24.330793 (+   172us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.331353 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.331523 (+   170us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:24.337085 (+  5562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.337181 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:24.337222 (+    41us) raft_consensus.cc:1685] finished
0709 12:19:24.363743 (+ 26521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.127357 (+763614us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000c5dd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:25.127604 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":558592,"prepare.queue_time_us":3767,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":595708,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":15026,"spinlock_wait_cycles":697493632,"thread_start_us":49241,"threads_started":1,"wal-append.queue_time_us":49529}
I20260709 12:19:25.090046 25064 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.103071 25369 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.096733 25461 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:25.136111 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 117222us
I20260709 12:19:25.149529 21035 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:25.052495 25506 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.176564 25506 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.177474 25557 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.178073 25557 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.180886 25227 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.181435 25227 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.152685 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.184430 21035 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:25.185016 21035 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:19:25.154343 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.150925 25369 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:25.164037 25539 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
W20260709 12:19:25.164438 25536 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 12:19:25.164561 25353 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.165066 25549 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:25.166107 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 796374us
I20260709 12:19:25.225775 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:25.227103 21007 leader_election.cc:400] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
W20260709 12:19:25.168576 25541 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 12:19:25.168931 25280 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.170823 25418 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:25.171856 25430 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:25.171663 25461 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:25.172683 25540 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
I20260709 12:19:25.176621 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3249) took 2325 ms. Trace:
I20260709 12:19:25.159451 20175 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:19:25.188709 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.240711 25551 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.241223 25551 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.242166 25461 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:25.242980 25422 consensus_meta.cc:287] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.005s
I20260709 12:19:25.119769 25473 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:25.244280 25473 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.245325 25473 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:25.198748 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.138173 25289 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:25.104837 25200 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.229710 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:25.183548 25227 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.203466 25428 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.238828 20177 rpcz_store.cc:276] 0709 12:19:22.851258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.851374 (+   116us) service_pool.cc:224] Handling call
0709 12:19:23.822468 (+971094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.335908 (+513440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.335940 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.336007 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:24.336037 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.336104 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.176448 (+840344us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54000a6250. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:25.176554 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545085,"raft.queue_time_us":516650,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":2225823488}
W20260709 12:19:25.251988 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.253563 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.254194 20254 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:25.260150 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:25.228658 25352 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:25.231105 25183 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:25.249244 25542 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 12:19:25.224339 25405 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:19:25.219002 25547 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:19:25.239002 25432 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.277405 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:25.285347 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:25.249944 25280 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:25.277794 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:25.281514 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:25.243412 25422 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.280809 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3261) took 1361 ms. Trace:
I20260709 12:19:25.320318 20179 rpcz_store.cc:276] 0709 12:19:23.919003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.919529 (+   526us) service_pool.cc:224] Handling call
0709 12:19:23.919942 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.341709 (+421767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.368684 (+ 26975us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.370947 (+  2263us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.578079 (+207132us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:24.578122 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.578200 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.168030 (+589830us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:25.280453 (+112423us) raft_consensus.cc:1685] finished
0709 12:19:25.280476 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.280739 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":421279,"raft.queue_time_us":455153,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":10351872,"thread_start_us":170138,"threads_started":1,"wal-append.queue_time_us":308590}
I20260709 12:19:25.281387 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3262) took 1349 ms. Trace:
I20260709 12:19:25.322154 20178 rpcz_store.cc:276] 0709 12:19:23.931859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.934845 (+  2986us) service_pool.cc:224] Handling call
0709 12:19:23.935237 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:24.372959 (+437722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.373011 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:24.373884 (+   873us) log.cc:844] Serialized 26 byte log entry
0709 12:19:24.625437 (+251553us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:24.625485 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.625560 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:25.281174 (+655614us) raft_consensus.cc:1685] finished
0709 12:19:25.281197 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:25.281323 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432977,"raft.queue_time_us":440082,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":251245,"threads_started":1,"wal-append.queue_time_us":286761}
I20260709 12:19:25.249982 25561 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.283306 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.230623 25401 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:19:25.271967 25227 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:25.291491 20254 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
W20260709 12:19:25.293298 25544 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:19:25.293351 25438 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:25.297091 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.266116 25553 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:25.264515 25289 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:25.303182 25369 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:25.274866 25461 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.280516 25548 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:25.305589 25549 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.274711 25390 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:19:25.308315 25557 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:25.333074 25388 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.936s	user 0.008s	sys 0.006s
I20260709 12:19:25.262838 25225 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.330078 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 197776us
I20260709 12:19:25.286262 25547 consensus_queue.cc:1243] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:19:25.340997 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 322330us
I20260709 12:19:25.341363 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:25.367676 20247 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.263863 25428 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.322002 25405 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.303211 25200 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.330171 25558 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.339883 25560 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.366156 25170 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.350526 25449 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.329013 25280 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.340909 25339 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.349797 25461 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:25.362630 25057 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.003s
I20260709 12:19:25.356125 25556 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.330943 25310 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.363648 25183 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.362239 25438 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:25.347604 25227 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.408609 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:25.419847 20178 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.409325 25057 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.403975 25170 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.410298 25563 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.432041 25563 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.432840 20248 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:19:25.416488 25462 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.411602 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.413193 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:25.333045 25561 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.435153 20179 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:25.436932 25561 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.437675 25561 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:25.438145 25561 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.407166 25200 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.410545 25422 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.422802 20175 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:25.411260 25461 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.367828 25388 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.434514 25563 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.417280 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.440748 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:25.456629 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:25.443255 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77666.6us
I20260709 12:19:25.460485 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.461237 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:25.461831 20254 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:25.462533 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.463135 21035 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:25.463373 20256 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:19:25.463809 20256 pending_rounds.cc:85] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 6
I20260709 12:19:25.373368 25225 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.446873 20249 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:25.385370 25405 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.464026 20256 pending_rounds.cc:107] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:19:25.408955 20247 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:25.466041 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:25.365173 25548 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.512440 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.532765 20171 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 6: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:25.533077 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:25.513074 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.533941 20255 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.534169 20173 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:25.534348 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.535889 21035 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:25.405706 25449 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.536708 20247 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:19:25.534978 21037 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:25.539996 20174 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.535302 20256 raft_consensus.cc:2889] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:25.469952 20295 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:25.472731 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.544739 20178 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:25.468648 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.545884 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.501755 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.547201 20251 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:19:25.513937 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.548113 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.411914 25339 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.392920 25558 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.546663 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:25.563659 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:25.552479 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.564998 20178 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:25.553184 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:25.559715 20253 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:25.566504 20175 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.531592 25422 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:25.530898 25563 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.531041 25557 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.397650 25560 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.531859 25432 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.416776 25556 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:25.544315 25427 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.130s	user 0.010s	sys 0.003s
I20260709 12:19:25.551937 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.592206 20171 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:25.593233 20171 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:25.560853 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:25.568797 25565 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:19:25.593940 20251 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:25.550271 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.447429 25549 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:25.568536 20180 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:25.570117 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.424296 25183 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.603076 25183 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.569422 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.603541 25199 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.605427 25549 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:25.570596 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.606344 25549 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.569067 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.570135 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:25.608409 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:25.613392 25170 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:25.616544 25553 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:25.616911 25553 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:25.617659 25553 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.618834 25553 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.620509 25573 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:25.620988 25573 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:25.621399 25573 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:25.579255 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:25.582899 25401 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.636482 25401 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.636524 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:25.637009 25401 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.600322 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:25.447556 25200 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.644177 25428 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.645114 25547 raft_consensus.cc:993] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:25.622995 25549 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.450438 25289 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:25.648805 25419 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:25.567063 25571 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.656185 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.588344 25561 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.587898 25418 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.588936 25562 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:25.627774 25522 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:25.599598 25422 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.592218 25432 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:25.708425 25392 consensus_meta.cc:287] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.006s
I20260709 12:19:25.708963 25549 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.709523 25449 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:25.710198 25432 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.710783 25561 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:25.711177 25561 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.680034 25419 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:25.711584 25561 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:25.711716 25200 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.712219 25310 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.695102 25462 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.699002 25574 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:19:25.709005 25392 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.714766 25280 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.715376 20172 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:25.576748 25438 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.694368 25513 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:19:25.716885 25579 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.717484 25579 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.717931 25579 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.706974 25418 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:25.711485 25496 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.007s
I20260709 12:19:25.586000 25563 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.694514 25571 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:25.697026 25405 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.720506 25419 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.688784 25547 raft_consensus.cc:1081] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:25.730484 25405 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:25.445097 25369 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:19:25.733394 25225 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.681458 20175 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:19:25.729254 20255 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:25.737221 21041 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:25.714896 25562 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.719624 25392 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.725792 25419 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:25.771737 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.776026 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 194955us
I20260709 12:19:25.762938 25506 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.782740 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 312875us
I20260709 12:19:25.762851 25550 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.719993 25496 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.728229 25422 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.763530 25405 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.811359 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:25.841346 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:25.831447 25558 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.828080 25575 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:19:25.859966 25369 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:25.855536 25591 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:19:25.860458 25369 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:25.861574 25562 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.861466 25369 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.862641 25369 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:25.866245 25473 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.006s
I20260709 12:19:25.858206 25580 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:25.867810 25580 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:25.868232 25580 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:25.856350 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45076.9us
I20260709 12:19:25.871739 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:25.872458 21041 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
W20260709 12:19:25.859340 25589 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:19:25.874584 25183 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:25.875114 25183 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:25.876618 25103 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 12:19:25.876720 25591 consensus_queue.cc:1243] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:25.877344 25591 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:25.877156 25103 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.877737 25591 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:25.878732 25591 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.879288 25533 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:25.879805 25533 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:25.880836 25533 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.882328 25533 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.883697 25339 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.883882 25183 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.884747 25591 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:25.805377 25227 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.804260 25057 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.825232 25418 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:25.870244 25362 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.000s
I20260709 12:19:25.901542 25362 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.904559 25548 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.906481 25388 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.906592 25551 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:25.910265 25577 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:25.910341 25462 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:25.910815 25462 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:25.911424 25571 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.807929 25550 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.911722 25462 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.913347 25462 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:25.913980 25550 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.807605 25506 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.916262 25506 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.917086 25401 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.917829 25496 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.886127 25563 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.920028 25556 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.920853 25422 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:25.883423 25561 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.925212 25561 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.833266 25560 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.932245 25405 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.937052 25557 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.938138 25579 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.938990 25461 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:25.940308 25579 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.941401 25461 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:25.942032 25573 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:25.292965 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.985148 20073 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 11, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 11 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:25.994029 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 385494us
I20260709 12:19:26.002144 20178 raft_consensus.cc:2410] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:19:26.004849 20173 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:26.003328 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3044) took 1617 ms. Trace:
I20260709 12:19:26.006296 20172 rpcz_store.cc:276] 0709 12:19:24.385563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.393655 (+  8092us) service_pool.cc:224] Handling call
0709 12:19:25.183430 (+789775us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:19:25.183675 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.715825 (+532150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.002440 (+286615us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54002404d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:26.002995 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246281472}
I20260709 12:19:26.014170 20247 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:26.015827 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 143298us
I20260709 12:19:26.017781 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3047) took 1631 ms. Trace:
I20260709 12:19:26.018342 20174 rpcz_store.cc:276] 0709 12:19:24.386305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.395475 (+  9170us) service_pool.cc:224] Handling call
0709 12:19:24.446233 (+ 50758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:25.546003 (+1099770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.016963 (+470960us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540031b5d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:26.017493 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514967808}
I20260709 12:19:25.887482 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:25.888564 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.036791 20325 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:26.123916 25575 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:26.126083 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.135730 20324 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:26.114431 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.134343 25103 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.140832 25362 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:26.122061 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:26.148522 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.149959 25533 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.151307 25533 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.154533 25533 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:26.160791 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 228866us
W20260709 12:19:26.162551 20077 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 319) took 23297 ms (client timeout 15000 ms). Trace:
I20260709 12:19:26.133672 25560 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.164602 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.164471 25560 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.165623 21034 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:26.125936 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.168432 20326 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.077989 25555 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.119485 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:26.036227 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.074939 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.113137 25573 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:26.184675 25199 consensus_meta.cc:287] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.580s	user 0.016s	sys 0.004s
I20260709 12:19:26.126327 25557 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:26.185956 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.121066 25564 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:19:26.120343 25562 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:19:26.190119 25579 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.122238 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.079909 25506 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.080408 25353 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 12:19:26.198997 25579 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.202047 20252 raft_consensus.cc:2410] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:26.198287 25557 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.204008 25579 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.202718 25506 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.205282 25538 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.205701 25557 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:26.206758 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44281.6us
I20260709 12:19:26.205972 25538 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:26.218195 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.214118 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.061319 25294 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
W20260709 12:19:26.223224 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 104102us
I20260709 12:19:26.219907 25560 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.209213 25575 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.221812 25564 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:26.247946 25564 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:26.248047 25597 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:26.248901 25597 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.249836 25564 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.251947 25564 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:26.236364 25369 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.255419 25538 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.255909 25369 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.236711 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:26.239455 25596 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:26.257283 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1282) took 2152 ms. Trace:
I20260709 12:19:26.259189 21034 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:26.260095 20252 rpcz_store.cc:276] 0709 12:19:24.105210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.106135 (+   925us) service_pool.cc:224] Handling call
0709 12:19:26.256956 (+2150821us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54003cafd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:26.257179 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4816697088}
I20260709 12:19:26.220112 20073 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 9, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.266201 20073 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 9 to 12, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 12 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.260000 25596 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:26.269579 25575 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:26.269336 25596 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.271044 25596 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.271804 25369 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.272807 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:26.273102 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.276151 25560 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.276654 25560 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.277156 25560 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.281308 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.282045 20327 raft_consensus.cc:2376] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16. Re-sending same reply.
I20260709 12:19:26.283321 25579 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:26.283977 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.284102 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.286461 20322 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:26.287966 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.289084 20329 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:26.290237 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.255293 25401 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.295670 25557 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:25.944118 25580 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.295791 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.297114 20321 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:26.293960 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.298473 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:26.298693 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57422.5us
I20260709 12:19:26.299415 20322 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:26.296343 25557 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.287895 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:26.163173 20077 rpcz_store.cc:269] 0709 12:19:02.864867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.865097 (+   230us) service_pool.cc:224] Handling call
0709 12:19:26.162129 (+23297032us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:17.170662 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:17.297740 (+127078us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:17.306944 (+  9204us) write_op.cc:435] Acquired schema lock
0709 12:19:17.310963 (+  4019us) tablet.cc:662] Decoding operations
0709 12:19:17.412216 (+101253us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:17.412321 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:17.412365 (+    44us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:19:17.413217 (+   852us) tablet.cc:701] Row locks acquired
0709 12:19:17.413269 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:19:17.413499 (+   230us) write_op.cc:270] Start()
0709 12:19:17.413674 (+   175us) write_op.cc:276] Timestamp: P: 1783599557413423 usec, L: 0
0709 12:19:17.413715 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:19:17.414539 (+   824us) log.cc:844] Serialized 2845 byte log entry
0709 12:19:18.136528 (+721989us) op_driver.cc:464] REPLICATION: finished
0709 12:19:18.384066 (+247538us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5dde92eef0
0709 12:19:18.951386 (+567320us) write_op.cc:301] APPLY: starting
0709 12:19:18.951506 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:19.428115 (+476609us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:19.428196 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:19.590904 (+162708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:19.591264 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:19:19.591333 (+    69us) write_op.cc:312] APPLY: finished
0709 12:19:19.644338 (+ 53005us) log.cc:844] Serialized 73 byte log entry
0709 12:19:19.846700 (+202362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:19.905138 (+ 58438us) write_op.cc:454] Released schema lock
0709 12:19:19.912130 (+  6992us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:20.014713 (+102583us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:20.015712 (+   999us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":657403,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":739699,"apply.run_cpu_time_us":40903,"apply.run_wall_time_us":1029745,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":493429,"prepare.run_cpu_time_us":14165,"prepare.run_wall_time_us":530544,"raft.queue_time_us":361219,"raft.run_cpu_time_us":23227,"raft.run_wall_time_us":505686,"replication_time_us":687062,"spinlock_wait_cycles":25495296,"thread_start_us":1408930,"threads_started":5,"wal-append.queue_time_us":536748,"wal-append.run_cpu_time_us":88828,"wal-append.run_wall_time_us":2391742}]]}
I20260709 12:19:26.301280 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.303145 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.304492 20328 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:26.301854 25557 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:26.298475 25580 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.231705 25555 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.314335 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.308432 25597 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:26.315912 20325 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:26.318495 20073 catalog_manager.cc:5697] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 4 to 7, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 7 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.312263 25506 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.333323 20073 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 15 to 16, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 16 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:26.337859 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.335301 20073 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:26.345191 20073 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 7 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 8 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:26.351502 20329 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:26.354034 25183 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:26.424343 25183 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:26.424726 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.330533 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:26.361851 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:26.361383 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.424438 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:26.426417 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 115446us
I20260709 12:19:26.427325 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.364180 25555 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.370630 21034 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:26.375409 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:26.376842 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.382064 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.384166 25562 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:26.389418 20172 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:26.390324 20178 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:26.390884 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:26.438728 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:26.392740 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.394006 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.394493 25401 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:26.400130 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:26.413061 20180 pending_rounds.cc:85] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 9
I20260709 12:19:26.414987 20179 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
W20260709 12:19:26.422003 20254 consensus_meta.cc:287] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.940s	user 0.010s	sys 0.017s
I20260709 12:19:26.422938 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.424829 25183 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:26.425953 25579 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:26.425892 20173 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:26.368220 25557 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.392216 20175 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:26.448518 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.450726 20326 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:26.454181 20174 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:26.446236 20180 pending_rounds.cc:107] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:19:26.446563 20179 pending_rounds.cc:85] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:19:26.455505 20179 pending_rounds.cc:107] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:19:26.457711 20252 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:26.457767 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:26.458600 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.459198 20253 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:26.455355 20180 raft_consensus.cc:2889] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:26.468853 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.461063 20328 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:26.456221 20179 raft_consensus.cc:2889] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:26.446576 25562 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:26.475682 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:26.456079 20254 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:19:26.478937 20255 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.475817 25557 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.470572 25401 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.453895 25579 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.476845 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.476927 25183 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.479449 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.480764 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:26.482035 20322 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:26.483964 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.494302 20178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:26.494764 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.495157 20178 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.495687 20178 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:26.495884 20248 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:26.496780 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 1911) took 1038 ms. Trace:
I20260709 12:19:26.499332 20329 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.497510 20254 rpcz_store.cc:276] 0709 12:19:25.458678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.460991 (+  2313us) service_pool.cc:224] Handling call
0709 12:19:26.490331 (+1029340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:26.502699 21035 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:26.485693 25579 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.501430 21042 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:19:26.504987 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.506259 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:26.506620 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.512496 20252 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:26.515658 25555 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.516162 25555 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.516685 25555 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.518455 20328 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:19:26.519539 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.485209 25506 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.521586 25506 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.524999 25401 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.526078 21034 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:26.533239 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:26.534296 25538 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:26.534610 20220 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:26.534759 25538 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.535203 25538 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.535495 25199 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:26.535787 21037 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 7.
I20260709 12:19:26.536158 25562 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.537932 25562 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:26.539779 25183 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.547518 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.553678 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:26.558984 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:26.562167 20219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.796s (SENT) [suppressed 24 similar messages]
I20260709 12:19:26.563808 20325 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:26.564714 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.565204 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.565915 20326 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:26.565847 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.566874 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.567008 20330 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:19:26.570076 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.565882 20255 raft_consensus.cc:2410] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:26.575388 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.580052 25560 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.580965 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2452) took 1140 ms. Trace:
I20260709 12:19:26.581374 20248 rpcz_store.cc:276] 0709 12:19:25.441066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.441450 (+   384us) service_pool.cc:224] Handling call
0709 12:19:26.495362 (+1053912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.509604 (+ 14242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.580717 (+ 71113us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002de450. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:26.580883 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326384896}
I20260709 12:19:26.584842 20329 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:26.586259 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.596122 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.603813 20253 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:26.604089 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.604296 25560 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.605271 20256 raft_consensus.cc:2410] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:19:26.605207 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:26.606184 20179 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:26.587256 20178 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.603472 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:26.608076 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.608974 20251 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:19:26.609833 20252 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:26.610353 20178 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.614733 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:26.616392 25596 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:26.619886 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:26.632563 25506 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:26.640661 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:26.647716 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.648629 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.649585 20178 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:26.654152 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:26.654537 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 72121.6us
I20260709 12:19:26.657152 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.583664 25557 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:26.658816 21037 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:26.659108 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:26.659777 20179 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.662492 20173 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:26.665565 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.667332 21034 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:26.672652 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:26.677284 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.682194 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.682313 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.683691 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:26.687856 20252 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:26.691931 20322 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:26.692611 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 142158us
I20260709 12:19:26.664379 25557 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.696856 20176 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:26.698509 20255 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:26.700345 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:26.727720 20330 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:26.723387 20321 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:26.720203 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:26.731148 20326 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:19:26.742002 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.709848 25538 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:19:26.745528 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.755889 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.781629 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:26.785698 25057 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:26.786247 25057 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.786619 25057 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:26.800896 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:26.804690 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.764465 25564 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:19:26.814263 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 312507us
I20260709 12:19:26.767356 25579 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.817199 20255 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:19:26.815649 25596 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:26.830423 25506 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:19:26.842602 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 96073.9us
W20260709 12:19:26.844704 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78717.9us
I20260709 12:19:26.852283 25538 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:26.860409 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:26.860627 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53147.9us
W20260709 12:19:26.861028 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 104786us
I20260709 12:19:26.852715 25057 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.862478 25538 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:26.842149 25557 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.842298 25506 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:26.870343 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:26.883991 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.891535 25572 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:26.892377 25572 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.893411 25573 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:26.894716 25580 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:26.895432 25572 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.908665 25289 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:19:26.908946 25596 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:26.908751 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:26.909580 25596 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:26.910641 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:26.911876 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.913138 25401 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:26.913472 25294 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:26.913681 25401 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.914001 25294 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:26.914291 25401 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.915623 25294 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:26.917898 25294 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:26.933429 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.936705 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:26.940168 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 83971.9us
I20260709 12:19:26.900664 25538 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:26.942822 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.948197 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.947867 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:26.950959 21034 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.951988 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:26.952986 20252 raft_consensus.cc:2393] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:26.953951 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:26.963624 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.964228 21042 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:26.965783 21037 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:26.965251 20255 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:26.952661 25289 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:19:26.972985 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60159.7us
I20260709 12:19:26.950801 25579 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:26.974370 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81495.7us
I20260709 12:19:26.976871 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:26.996695 21041 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:26.984329 25289 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:26.999712 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:27.001178 25607 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:19:26.990157 25564 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:26.999706 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:27.008415 20247 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.023892 25597 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:27.023743 25618 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:19:27.024505 25597 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.025216 25618 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:27.025589 25618 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.025645 25597 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.026665 25618 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:27.028182 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 119651us
I20260709 12:19:27.033030 25580 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:27.034057 25564 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:27.034389 25564 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.007457 25419 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:27.035312 25564 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.037173 20179 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:27.038472 20294 leader_election.cc:400] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:19:27.039431 25620 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.040035 25620 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.041999 25564 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.042416 25620 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:27.044812 25289 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.046393 25289 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:27.046456 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.047205 20252 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:27.047513 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:27.047982 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.048766 20251 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:27.049451 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.049618 25620 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:27.051344 25610 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:19:27.033056 25618 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:27.052678 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.027334 25597 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:27.058331 21042 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:27.004197 25057 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:26.996241 25506 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:27.069581 25183 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 12:19:27.073745 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:27.074548 25538 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:27.074623 21042 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:27.075598 20325 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:19:27.079231 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.079909 20251 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:27.081790 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.084108 25199 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:27.085129 20327 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:27.074831 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:27.085039 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.084709 25199 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.089371 25419 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:27.090145 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:27.091776 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.093941 20323 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.094285 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:27.095160 20255 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.090435 25596 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.093501 25419 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.093850 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.097723 21034 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:27.101962 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:27.102845 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:27.105641 20179 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:27.093848 25557 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.106353 25057 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:27.106611 25613 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.132s	user 0.001s	sys 0.003s
I20260709 12:19:27.107229 25573 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:27.106962 25057 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.106619 20252 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:27.109579 25057 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.109886 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.100509 25183 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.111240 25183 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.113464 25183 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.105034 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:27.114506 20248 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.106925 25624 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:27.090477 25609 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.090310 25572 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.130059 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:27.099260 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.122529 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.126273 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:27.126906 25596 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:27.100174 25555 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.005s
I20260709 12:19:27.127872 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.133106 20328 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:27.134126 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.134950 20179 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:27.104140 25579 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:27.142406 20247 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:27.106801 25557 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.146472 25557 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.147261 25623 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:27.147332 20176 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:27.140467 25620 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:27.148944 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.149946 20178 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:27.150308 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.152195 25419 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:27.151445 25620 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.140712 25555 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.153846 20176 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:27.154196 25555 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.155367 20178 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:19:27.155915 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:27.156610 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.141726 25572 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.135771 25199 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.166914 20173 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:19:27.181083 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.181834 20173 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:27.181877 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:27.099220 25562 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:19:27.151399 20321 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:27.182710 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.167455 20174 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:27.169025 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.159545 20248 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:27.186087 20178 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:27.187451 25573 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.167385 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:27.169996 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:27.189805 20173 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:27.190166 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.190990 20328 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:27.170501 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:27.192543 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.169610 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:27.178627 25572 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.208115 25572 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:27.208703 25057 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:27.209326 25057 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:27.131824 25609 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.210338 25057 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.212006 25609 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:27.213824 20172 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:27.183362 25183 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:27.222872 20323 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
W20260709 12:19:27.224011 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 224412us
W20260709 12:19:27.229208 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.165647 25579 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:27.229930 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 155186us
I20260709 12:19:27.251304 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:27.256291 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:27.259112 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:27.263219 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.263144 20172 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:27.253232 25579 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:27.240343 25572 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.267460 25572 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.270411 25572 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.271684 25596 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:27.273485 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:27.248791 25609 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:27.275792 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 106325us
I20260709 12:19:27.236771 25618 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:27.277253 20255 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:27.284586 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:27.287247 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65090.5us
W20260709 12:19:27.294165 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.283416 25624 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:27.279222 25618 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.313205 25506 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:27.316051 25624 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.316551 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.316954 25506 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.317468 25573 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.300835 25623 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:27.344566 25623 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.345108 25623 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.346282 25624 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.338841 25618 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.336691 25579 raft_consensus.cc:2764] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:19:27.328691 25628 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:27.367269 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.317473 25506 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.374528 25506 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.378644 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:27.380990 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50564.1us
W20260709 12:19:27.381278 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 130097us
I20260709 12:19:27.383024 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.384573 25618 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.385134 25609 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:27.392066 25609 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:27.392637 25609 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.385531 25617 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
W20260709 12:19:27.396826 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49359.5us
I20260709 12:19:27.406953 25401 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.410226 20175 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:27.394310 25597 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:19:27.416780 25597 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:27.416874 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.417815 25557 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:27.418196 25557 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:27.421615 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 239783us
W20260709 12:19:27.423604 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 122148us
I20260709 12:19:27.418691 25579 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:27.426546 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.417182 25597 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.418606 25557 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:27.429219 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:27.434621 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.435287 20323 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:27.435334 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:27.435880 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.436342 25183 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:27.436444 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.436620 20255 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:27.436892 25183 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.437187 20324 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:27.437358 25183 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.437914 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.438257 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.438776 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:27.438927 20322 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:27.439400 20247 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:27.427497 25617 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.440243 25617 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.433527 25572 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:27.442309 25572 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:27.442426 25617 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:27.433220 25619 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:19:27.444654 25619 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:27.445046 25619 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.445140 25560 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:27.445755 25560 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:27.446031 25619 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.446753 25560 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.447293 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.453208 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.453946 20324 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:27.453809 25572 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.448163 20175 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:27.428146 25401 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:27.463479 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:27.464147 20247 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:27.464233 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.465337 25642 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:27.466037 25642 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.466670 25642 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:27.473672 25627 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:27.480641 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:27.481747 25628 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:27.482292 25628 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:27.483366 25628 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.448010 25619 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.506448 20247 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:27.518191 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:27.543305 25627 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:27.519111 25557 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.541162 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:27.562703 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44650.4us
W20260709 12:19:27.577502 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.577399 25199 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.578157 25199 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:27.578395 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.579406 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:27.570197 25401 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.543889 25627 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:27.590549 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 171476us
W20260709 12:19:27.592630 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 51622.2us
W20260709 12:19:27.597977 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 88964.6us
W20260709 12:19:27.598462 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.598589 25626 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:27.599115 25626 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:27.516022 25597 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.599519 25626 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.600816 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:27.592356 25627 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:27.610304 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.609026 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:27.616559 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:27.600410 25555 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.588806 25401 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.611864 25620 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:27.599556 25557 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:27.612854 25199 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.597079 25623 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.612223 25579 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:27.637569 25597 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:27.649472 25623 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.650128 25617 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:27.653098 25401 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.612108 25628 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:19:27.653738 25646 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:27.655023 25183 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.655920 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.656487 20294 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:27.623642 25555 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.658461 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:27.637356 25620 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:27.662988 25642 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.667802 25609 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.678049 25637 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:27.683195 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.683354 25628 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:27.683799 25646 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:27.741443 25620 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:27.732573 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.745851 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.738205 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:27.677666 25572 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:27.729910 25637 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.734421 25555 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.683606 25579 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.747537 25626 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.733203 25627 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.800364 25626 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.801234 25627 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.802044 25618 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.738140 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:27.803881 20172 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:27.737484 25642 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:27.772954 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 114600us
I20260709 12:19:27.771307 25624 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:27.779335 25646 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.780570 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.781222 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.779811 25623 raft_consensus.cc:2764] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:19:27.771729 25628 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:27.816459 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.810704 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:27.797302 25572 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:27.814507 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:27.802644 25618 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.817206 20173 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:27.796439 25637 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:27.821131 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 203475us
I20260709 12:19:27.832121 25623 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:27.822503 25572 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:27.837371 20323 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:27.837759 20323 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:27.838771 20323 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:27.872056 20247 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:19:27.874854 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 218516us
I20260709 12:19:27.872641 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:27.879110 20321 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:27.885383 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:27.886071 20322 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:27.886857 20323 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.888705 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:27.888942 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:27.890702 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.901031 25626 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:27.913007 20322 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:27.914113 25618 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:27.916886 25609 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:27.918790 25183 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:27.932401 20323 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:19:27.932560 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.933027 20323 pending_rounds.cc:85] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 6
I20260709 12:19:27.933442 20323 pending_rounds.cc:107] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:19:27.933737 20323 raft_consensus.cc:2889] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:27.939846 20175 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:27.944128 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:27.948597 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:27.938715 25658 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:19:27.943725 25660 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:27.957955 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 61635.7us
I20260709 12:19:27.966972 20323 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:27.948004 25183 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:27.975059 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.908061 25628 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:27.957443 25618 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:27.978788 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:27.988169 20321 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:27.979476 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:27.980789 20247 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:19:27.981652 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:27.994264 20247 pending_rounds.cc:85] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 9
I20260709 12:19:27.994634 20247 pending_rounds.cc:107] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:19:27.994936 20247 raft_consensus.cc:2889] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:27.963347 25617 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:19:27.981482 25183 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.004602 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:28.005910 25183 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:28.006735 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:28.013077 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:28.013432 20173 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:27.969578 25660 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:28.032418 20179 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:28.023128 20255 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:28.034480 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:28.034412 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:28.017861 20175 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:28.038443 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:28.074985 20178 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:28.010735 25199 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:28.007941 25627 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:28.080672 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46264.9us
W20260709 12:19:28.092096 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74346.5us
I20260709 12:19:28.074297 25538 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:28.074991 25573 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:28.074680 25580 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:19:28.100615 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.101614 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.101864 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:28.102341 20174 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:28.103327 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.103969 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.104475 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.104754 20176 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:28.105590 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.106048 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.106559 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.107224 20255 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:28.078104 25199 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:28.108507 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 95505.5us
I20260709 12:19:28.105705 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:28.110118 20172 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:28.110582 20176 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:28.092236 25401 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:28.111505 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:28.115599 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.116961 20248 raft_consensus.cc:2368] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15.
I20260709 12:19:28.117460 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.088865 25626 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:28.118073 20172 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:28.115947 25580 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:19:28.113327 25199 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:28.147653 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.150835 20175 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:28.154986 25660 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.156335 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.157491 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:28.158373 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.093066 25642 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:19:28.098026 25628 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:28.094497 25665 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:28.087451 25627 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.170650 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.148567 25573 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:28.195468 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:28.194208 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:28.194841 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.146193 25619 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:28.196338 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.121593 25626 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.200150 20178 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:28.149487 25057 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:28.202260 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.202951 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.204123 20174 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:28.119642 25401 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:28.180058 25668 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:19:28.172737 25646 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:28.219110 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:28.219457 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 68671.2us
I20260709 12:19:28.220239 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:28.212383 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 56866.6us
I20260709 12:19:28.175765 25560 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:28.222366 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.151906 25664 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:19:28.159912 25666 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:19:28.204541 25626 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:28.201615 25619 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:28.228644 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.214080 25401 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:28.228694 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:28.245133 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.246143 20252 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:28.222182 25646 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.235746 25609 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:28.230087 25572 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.216539 25057 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:28.239871 25619 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.243371 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:28.244148 20180 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:28.231868 20323 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:19:28.247958 25667 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:19:28.193780 25665 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.263397 20328 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:28.290355 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.264464 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.290946 20327 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:28.264739 25057 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.265743 25627 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:28.268610 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.291750 25665 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.269290 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.293301 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.293473 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:28.294555 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.294876 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.294915 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.269933 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.295958 25560 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:19:28.296094 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.296416 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.297233 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:28.297497 20328 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:19:28.296142 20255 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:28.298856 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.271286 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.301662 25538 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.302101 25538 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:28.303380 25572 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.259781 25664 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.272190 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.272755 25619 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.273172 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.259647 25646 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:28.277323 25609 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:28.278033 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:28.278827 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.279304 25666 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.288652 25674 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:19:28.313323 25580 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:19:28.323818 25666 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.299762 20322 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:28.307948 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:28.312017 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.325994 20255 raft_consensus.cc:2368] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13.
I20260709 12:19:28.313460 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:28.326433 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47720us
I20260709 12:19:28.327366 20294 leader_election.cc:400] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15.
I20260709 12:19:28.327741 20294 leader_election.cc:403] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:28.334565 20176 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:28.336280 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:28.337669 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:28.326447 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 112652us
I20260709 12:19:28.348258 25401 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.350826 25401 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.351786 20248 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:28.270385 25620 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.356459 25646 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.357285 25620 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.357465 20325 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:28.353660 20330 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:28.361402 20329 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:28.364316 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.375120 20255 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
W20260709 12:19:28.375298 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48151.2us
I20260709 12:19:28.379122 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:28.381098 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:28.381472 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:28.382123 21041 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:28.312662 25637 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.385599 25618 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:28.385746 25637 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.386049 25618 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:28.386761 21034 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:28.335500 25617 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:28.314884 25664 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.388557 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:28.418148 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 194709us
I20260709 12:19:28.421448 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:28.424829 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.378446 25579 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:28.421738 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 126944us
I20260709 12:19:28.433337 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.438781 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:28.439632 20255 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.379824 25573 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15.
I20260709 12:19:28.376509 25560 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:28.443094 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:28.445432 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69213.3us
I20260709 12:19:28.445580 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:28.461444 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:28.447690 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:28.362473 25609 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.420254 25646 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.421262 25617 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.374451 25628 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:19:28.420989 25580 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:28.419220 25401 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:19:28.387002 25618 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.488799 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.491313 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.705421 20323 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:28.477480 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.495455 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57246.6us
I20260709 12:19:28.490783 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.707628 20328 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:28.488355 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:28.515064 21037 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:28.436662 25665 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:28.608678 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.715653 20324 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:28.486975 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.708421 20322 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:28.605139 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.712142 20255 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:28.488718 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:28.717813 20325 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:28.735694 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:28.446053 25572 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.445194 25683 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.686887 25573 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.447327 25694 raft_consensus.cc:2764] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:19:28.746969 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:28.746801 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 285450us
I20260709 12:19:28.746901 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:28.714812 25617 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.483712 25666 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.682747 25555 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.743181 25691 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:28.734031 25057 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.749490 25618 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:28.745055 25665 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:28.784452 25665 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.785068 20253 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:28.789855 25683 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.793494 21042 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:28.786901 20075 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 16 to 19, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 19 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:28.797314 25183 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.797827 25183 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.798906 25597 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:28.799376 25597 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:28.799701 25694 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:28.754137 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:28.749789 25572 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.437352 25620 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.303s
I20260709 12:19:28.758298 20254 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:28.758672 20323 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:28.743970 25624 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.800145 25183 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.486223 25199 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.755097 25573 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.775250 25691 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.815764 25560 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.817010 25572 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:28.817343 25691 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:28.776536 21036 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:28.818786 20252 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:28.820050 25679 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:28.733762 25626 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.777077 25688 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:28.801589 25664 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.801208 20075 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:28.793699 20073 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 311) took 23120 ms (client timeout 15000 ms). Trace:
I20260709 12:19:28.685293 25538 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:28.823889 20075 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:28.776234 25057 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:28.823699 20073 rpcz_store.cc:269] 0709 12:19:05.673529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.673829 (+   300us) service_pool.cc:224] Handling call
0709 12:19:05.760993 (+ 87164us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54002d0190. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd40b2 00007f5de0d4d759 00007f5de0ce5a76 00007f5de0cb6d58 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc
0709 12:19:28.793581 (+23032588us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:26.861926 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:26.992533 (+130607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:26.997703 (+  5170us) write_op.cc:435] Acquired schema lock
0709 12:19:26.999204 (+  1501us) tablet.cc:662] Decoding operations
0709 12:19:27.025726 (+ 26522us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:27.025824 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:27.025864 (+    40us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:19:27.026689 (+   825us) tablet.cc:701] Row locks acquired
0709 12:19:27.026752 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:19:27.026993 (+   241us) write_op.cc:270] Start()
0709 12:19:27.027166 (+   173us) write_op.cc:276] Timestamp: P: 1783599567026906 usec, L: 0
0709 12:19:27.027185 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:19:27.164506 (+137321us) log.cc:844] Serialized 2855 byte log entry
0709 12:19:27.380185 (+215679us) op_driver.cc:464] REPLICATION: finished
0709 12:19:27.621607 (+241422us) write_op.cc:301] APPLY: starting
0709 12:19:27.641251 (+ 19644us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:27.734167 (+ 92916us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:27.734344 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:27.743124 (+  8780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:27.787874 (+ 44750us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:19:27.797662 (+  9788us) write_op.cc:312] APPLY: finished
0709 12:19:27.798083 (+   421us) log.cc:844] Serialized 73 byte log entry
0709 12:19:27.798302 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:27.798441 (+   139us) write_op.cc:454] Released schema lock
0709 12:19:27.798507 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:27.799164 (+   657us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:27.799196 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1449379,"reported_tablets":46,"spinlock_wait_cycles":25153920,"child_traces":[["op",{"apply.queue_time_us":227614,"apply.run_cpu_time_us":13818,"apply.run_wall_time_us":180815,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":480440,"prepare.run_cpu_time_us":28620,"prepare.run_wall_time_us":459901,"raft.queue_time_us":51395,"raft.run_cpu_time_us":81003,"raft.run_wall_time_us":234842,"replication_time_us":332550,"spinlock_wait_cycles":19328,"thread_start_us":628230,"threads_started":4,"wal-append.queue_time_us":140923,"wal-append.run_cpu_time_us":11568,"wal-append.run_wall_time_us":1500331}]]}
I20260709 12:19:28.808516 25624 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.829393 25057 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:28.830194 25624 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:28.800395 25597 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.831683 25597 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:28.805886 25683 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:28.809401 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62605.2us
I20260709 12:19:28.836138 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.800796 25628 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.836997 25683 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:28.837361 25628 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:28.827349 20075 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:28.814589 25573 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:28.838732 25691 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:28.839533 25691 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:28.838999 20075 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 8 to 9, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:28.840904 20075 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 12, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:28.840000 25691 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:28.762065 25682 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.844780 25538 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:28.847873 25199 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:28.837050 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.843117 20075 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 12 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:28.811002 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.854700 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.861446 21041 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:28.870107 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:28.883008 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.883612 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.884186 20075 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:28.914160 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62459.1us
I20260709 12:19:28.804160 25555 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:28.916175 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.916786 20075 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 11, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:28.915907 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:28.935386 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:28.934448 20075 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:28.952368 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 201057us
I20260709 12:19:28.954152 20294 leader_election.cc:400] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13.
I20260709 12:19:28.954567 20294 leader_election.cc:403] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:28.955374 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:28.954834 20075 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:28.955674 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:28.970446 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:28.972445 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.952272 25624 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:28.975293 20075 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:28.977561 20322 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:28.978500 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:28.979305 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:28.940961 25289 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:19:28.960983 25694 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.982764 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:28.971508 25199 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:29.021996 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:28.981990 25573 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:29.026372 20254 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:29.024703 21042 raft_consensus.cc:2368] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
W20260709 12:19:29.025251 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54890.5us
I20260709 12:19:29.027282 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.029546 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.031014 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:29.032176 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.040007 20323 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:29.041191 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.042531 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.043362 21041 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:29.044423 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.045214 20323 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:29.047464 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.048801 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:28.986159 25693 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:29.048933 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:29.029376 25619 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.714s	user 0.015s	sys 0.007s
I20260709 12:19:29.046506 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:29.053977 20249 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:29.054934 20251 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.054121 20321 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:29.050532 20173 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:29.022812 25690 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:29.051036 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.058866 20328 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:29.056254 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.051333 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.039830 25642 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:29.054617 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.029445 25199 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.061614 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.032627 25624 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:29.059994 20324 raft_consensus.cc:2376] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14. Re-sending same reply.
I20260709 12:19:29.067328 20325 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:29.061313 20327 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:29.051867 20144 connection.cc:256] RPC call timeout handler was delayed by -2.485952682000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 12:19:29.076265 20325 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:19:29.067148 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.075169 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.092984 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:29.094949 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.095742 20325 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
W20260709 12:19:29.100033 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 170822us
I20260709 12:19:29.052062 25693 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:29.109043 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.109920 20252 raft_consensus.cc:2368] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:19:29.112643 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.113372 20322 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:29.115509 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.116187 20324 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:29.050885 25687 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:29.067468 25618 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:29.115635 25693 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.075693 25199 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.120823 25692 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:29.122772 25538 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:29.122895 25695 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:29.083635 25628 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.129215 21036 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:29.130110 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.029145 25694 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.153215 25626 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.123284 21041 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:29.145567 25618 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:29.176220 25555 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.177096 25624 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:29.153342 25697 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:19:29.160601 25687 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:29.163796 25692 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:29.181572 25687 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.181959 25692 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.184114 25597 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.175452 25618 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.184849 25597 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.174070 25694 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.189724 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.190413 20327 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:29.192323 25597 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.163993 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.164279 25538 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:29.165442 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.165977 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:29.208186 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 87157.5us
I20260709 12:19:29.209318 20255 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12.
I20260709 12:19:29.168133 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.166105 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:29.170132 20254 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:29.179193 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:29.210608 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.117492 25619 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:29.211231 20330 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:29.188652 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:29.221395 20252 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.213966 20323 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:29.214993 20325 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:19:29.222805 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56813.8us
I20260709 12:19:29.223839 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.218590 25538 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.226492 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.149952 25642 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.233476 20324 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:19:29.242269 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 215058us
I20260709 12:19:29.243657 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.245733 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.244182 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.232779 25688 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:29.253697 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.253779 20330 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:29.256282 25199 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.244448 25538 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:29.270509 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.262302 25618 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.264398 20255 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:29.265726 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.265966 25693 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:29.266952 20144 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.580s (SENT)
I20260709 12:19:29.241479 25619 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:29.252513 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.290603 20247 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:29.268857 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.291718 21042 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12.
I20260709 12:19:29.241559 25642 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.277511 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:29.294858 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.267923 25688 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.276587 20330 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
W20260709 12:19:29.279834 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.541s (SENT)
I20260709 12:19:29.295680 20255 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:29.295779 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.300181 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.302071 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:29.270171 25702 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:29.302767 20177 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:29.302968 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.315029 20321 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:29.315659 20180 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:29.316658 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:29.285280 25555 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:29.320850 20323 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 6.
I20260709 12:19:29.308854 25688 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:29.331101 25705 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:29.334054 20254 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:29.334440 20254 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.335215 20254 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.336223 20254 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:29.341331 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61530.1us
I20260709 12:19:29.308765 25704 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:29.311952 25597 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:29.344671 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49462.8us
I20260709 12:19:29.320123 25538 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.352502 20254 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:19:29.352948 20254 pending_rounds.cc:85] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 12
I20260709 12:19:29.353260 20254 pending_rounds.cc:107] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:19:29.353855 20254 raft_consensus.cc:2889] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:29.325903 25666 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:29.312652 25626 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:19:29.342914 25702 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:29.347797 25709 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:19:29.315138 25289 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:19:29.348120 25573 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13.
I20260709 12:19:29.345317 25704 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.362757 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:29.364540 25702 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.366954 25706 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:29.409088 25706 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:29.409529 25706 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:29.411083 25642 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:29.370543 25057 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:19:29.371639 25678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.003s	sys 0.018s
I20260709 12:19:29.371574 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.372453 25656 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:29.322141 25683 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:29.375691 25711 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:19:29.380560 25199 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.357004 25679 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.390890 25619 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:29.392966 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 126081us
I20260709 12:19:29.399557 25618 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:29.401571 25691 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.003s
I20260709 12:19:29.406265 25704 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:29.421886 25683 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:29.408476 25702 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:29.425230 25678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.003s	sys 0.018s
W20260709 12:19:29.433728 25617 consensus_meta.cc:287] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.004s
I20260709 12:19:29.359697 25555 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:19:29.437872 25693 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:29.438714 25707 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:19:29.469170 25057 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.461202 25683 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.445338 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:29.512642 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 67536.9us
I20260709 12:19:29.513147 20322 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:29.513376 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:29.453125 20251 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:29.454082 20328 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:29.455932 20252 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:29.457386 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.468524 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.516135 21034 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:29.516312 20330 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:29.491016 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:29.497485 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134797us
W20260709 12:19:29.500584 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 178443us
W20260709 12:19:29.443979 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72527.2us
I20260709 12:19:29.454547 25679 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.518658 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.518806 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.520779 20330 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:29.520709 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.460242 25691 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.517949 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:29.522763 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.531487 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.532521 20330 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:29.519296 25666 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:29.537977 20176 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:29.519114 25682 raft_consensus.cc:2764] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:19:29.528992 25626 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:29.547293 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.510761 25617 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.530201 25538 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.551956 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:29.560055 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 229907us
I20260709 12:19:29.560297 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:29.561283 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:29.553876 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.568637 20171 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:29.553979 20324 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:19:29.542155 25666 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.547629 25656 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:29.568961 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.579282 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:29.579650 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1183247219998975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28500000000000003s for a response
W20260709 12:19:29.580125 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9371748720000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 12:19:29.580224 20174 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
W20260709 12:19:29.580663 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9105219759999272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 12:19:29.581148 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8196219760000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:19:29.581806 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6018219760001102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 12:19:29.582285 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5604219760000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 12:19:29.571708 20177 raft_consensus.cc:2368] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:29.572378 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.537318 25057 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:29.549158 25626 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.574712 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.577280 20326 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:29.570551 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.586166 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:29.596009 25626 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.568728 25555 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:29.599466 25617 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.604465 25711 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:29.605492 25711 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:29.553025 25683 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.606007 25693 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:29.606380 25707 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:19:29.605405 25706 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.577693 25666 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:29.576205 25700 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.629252 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:29.640568 20324 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
W20260709 12:19:29.631011 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 117720us
I20260709 12:19:29.661175 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:29.662045 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:29.663095 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 144508us
I20260709 12:19:29.663395 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:29.631345 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1471289480000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 12:19:29.576728 25624 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:29.572590 25712 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:29.583950 25687 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:29.664733 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1300289480000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:19:29.629287 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54672.8us
I20260709 12:19:29.629944 25711 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:29.636369 25694 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:29.671085 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0913289479999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 12:19:29.669886 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:29.657735 25199 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:29.680724 25729 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:29.657444 25609 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:29.689788 25729 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.690133 25609 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.692561 25609 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:29.693300 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.675650 25721 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:19:29.636114 25579 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.677073 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:29.640242 25555 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:19:29.681038 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0796289479999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 12:19:29.702446 20144 connection.cc:256] RPC call timeout handler was delayed by -1.07602894799993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:19:29.628072 25538 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:29.684401 25694 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.686574 25691 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.668385 25656 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:29.702929 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0445289480001065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 12:19:29.708806 25694 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.709558 25538 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.709932 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:29.673187 25720 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:19:29.710541 25538 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.719712 25694 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:29.730577 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:29.665067 25690 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:29.755439 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 85588.4us
I20260709 12:19:29.690857 25729 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.670779 25712 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.670632 25057 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:19:29.755841 25728 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:19:29.757333 25690 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.657963 25693 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.689780 25199 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:29.665969 25700 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.680972 25687 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:29.751976 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 79826.4us
I20260709 12:19:29.756728 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:29.760361 25691 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:29.768188 25704 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:29.775906 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 106158us
I20260709 12:19:29.763525 25679 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.764950 25683 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.769800 25712 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:29.835340 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:29.829726 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 148105us
I20260709 12:19:29.736660 25579 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:29.835455 20324 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.836697 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.865188 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:29.867406 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.868288 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:29.868916 20251 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:29.869071 20255 raft_consensus.cc:2368] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:29.868360 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.870651 20252 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:29.774235 25199 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.873469 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.874491 21037 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:29.876750 21041 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:29.877131 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:29.877780 20255 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 6.
I20260709 12:19:29.878182 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.879225 20249 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:29.879922 21042 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:19:29.879956 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53820.8us
I20260709 12:19:29.881944 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:29.882797 20255 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:29.837365 25555 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.885028 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2469) took 1216 ms. Trace:
I20260709 12:19:29.885288 25706 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.885533 25555 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.885417 20250 rpcz_store.cc:276] 0709 12:19:28.484952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.488003 (+  3051us) service_pool.cc:224] Handling call
0709 12:19:28.813795 (+325792us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:19:28.814013 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.814427 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.814454 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.815060 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.074659 (+259599us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:29.167461 (+ 92802us) log.cc:844] Serialized 14 byte log entry
0709 12:19:29.167750 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.167823 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.670200 (+502377us) raft_consensus.cc:1685] finished
0709 12:19:29.701525 (+ 31325us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.701698 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77090,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":9919,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":172,"spinlock_wait_cycles":26784128,"thread_start_us":259160,"threads_started":1,"wal-append.queue_time_us":431737}
I20260709 12:19:29.888477 20328 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:29.873796 25691 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:29.898805 21041 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:29.902256 20255 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:19:29.888652 25580 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:29.903932 25580 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:29.905007 25580 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:29.906113 25580 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.908421 25694 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:29.908636 25687 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.909227 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:29.876415 25199 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.912041 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.921999 20328 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:29.913200 20250 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:29.924836 20250 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:29.933542 20294 leader_election.cc:400] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:29.934011 20294 leader_election.cc:403] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:29.937131 25735 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:29.939957 25725 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:19:29.940399 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:29.940904 25579 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:29.941028 21042 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:29.942284 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:29.943244 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:29.948534 20322 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:29.950281 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:29.943753 20328 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:29.953359 25696 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.904s	user 0.000s	sys 0.005s
I20260709 12:19:29.958797 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:29.959476 21042 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:29.828697 25711 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:29.977087 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:29.928723 25732 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:29.920241 25057 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:29.986588 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.592s (SENT)
I20260709 12:19:29.984586 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:29.989986 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:29.990164 25734 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.153s
I20260709 12:19:29.990789 21038 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:29.991783 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:29.992244 25683 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:29.992353 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1046) took 1561 ms. Trace:
I20260709 12:19:29.992744 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:29.993398 21040 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.992839 20329 rpcz_store.cc:276] 0709 12:19:28.430832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.431195 (+   363us) service_pool.cc:224] Handling call
0709 12:19:28.431630 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.446279 (+ 14649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.446328 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.484008 (+ 37680us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.874359 (+390351us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:28.874423 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.874531 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.952567 (+1078036us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:29.992035 (+ 39468us) raft_consensus.cc:1685] finished
0709 12:19:29.992057 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.992269 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4920,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":18948,"spinlock_wait_cycles":15616896,"thread_start_us":389792,"threads_started":1,"wal-append.queue_time_us":500712}
I20260709 12:19:29.995165 25700 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:29.992376 20328 raft_consensus.cc:606] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:19:29.995702 25726 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:19:29.983551 25742 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:19:30.002528 25701 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 12:19:30.014070 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.608s (SENT)
I20260709 12:19:30.014744 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:30.016057 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 104220us
I20260709 12:19:29.961690 25573 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:30.020323 20219 leader_election.cc:400] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:30.022439 20219 leader_election.cc:403] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:29.976616 25619 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:29.988684 25732 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:30.043056 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.717s (SENT)
I20260709 12:19:30.025656 25683 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:30.044346 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:30.027586 25619 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.027269 25742 consensus_queue.cc:1243] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:19:30.046828 25704 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:30.048521 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:30.049340 25743 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:30.049708 25683 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.051429 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:30.052505 20295 leader_election.cc:400] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
I20260709 12:19:30.046947 25739 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:30.030076 25732 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:30.040614 25711 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.056174 21040 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:30.056170 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:30.058094 20180 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.042655 25693 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.061939 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:30.053390 25619 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:30.057174 25579 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:30.077234 25736 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.077459 25724 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:30.078161 25724 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.078626 25724 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:30.084059 25597 raft_consensus.cc:993] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:30.084633 25597 raft_consensus.cc:1081] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:30.096201 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:30.098364 21036 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:30.098611 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:30.066991 25687 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.099627 25693 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:30.061378 25617 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:19:30.100286 25693 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:30.100924 25617 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:30.101419 25617 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:30.101343 25693 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.104723 20250 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.137611 20250 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:30.102784 25617 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:30.107400 25688 consensus_meta.cc:287] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.757s	user 0.006s	sys 0.008s
I20260709 12:19:30.137331 25712 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.078187 25737 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:19:30.160228 20330 raft_consensus.cc:2368] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17.
I20260709 12:19:30.146052 25690 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:30.162747 25690 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:30.164511 20326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1053) took 1675 ms (client timeout 2177 ms). Trace:
W20260709 12:19:30.165127 20326 rpcz_store.cc:269] 0709 12:19:28.488965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.490963 (+  1998us) service_pool.cc:224] Handling call
0709 12:19:30.164174 (+1673211us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b540040ef54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:30.164405 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003798912}
I20260709 12:19:30.171589 20174 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
W20260709 12:19:30.173699 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.073392 25057 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.176851 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:30.175215 25682 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:30.185109 20255 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:30.187809 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 169616us
I20260709 12:19:30.189214 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:30.139533 25687 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:30.159123 25666 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:30.200585 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 154762us
W20260709 12:19:30.201704 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 328812us
I20260709 12:19:30.216195 25736 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:30.219295 25744 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:30.225279 25700 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:30.226114 25700 consensus_queue.cc:1243] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:30.226568 25744 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:30.226949 25744 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:30.228596 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:30.232929 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:30.192080 25560 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:30.253206 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:30.255752 21041 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:19:30.192106 25690 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:30.258440 20251 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:30.261579 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:30.262295 20329 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:30.265095 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:30.230417 25617 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:30.268090 20326 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:19:30.183913 25688 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:30.287402 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57243us
I20260709 12:19:30.190201 25682 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:30.300997 20321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3336) took 1235 ms (client timeout 1605 ms). Trace:
I20260709 12:19:30.301985 20329 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:30.267710 25687 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.282644 25751 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.093s
W20260709 12:19:30.293067 25750 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:19:30.293411 25742 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:30.296144 25746 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:19:30.296657 25744 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.297506 25618 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:30.284875 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:30.356781 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 72005.7us
I20260709 12:19:30.358708 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:30.332998 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43698.5us
W20260709 12:19:30.301679 20321 rpcz_store.cc:269] 0709 12:19:29.055917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.056022 (+   105us) service_pool.cc:224] Handling call
0709 12:19:30.291358 (+1235336us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540025e254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:30.291504 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511108352}
I20260709 12:19:30.335289 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:19:30.362087 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.008s (SENT)
I20260709 12:19:30.307467 25735 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:30.343914 25720 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:19:30.407685 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.409739 25733 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.412770 25573 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10.
W20260709 12:19:30.414467 25708 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.134s	user 0.003s	sys 0.000s
I20260709 12:19:30.421545 25712 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:30.425652 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.626s (SENT)
I20260709 12:19:30.426129 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:30.427332 25741 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:30.430413 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:30.431414 20328 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:30.431856 20328 raft_consensus.cc:614] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:30.433419 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:30.436041 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:30.437383 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:30.346702 25751 consensus_queue.cc:1243] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:19:30.455464 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 95328us
W20260709 12:19:30.462294 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 83772us
I20260709 12:19:30.467844 21034 pending_rounds.cc:85] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 12
I20260709 12:19:30.468233 21034 pending_rounds.cc:107] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:19:30.468521 21034 raft_consensus.cc:2889] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:30.474059 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.475718 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:30.476943 20180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:30.482013 20174 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:30.482144 20180 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.482745 20180 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.479151 20179 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:30.484808 20220 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.190s (SENT)
I20260709 12:19:30.485306 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:30.490114 25712 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.490726 20174 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:30.496570 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:30.497438 20328 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.490798 25712 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:30.499715 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.499373 25712 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:30.520990 20328 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:30.530133 20321 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:19:30.559264 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:30.560364 25573 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:30.561126 25573 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:30.562412 25573 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.573263 20179 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:30.401985 25683 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:30.404461 25729 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:30.459303 25744 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:30.592188 20180 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:30.579442 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 117450us
I20260709 12:19:30.591009 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:30.361706 25742 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:30.597150 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 112380us
W20260709 12:19:30.584882 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 306591us
I20260709 12:19:30.367452 25724 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:30.643520 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49440.6us
I20260709 12:19:30.676081 20179 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:30.678112 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:30.590992 25750 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:19:30.597520 25711 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.005s
I20260709 12:19:30.589112 25628 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:30.690096 25760 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.695776 20180 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:30.592886 25739 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:30.583621 25687 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:30.598948 25743 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.460805 25732 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.715588 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3348) took 1419 ms. Trace:
I20260709 12:19:30.715885 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:30.693802 25057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.019s	sys 0.035s
I20260709 12:19:30.712785 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:30.778522 20323 rpcz_store.cc:276] 0709 12:19:29.296170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.299938 (+  3768us) service_pool.cc:224] Handling call
0709 12:19:30.715392 (+1415454us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5400328554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:30.715504 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45871360}
W20260709 12:19:30.779232 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 66545.7us
I20260709 12:19:30.780148 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:30.705981 25721 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:19:30.704887 25199 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.003s
W20260709 12:19:30.753000 20250 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 12:19:30.697907 25642 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.718127 25560 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:30.640234 25778 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:19:30.706257 25666 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:30.698824 25729 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:30.762687 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.742314 25597 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:19:30.746394 25580 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.840s	user 0.015s	sys 0.001s
W20260709 12:19:30.781677 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 65882.7us
W20260709 12:19:30.785000 25057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.020s	sys 0.035s
I20260709 12:19:30.786069 20250 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:19:30.783634 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.173s (SENT)
I20260709 12:19:30.802605 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:30.788388 25573 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.786674 25693 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:30.785264 25690 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:30.806947 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.809674 21037 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:30.718526 25735 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:30.788865 25560 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:30.815320 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:30.807215 25683 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:30.836305 25770 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:19:30.836449 25683 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.807901 25742 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.816268 20323 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:30.841058 20323 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:30.817593 25768 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:19:30.791590 25199 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:30.844945 25199 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:30.768167 25760 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.845932 21038 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:30.847100 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:30.847690 21042 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:30.848459 25733 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:30.848961 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:30.849022 25733 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.850037 21036 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
W20260709 12:19:30.808988 25555 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:19:30.799193 25642 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.851954 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:30.852708 21040 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:30.853160 25642 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:30.823153 25619 consensus_meta.cc:287] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.004s
I20260709 12:19:30.822194 25729 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.853781 25619 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:30.854804 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:30.855388 21043 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:30.856062 25619 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:30.823978 25560 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.859112 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:30.833086 25732 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:30.783916 25743 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.835022 25724 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.847615 25760 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.865726 25560 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.868039 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3107) took 1882 ms. Trace:
I20260709 12:19:30.868444 20176 rpcz_store.cc:276] 0709 12:19:28.985792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.985965 (+   173us) service_pool.cc:224] Handling call
0709 12:19:28.986308 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.539552 (+553244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.867805 (+1328253us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54002c5454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:30.867977 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266896128}
I20260709 12:19:30.868827 25743 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.871853 21042 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:30.887797 20328 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:30.830862 20325 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:30.791203 25711 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:30.900738 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:30.905594 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:30.907259 20324 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:30.907703 20321 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:30.906198 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:30.779225 25687 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.910171 20329 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:30.911089 21043 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:30.889461 25761 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:30.915233 25761 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.917425 25761 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:30.919417 25719 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.456s	user 0.002s	sys 0.004s
W20260709 12:19:30.922305 25769 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:19:30.923035 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1059) took 1754 ms. Trace:
I20260709 12:19:30.923429 20327 rpcz_store.cc:276] 0709 12:19:29.168523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.221842 (+ 53319us) service_pool.cc:224] Handling call
0709 12:19:29.235519 (+ 13677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:29.235904 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:29.235932 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:29.243195 (+  7263us) log.cc:844] Serialized 26 byte log entry
0709 12:19:29.336555 (+ 93360us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:29.336950 (+   395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.337234 (+   284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.421388 (+ 84154us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4800160158. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:19:30.918742 (+1497354us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:30.922827 (+  4085us) raft_consensus.cc:1685] finished
0709 12:19:30.922848 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.922978 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":1587,"raft.run_wall_time_us":179845,"spinlock_wait_cycles":73786368,"thread_start_us":79663,"threads_started":1,"wal-append.queue_time_us":206689}
I20260709 12:19:30.937440 25724 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:30.880580 25666 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:30.900352 25624 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.964184 25597 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.966753 25597 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.967422 25687 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.968111 25687 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:30.958478 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.963058 25624 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:30.975152 25733 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:30.990867 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 209181us
I20260709 12:19:30.961506 25724 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:30.976013 25617 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.975893 25690 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:31.015323 21037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1326) took 1129 ms. Trace:
W20260709 12:19:30.995008 20220 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.198s (SENT)
I20260709 12:19:31.043984 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.044850 20174 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:31.032948 25560 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:30.970150 25711 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.029810 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.039703 20324 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:31.046451 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.050031 20176 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:31.035976 20322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.048s	sys 0.108s
I20260709 12:19:31.042162 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:31.050823 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55854.9us
I20260709 12:19:31.051080 20180 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:31.015858 21037 rpcz_store.cc:276] 0709 12:19:29.882428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.882541 (+   113us) service_pool.cc:224] Handling call
0709 12:19:29.901322 (+ 18781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.811797 (+910475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.011734 (+199937us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b5400462154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:31.011969 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088351488}
W20260709 12:19:31.022745 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 116632us
W20260709 12:19:31.052603 20322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.049s	sys 0.108s
I20260709 12:19:31.046074 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.046407 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.052368 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:31.053505 20248 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:31.053845 20171 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:31.055636 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 239551us
I20260709 12:19:31.045554 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.053292 20173 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:31.053393 20177 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:31.034483 25733 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:31.063870 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.064862 20178 raft_consensus.cc:2410] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:31.072382 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.073132 20175 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:31.041633 25597 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.075212 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:31.042626 25693 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:31.077368 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:31.079799 20252 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:31.081559 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:31.015520 25617 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.079942 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:31.044481 25780 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:19:31.064152 25733 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:31.082818 25656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.002s	sys 0.019s
I20260709 12:19:31.103986 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.107141 20175 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:31.077071 25794 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.108453 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.104012 25733 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.102727 25723 raft_consensus.cc:993] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:31.093065 25741 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:31.103179 25786 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:19:31.117678 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.118221 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.116533 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.118266 20177 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:31.106644 25656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.002s	sys 0.019s
I20260709 12:19:31.115079 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.121579 20252 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:31.106259 25785 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:31.100651 25793 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.139595 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:31.141295 25776 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:19:31.142058 25617 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:31.142541 25782 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:19:31.113788 25732 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:31.152158 20175 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:31.153743 20177 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:31.156061 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:31.157755 25617 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.157862 25780 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:31.158425 25780 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:31.158269 25617 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.162807 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.163681 20177 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:31.106633 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:31.076251 25791 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:19:31.132042 25723 raft_consensus.cc:1081] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:31.179390 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:31.129856 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44434.6us
I20260709 12:19:31.116189 25619 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:31.180935 20252 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:31.129300 25656 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:31.185278 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.186195 20177 raft_consensus.cc:2376] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14. Re-sending same reply.
I20260709 12:19:31.111878 25690 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.189815 25617 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:31.190164 25624 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.192358 25656 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:31.195667 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 89555us
I20260709 12:19:31.165630 25785 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:31.162791 25793 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.165354 25693 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.164315 25780 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.115872 25794 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.274379 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.213374 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:31.265020 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 68105.9us
I20260709 12:19:31.213904 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.214634 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.178921 25741 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:31.281893 21008 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.559s (SENT)
I20260709 12:19:31.279134 20174 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
W20260709 12:19:31.283008 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.604s (SENT)
W20260709 12:19:31.283260 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 128894us
I20260709 12:19:31.284423 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:31.283490 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86700.6us
I20260709 12:19:31.284899 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.285163 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:31.287348 20172 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:31.287485 20175 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:31.287997 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.288867 20180 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:31.290542 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:31.291200 20324 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:31.274398 25626 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:31.293367 20176 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:31.293392 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:31.197681 25761 raft_consensus.cc:2764] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:31.265969 25724 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.208300 25711 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:31.295730 20324 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:31.265532 25796 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.277536 25791 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.185771 25619 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:31.300144 25057 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:31.300150 25700 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:31.319317 25796 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.321386 25700 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.320552 25791 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.323400 25796 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:31.323904 25700 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.302757 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:31.305656 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.306317 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.325968 20322 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:31.326139 21034 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:31.294951 25739 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:19:31.328104 25744 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.664s	user 0.004s	sys 0.008s
I20260709 12:19:31.307963 25794 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.286964 25743 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 12:19:31.309123 25788 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:19:31.309417 21043 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:31.310282 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:31.284425 25760 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.312777 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:31.294687 25751 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:19:31.313090 25785 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.301945 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.325201 25791 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.327373 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.308254 25705 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:31.333417 25617 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.338086 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:31.343477 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:31.387467 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:31.387776 20255 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:31.388131 20256 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:31.376678 21035 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:31.329291 25624 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:31.392378 20322 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:31.398653 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.402756 20178 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:31.395752 25617 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:19:31.401813 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.715s (SENT)
I20260709 12:19:31.365054 25796 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.404247 21035 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 12:19:31.401861 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63900.9us
I20260709 12:19:31.387034 25724 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.416821 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.417464 20178 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:31.376415 25760 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.408576 25796 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.423961 25796 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:31.437330 25752 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:31.418993 25705 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.441638 25705 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.444653 25733 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.449774 25793 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.406522 25742 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:19:31.456149 25580 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:31.456591 25580 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:31.457472 25580 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.458442 25580 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:31.462366 20256 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:19:31.467484 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58330.1us
I20260709 12:19:31.415407 25724 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.469762 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.411126 25619 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:31.470393 20178 raft_consensus.cc:2376] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13. Re-sending same reply.
I20260709 12:19:31.471408 25705 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.400698 25741 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.478045 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:31.478708 20323 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:31.479813 20322 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:31.520160 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:31.517158 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.601s (SENT)
I20260709 12:19:31.521411 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:31.521143 20256 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:31.522199 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.522982 21034 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:31.524937 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.527657 25705 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.529145 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.529313 25702 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:31.530166 20252 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:31.529907 25702 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.556430 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.531246 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.562683 21035 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:19:31.562835 20220 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.647s (SENT)
I20260709 12:19:31.562732 21043 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:31.532204 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.569721 20178 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:31.569957 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.576107 20177 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:19:31.577543 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.496536 25617 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:31.531123 25199 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.551601 25724 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:31.566985 25752 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.552907 25760 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.577579 25619 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:31.594585 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.597422 20177 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:31.601735 25801 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.591184 25199 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.602344 25801 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.601773 25688 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.603298 25682 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.613338 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.614202 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.614949 20172 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:31.618335 20178 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:31.619205 25702 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.619614 25199 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.600469 25752 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.617455 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.623858 20172 raft_consensus.cc:2410] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:19:31.625708 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.605919 25801 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:31.630167 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2021) took 2160 ms (client timeout 1875 ms). Trace:
I20260709 12:19:31.633315 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.637020 20172 raft_consensus.cc:2376] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13. Re-sending same reply.
I20260709 12:19:31.638370 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.639232 20172 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:19:31.639472 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.642596 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:31.636636 20330 rpcz_store.cc:269] 0709 12:19:29.469518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.568701 (+ 99183us) service_pool.cc:224] Handling call
0709 12:19:31.629800 (+2061099us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54002da0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:31.630013 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338113792}
I20260709 12:19:31.646242 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.646844 20172 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:31.648857 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.649468 20176 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:31.651196 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.651597 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.652412 20172 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:31.653035 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.654341 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.654623 20176 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:31.654656 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.656190 20177 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:31.658380 25821 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.659003 25821 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.661274 25821 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:31.664887 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:31.665496 20176 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:31.665876 20176 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:31.655519 20172 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:31.673105 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.674192 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.674706 20172 raft_consensus.cc:2376] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11. Re-sending same reply.
I20260709 12:19:31.653664 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.677271 20176 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.683364 25752 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.685308 25798 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:31.686391 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.687599 25798 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:31.688293 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.689246 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:32.136811 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.432358 20252 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:31.949503 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.380575 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.808023 20255 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:19:31.790560 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.062494 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.769153 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.808369 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:32.278584 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.803s (SENT)
I20260709 12:19:31.793464 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.804314 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.778219 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:31.746773 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:31.693235 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:32.458930 20329 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:32.459195 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 180679us
I20260709 12:19:32.448633 20173 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:32.449085 20172 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12.
I20260709 12:19:32.384092 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:32.461016 21034 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:31.771895 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.461663 20255 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:32.386865 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:32.454924 21035 raft_consensus.cc:2376] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17. Re-sending same reply.
I20260709 12:19:31.956452 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:32.195171 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:31.698094 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:32.465066 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:31.974372 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.466311 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.742679 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:32.466674 20174 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:31.803551 20176 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.038924 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:32.468361 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:32.469002 20172 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:19:32.469543 20328 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:32.470139 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:32.470856 20255 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:31.707443 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:32.461850 20179 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:31.696333 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:32.472141 20322 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:32.472502 20321 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:32.462147 21037 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:32.462605 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:31.694576 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.778s (SENT) [suppressed 46 similar messages]
I20260709 12:19:31.689473 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:31.794706 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:32.459385 20247 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:32.465472 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:31.872617 25735 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.449291 20171 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:32.480837 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:31.733605 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.740953 25693 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.768839 21043 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:32.487270 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.487870 20177 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:32.488602 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.476068 20323 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:31.939065 25538 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:32.063256 25573 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:31.872303 25702 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.347213 25687 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.333173 25733 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:32.482375 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:32.392951 25597 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.062623 25742 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:31.770004 25724 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:32.422817 25821 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:32.484792 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.485364 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.395236 25798 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:31.802470 25580 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.491655 25538 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:32.399276 25679 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:19:32.489085 20177 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
W20260709 12:19:32.491490 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 696866us
I20260709 12:19:32.492436 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:31.804477 25628 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.681s
W20260709 12:19:32.505343 20330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.019s
I20260709 12:19:32.506139 20329 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:32.509905 20255 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
W20260709 12:19:32.523613 20330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.006s	sys 0.019s
I20260709 12:19:32.512323 20172 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:32.524293 25666 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:32.525005 25618 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.525558 20172 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:32.491036 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:32.526955 20178 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:32.527200 25642 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:32.489794 25735 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.527287 20178 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:32.528769 20178 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.499792 25683 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:32.520658 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:32.525475 25618 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.510811 25597 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.529788 20178 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.490048 25693 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.517738 25733 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:32.531857 25798 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:32.512636 20171 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:32.531141 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:32.521629 25619 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.911s	user 0.008s	sys 0.004s
I20260709 12:19:32.538017 25619 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:32.538358 20177 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:32.538549 25619 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.539546 25597 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:32.539557 25829 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.540494 25829 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:32.540875 25619 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.530964 20172 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:32.509326 25687 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:32.540766 21008 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.543403 25687 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:32.506167 25702 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.543982 25538 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.545634 25538 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:32.545986 25702 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.546739 20173 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:32.544687 20324 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:32.556797 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.504318 25573 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.531404 25683 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.573601 20180 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:32.512040 25724 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:32.576907 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 882298us
I20260709 12:19:32.572599 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:32.568743 20324 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:32.512960 25742 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.540933 25829 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.519140 25580 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.536895 25767 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:32.600322 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:32.514106 25821 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:32.601933 20175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 941) took 1382 ms (client timeout 1626 ms). Trace:
I20260709 12:19:32.583966 25683 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:32.605047 20175 rpcz_store.cc:269] 0709 12:19:31.213262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.213595 (+   333us) service_pool.cc:224] Handling call
0709 12:19:32.595059 (+1381464us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b54002378d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:32.595221 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19952512}
I20260709 12:19:32.610425 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.593112 25732 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:32.613464 20327 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:32.615521 25693 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:32.626350 20178 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:32.623144 25618 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:32.562729 25733 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:32.662881 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 207465us
W20260709 12:19:32.640324 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 103096us
I20260709 12:19:32.680117 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.630350 20180 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:32.634289 21008 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.683012 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:32.645951 20144 connection.cc:256] RPC call timeout handler was delayed by -1.48186561600005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:19:32.686184 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4296656159999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:19:32.686537 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4296656159999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 12:19:32.626351 25837 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:32.663249 25834 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:19:32.688496 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3126656160000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 12:19:32.704304 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2451656159998947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:19:32.704761 20144 connection.cc:256] RPC call timeout handler was delayed by -1.2370656159998816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:19:32.705121 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1722656160000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 12:19:32.705487 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1623656159999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 12:19:32.705833 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1569656159999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:19:32.706184 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1569656159999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:19:32.706534 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1038656159998936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 12:19:32.706878 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0012656159999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 12:19:32.707233 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0012656159999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:19:32.708014 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:32.689227 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55050.4us
I20260709 12:19:32.710006 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.712108 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:32.685184 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 207410us
I20260709 12:19:32.718578 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.716506 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:32.719545 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 119337us
I20260709 12:19:32.721195 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:32.721347 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:32.722518 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:32.729344 20144 leader_election.cc:400] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:19:32.729696 20144 leader_election.cc:403] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:32.731117 20144 leader_election.cc:400] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12.
I20260709 12:19:32.731523 20144 leader_election.cc:403] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:32.694051 25752 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:32.693126 25618 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.731537 25687 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.766645 25555 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:32.766769 25687 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:32.784865 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:32.804833 25555 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.805440 25555 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.805450 21039 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:32.807478 25687 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:19:32.809056 25687 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12.
I20260709 12:19:32.810395 25687 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:32.710047 25837 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:32.717622 25693 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:32.811431 25687 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.717883 25836 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:32.729602 25834 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:32.738556 25831 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:32.731210 25735 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.737730 25798 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:19:32.836293 25597 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:32.839745 25597 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.840090 25835 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:32.840166 25597 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.814122 25724 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.841126 25724 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:32.841513 25724 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.841872 25724 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:32.813364 25618 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.817786 25840 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.843140 25618 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.747192 25844 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:32.843595 25840 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.843849 25844 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.844235 25580 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.845886 25840 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:32.845932 25687 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.824043 25679 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:32.817338 25837 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:32.834650 25834 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:32.840665 25835 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:32.845965 25844 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:32.891041 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 211011us
I20260709 12:19:32.867918 25834 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:32.861457 25767 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:32.869582 25835 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.901252 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:32.869889 25801 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.910465 25801 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:32.912876 25801 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:32.919232 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:32.920356 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 189399us
I20260709 12:19:32.895483 25573 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:32.899150 25580 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:32.924207 25831 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:32.924460 25767 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.927349 25732 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:32.927865 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.961462 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:32.962241 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:32.933553 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3337) took 1240 ms. Trace:
I20260709 12:19:32.937150 25597 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:32.899931 25742 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:32.968101 20180 rpcz_store.cc:276] 0709 12:19:31.693256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.717170 (+ 23914us) service_pool.cc:224] Handling call
0709 12:19:32.933367 (+1216197us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400240ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:32.933480 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244342528}
I20260709 12:19:32.943478 25845 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:32.944681 25843 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:19:32.951683 25821 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:32.923321 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:32.955292 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:32.992383 20255 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.993157 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:32.904012 25803 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:32.969048 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:32.969462 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:32.943364 25849 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:32.971728 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:32.970778 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 252632us
I20260709 12:19:32.996753 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:32.997017 20250 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:32.972975 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 254486us
I20260709 12:19:32.973822 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.000869 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:33.003791 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 320814us
I20260709 12:19:32.982527 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:33.010870 20249 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:32.951720 25733 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:33.011982 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.011844 20324 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:19:33.012902 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 89675.2us
I20260709 12:19:33.016043 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.016978 20255 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:32.958971 25751 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:33.014954 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:33.004925 20219 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:33.032397 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:32.971282 25838 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:33.037670 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:32.987591 25845 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.958105 25580 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:33.059175 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.061342 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 142197us
I20260709 12:19:33.036396 25831 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:33.056460 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:33.046787 25784 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:33.073447 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.035847 25849 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:33.068162 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:33.055949 25538 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:33.084022 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.071741 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.056536 25845 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.995848 25683 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.093451 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.093981 21043 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:33.094292 21038 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:19:33.094738 21038 pending_rounds.cc:85] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 11
I20260709 12:19:33.095019 21038 pending_rounds.cc:107] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:19:33.095345 21038 raft_consensus.cc:2889] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:33.051728 25693 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:19:33.097723 21035 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:33.087118 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.056237 25850 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:33.033162 25803 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.045557 25751 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.091823 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:33.088231 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 365779us
I20260709 12:19:33.102535 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.077625 25784 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.086977 25844 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:19:33.133123 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54885.5us
I20260709 12:19:33.143224 21034 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:33.144742 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.145851 20247 raft_consensus.cc:2368] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:33.144447 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.146731 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.050491 25838 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.083086 25854 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:33.088587 25642 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:33.062129 25855 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:19:33.087981 25573 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:19:33.145814 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 100437us
I20260709 12:19:33.158028 25844 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.158195 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:33.207919 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49812.2us
I20260709 12:19:33.209311 20253 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.209699 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:33.207059 20144 leader_election.cc:400] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:19:33.213408 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.229421 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.156661 25628 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.141737 25858 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.146685 25831 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:33.239246 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81846.5us
I20260709 12:19:33.156785 25784 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:33.141431 25742 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:33.248539 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 117195us
I20260709 12:19:33.213092 25821 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:33.205180 25852 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:33.211994 25844 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:33.245314 20253 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:33.205291 25573 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.252030 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:33.231353 25801 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:33.255686 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.144851 25850 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.289772 25702 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:33.243690 25619 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:33.244853 25836 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:33.242985 25856 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:33.312235 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 56674.1us
I20260709 12:19:33.325865 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:33.254280 25851 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:19:33.295156 25597 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.242386 25555 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.336880 25683 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:33.337410 25555 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:33.338887 20251 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:19:33.245313 25847 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:19:33.312976 25702 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:33.339957 25702 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:33.301745 25852 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.340377 25751 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.314898 25693 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:33.341588 25693 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:33.342049 25852 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.253823 25752 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:19:33.342415 25693 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.343698 25693 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:33.344780 25803 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:33.318547 25864 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:19:33.252935 25742 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.345279 25619 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:33.346256 25619 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:33.346654 25619 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.346753 21042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1343) took 1352 ms. Trace:
I20260709 12:19:33.347003 25742 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.347038 25619 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.347211 21042 rpcz_store.cc:276] 0709 12:19:31.994381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.994554 (+   173us) service_pool.cc:224] Handling call
0709 12:19:32.936585 (+942031us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:19:32.936835 (+   250us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:32.937265 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.937299 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:32.937981 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 12:19:33.053390 (+115409us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:33.053446 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.053546 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.346422 (+292876us) raft_consensus.cc:1685] finished
0709 12:19:33.346447 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.346689 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3339,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":28604672,"thread_start_us":114938,"threads_started":1,"wal-append.queue_time_us":206833}
I20260709 12:19:33.349509 25869 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:33.349890 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.350828 21042 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:33.230378 25849 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.352378 21042 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:33.246882 25628 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:33.356268 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 142933us
I20260709 12:19:33.357746 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.242228 25861 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:19:33.299425 25573 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:33.326861 25836 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.328773 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.298753 25801 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.332600 21043 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:33.332872 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 186219us
I20260709 12:19:33.314726 25642 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:33.360702 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:33.363507 25869 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:33.244626 25858 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.366321 25701 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.321058 25865 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.352890 25831 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:33.329034 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 184683us
I20260709 12:19:33.408671 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:33.410315 25883 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:33.410698 25883 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.411115 25883 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:33.373118 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:33.411939 21037 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:33.413669 25879 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:33.416245 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.416474 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.417106 20254 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:33.410759 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:33.370688 25856 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:33.397771 20144 leader_election.cc:400] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12.
I20260709 12:19:33.424770 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.425419 20255 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:33.404263 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.426422 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.423847 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.427183 20180 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:33.427311 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:33.417322 20249 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:33.428809 25855 consensus_queue.cc:1243] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:33.429067 25878 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.429436 25855 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:33.429805 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.429915 25878 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:33.369938 25854 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:33.434232 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.435609 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.436209 20173 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:33.438232 20330 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:19:33.397904 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 69234us
I20260709 12:19:33.439489 20172 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:33.440511 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.439599 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.441362 20321 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:33.441817 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.441182 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.442680 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.401578 25801 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:33.438052 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.397739 25836 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:33.404346 25839 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:33.449246 20323 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:33.449785 25839 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.450192 25839 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.452678 20144 leader_election.cc:400] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17.
I20260709 12:19:33.453006 20144 leader_election.cc:403] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:19:33.453625 25869 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17.
I20260709 12:19:33.446283 21037 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:33.456501 21043 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:33.457551 25836 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.447119 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:33.459911 25836 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.447377 20176 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:33.460335 25879 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:33.448109 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.460897 25879 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.460913 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:33.461584 25879 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:33.465126 21043 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:19:33.466161 20180 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:33.470086 21037 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:33.472694 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.476392 20328 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:33.401151 25580 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.487144 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:33.489249 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 89210us
I20260709 12:19:33.418876 25874 raft_consensus.cc:2764] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:19:33.432781 25876 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:33.499603 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:33.490653 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.496167 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.498647 20180 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:33.372048 25834 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.404779 25701 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.422272 25865 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.476363 25877 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:19:33.479058 25597 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:33.584605 20180 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:33.539202 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:33.585386 20176 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:33.501372 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.585675 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:33.603869 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 102577us
I20260709 12:19:33.606141 20180 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.606802 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.607378 20180 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:33.609333 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:33.568982 25618 consensus_meta.cc:287] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
W20260709 12:19:33.517629 25829 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.914s	user 0.006s	sys 0.006s
I20260709 12:19:33.516870 25869 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:33.517138 25837 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.006s
W20260709 12:19:33.520110 25859 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:19:33.484314 25836 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:33.560876 25835 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.001s
W20260709 12:19:33.517148 25868 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 12:19:33.609601 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 141668us
I20260709 12:19:33.610706 25888 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:33.623071 20321 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:33.500054 25876 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.508985 25767 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:33.622100 25829 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.549835 25858 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.611548 20177 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:33.664835 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.560722 25628 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:33.611269 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:33.618606 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 142169us
I20260709 12:19:33.666399 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.666950 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.590627 25597 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:33.631505 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 157253us
I20260709 12:19:33.673673 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.497895 25861 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.127s
I20260709 12:19:33.631348 20180 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:19:33.682430 20179 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:33.682651 20180 pending_rounds.cc:85] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:19:33.619580 25875 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:33.682986 20180 pending_rounds.cc:107] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.7
W20260709 12:19:33.554481 25724 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.003s
I20260709 12:19:33.552281 25702 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.667539 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:33.674729 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.684787 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:33.676875 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.685348 20177 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.685483 25702 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.685906 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.676460 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35936
I20260709 12:19:33.679780 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.687322 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:33.667589 25892 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.688315 25892 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.639356 25837 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.559038 25619 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:33.658871 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 63024.8us
I20260709 12:19:33.497134 25839 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.619695 25873 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:33.604166 25879 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.668125 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.711423 20176 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:33.639245 25555 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:19:33.689333 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.568933 25784 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.682430 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.679390 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.716924 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.685125 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.672911 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.674264 21037 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:33.677500 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.691250 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.691680 20328 raft_consensus.cc:2368] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11.
I20260709 12:19:33.719237 20323 raft_consensus.cc:2368] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12.
W20260709 12:19:33.654297 20326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.002s	sys 0.023s
I20260709 12:19:33.683386 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.720645 20179 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:33.625197 25618 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.691087 25850 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:33.676789 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.550920 25856 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:33.703341 20144 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.520s (SENT)
I20260709 12:19:33.706552 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:33.662591 25876 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.518340 25642 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.635555 25751 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:19:33.683288 20180 raft_consensus.cc:2889] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:33.639062 25683 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:19:33.620851 25880 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:19:33.668327 25597 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.744119 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.744590 20327 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:33.744769 20251 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:19:33.745147 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.720479 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.745837 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.746351 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:33.746626 21040 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:33.746800 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:33.697085 20177 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:33.747586 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:33.748915 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45629.5us
I20260709 12:19:33.749136 25829 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:33.749694 20144 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.561s (SENT)
W20260709 12:19:33.751081 20144 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.607s (SENT)
I20260709 12:19:33.752332 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:33.752878 20326 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:33.753183 20326 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:33.754654 25687 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:33.755049 25687 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:33.756265 25701 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.757282 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:33.757853 25538 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.002s
I20260709 12:19:33.758001 20328 raft_consensus.cc:2368] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9.
I20260709 12:19:33.758363 25538 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.758620 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:33.758865 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.761148 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3331) took 2069 ms. Trace:
I20260709 12:19:33.761415 25784 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.761564 20174 rpcz_store.cc:276] 0709 12:19:31.691298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.516230 (+824932us) service_pool.cc:224] Handling call
0709 12:19:32.595223 (+ 78993us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:32.595676 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:32.595705 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:32.596423 (+   718us) log.cc:844] Serialized 52 byte log entry
0709 12:19:32.687619 (+ 91196us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:32.687681 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.687778 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:33.089165 (+401387us) raft_consensus.cc:1685] finished
0709 12:19:33.089199 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.760895 (+671696us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b54002378d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:33.761083 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1392,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":117,"spinlock_wait_cycles":180850944,"thread_start_us":86840,"threads_started":1,"wal-append.queue_time_us":216241}
I20260709 12:19:33.761144 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.659130 25897 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:33.749184 21040 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:33.766585 21040 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:33.637869 25869 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.739491 25874 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.778620 25869 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:33.548259 25854 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.655031 25836 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.726044 20172 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:33.746954 20180 raft_consensus.cc:2376] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13. Re-sending same reply.
I20260709 12:19:33.733455 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.780120 20177 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:33.656469 25835 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.683790 25724 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.742486 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:33.716051 25834 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:33.743371 20248 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:33.675793 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.721840 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:33.769874 25892 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.745874 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:33.771823 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.744263 25883 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.774076 25837 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.774596 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:33.701351 21039 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:33.780562 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:33.781703 20328 raft_consensus.cc:2368] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
W20260709 12:19:33.855962 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 104915us
I20260709 12:19:33.883735 20174 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:33.767127 25844 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.864426 20180 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:33.756225 25865 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.867868 25801 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:33.777927 25874 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.869828 20172 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:33.854764 25884 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:33.889321 20173 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:19:33.906275 21008 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.247s (SENT)
I20260709 12:19:33.912398 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.891005 20254 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:33.903048 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:33.906039 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 131483us
I20260709 12:19:33.910868 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.911468 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:33.895416 25885 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.334s	user 0.004s	sys 0.000s
I20260709 12:19:33.917137 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:33.917867 20251 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:33.863265 25573 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:33.925148 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.919996 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.920084 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.927672 20175 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:33.927806 21036 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:33.927282 20329 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:33.928429 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.929356 20328 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:19:33.935547 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:33.936095 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.937016 20330 raft_consensus.cc:2368] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:19:33.937713 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:33.939549 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:33.939899 20328 raft_consensus.cc:2368] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17.
I20260709 12:19:33.914963 25884 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:33.940528 20321 raft_consensus.cc:2368] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16.
I20260709 12:19:33.917827 25850 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:33.923914 25888 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:33.988713 20323 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17.
I20260709 12:19:33.999734 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:34.002532 25906 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:19:33.927228 25865 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 12:19:33.925523 25751 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:33.927634 25892 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:19:33.928223 25849 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:19:34.017369 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 133308us
I20260709 12:19:33.930876 25837 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:34.077054 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:34.087872 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:34.090343 20328 raft_consensus.cc:2368] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
W20260709 12:19:34.081030 20144 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.633s (SENT)
I20260709 12:19:34.076352 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:34.094609 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:34.094775 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:34.095119 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:33.946802 25884 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:34.002766 25891 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:19:34.065994 25845 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.962s	user 0.008s	sys 0.004s
I20260709 12:19:34.104894 25845 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.107630 20325 raft_consensus.cc:606] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 12:19:34.107978 20325 raft_consensus.cc:614] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:34.108589 25784 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:34.109135 25784 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.109889 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:34.110633 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:34.111268 25784 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.096397 25702 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:34.092537 25751 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.098886 25872 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:34.013823 25874 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:34.099943 25801 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:34.100013 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:34.100696 25844 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.009688 25836 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:34.100879 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:34.084107 25849 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:34.011633 25835 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:34.102888 25873 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.103294 25888 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.150250 25751 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.079885 25883 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:33.947083 25850 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.151063 25850 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.112499 25900 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:34.112731 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.066895 25597 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.113986 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.119810 25845 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.121201 20329 raft_consensus.cc:2368] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
W20260709 12:19:34.124570 20144 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.782s (SENT)
I20260709 12:19:34.073028 25876 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:34.127210 20325 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:34.157114 20247 raft_consensus.cc:2393] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:34.157907 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:34.135872 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.140281 20252 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:34.038319 25839 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.083398 25573 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:34.144822 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44893.7us
I20260709 12:19:34.147775 20321 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:34.148579 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.146176 25580 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:34.154528 20254 raft_consensus.cc:2410] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:19:34.113786 25834 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:34.141372 25702 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:34.159178 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.153451 20330 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:34.160667 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.173291 25702 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:34.173827 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:34.160953 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:34.161911 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.176210 25845 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:34.176759 25845 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:34.177248 25845 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:34.162084 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:34.151233 25873 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:34.178131 20321 raft_consensus.cc:2393] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:34.179189 20321 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:34.147534 25849 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:34.182050 25619 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.165705 25876 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:34.172680 25834 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:34.265880 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.266009 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:34.447666 20171 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:34.297099 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.266518 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:34.439230 20321 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:34.349956 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.292302 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.193936 20248 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:34.438709 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.291558 20327 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:34.451043 20253 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:34.376492 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.452135 20179 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:34.438236 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 313646us
W20260709 12:19:34.453130 20144 leader_election.cc:336] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.805s (SENT)
I20260709 12:19:34.450232 20172 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:34.463403 20172 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:19:34.439522 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 262772us
I20260709 12:19:34.464442 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.449007 20173 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:34.232659 25836 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.292693 25057 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 12:19:34.261940 25618 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.468182 25597 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.467411 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.447450 25837 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:34.472162 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.258888 25838 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.474246 20171 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:34.478070 20327 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:34.485272 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.490368 20323 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:34.540313 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.449710 25834 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:34.491532 21041 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:34.494266 25687 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.498135 25702 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.554167 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.554760 20327 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:34.554872 20248 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:34.501021 20326 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.508245 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:34.555963 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47840.5us
I20260709 12:19:34.487195 25879 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:34.510599 25845 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:34.258071 25867 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:19:34.512857 25849 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:34.520951 20322 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:34.499234 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.522156 25850 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:34.519444 20219 connection.cc:256] RPC call timeout handler was delayed by -1.1897745440001017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 12:19:34.532737 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79628.4us
I20260709 12:19:34.533877 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.534312 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.534611 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.535145 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.571893 20253 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:34.571894 20252 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:34.536552 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.526680 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:34.491393 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 785) took 1424 ms. Trace:
I20260709 12:19:34.574246 20172 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.546227 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.571122 20249 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:34.577534 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.573472 21039 rpcz_store.cc:276] 0709 12:19:33.067277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.067724 (+   447us) service_pool.cc:224] Handling call
0709 12:19:34.491136 (+1423412us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54006617d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:34.491292 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420011776}
I20260709 12:19:34.578172 20178 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:34.579380 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52780.2us
I20260709 12:19:34.547521 20254 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:34.580207 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:34.522727 25873 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:34.558894 20327 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:34.559075 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.559679 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:34.582324 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:34.582952 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:34.557278 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:34.561990 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.583902 20248 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.562179 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.585139 20247 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:34.167681 25884 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.563027 20175 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:34.557106 20326 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:34.584535 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:34.588311 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:34.587248 25687 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:34.597421 25849 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:34.598315 20325 raft_consensus.cc:1217] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 12:19:34.599072 25702 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.537081 25836 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.601415 25836 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:34.599002 20325 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 14. Ops: [12.7-12.7]
I20260709 12:19:34.602133 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 976) took 1057 ms. Trace:
I20260709 12:19:34.602737 20330 raft_consensus.cc:606] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:34.561107 25619 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:34.602548 20177 rpcz_store.cc:276] 0709 12:19:33.544933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.760901 (+215968us) service_pool.cc:224] Handling call
0709 12:19:34.601946 (+841045us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5400002154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:34.602068 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37126400}
I20260709 12:19:34.603457 20330 raft_consensus.cc:614] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:34.612524 25883 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:34.616288 25784 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:34.616979 25883 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:34.605311 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:34.609570 20172 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:34.637629 20328 raft_consensus.cc:2368] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:34.640723 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:34.650451 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 62214.3us
I20260709 12:19:34.563247 20179 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:34.653278 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.653400 20248 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:34.612051 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:34.545564 25837 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.612847 20180 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:34.654083 20172 raft_consensus.cc:2376] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12. Re-sending same reply.
W20260709 12:19:34.654076 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48843.2us
I20260709 12:19:34.617960 25844 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:34.585785 25863 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:34.655845 20247 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:19:34.652468 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48473.3us
I20260709 12:19:34.613879 25865 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:34.610643 20252 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:34.618965 25619 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.619009 25538 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:34.602679 25879 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:34.650442 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:34.667428 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:34.667662 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:34.694767 25573 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:34.653528 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:34.695475 25597 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:34.691830 25538 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:34.696564 25879 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.696707 25538 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:34.697069 25879 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:34.698133 20075 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 207) took 15034 ms (client timeout 15000 ms). Trace:
I20260709 12:19:34.602422 25872 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:34.673923 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:34.692327 21039 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:19:34.668020 20178 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:34.701452 20180 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:34.674571 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:34.702850 20172 raft_consensus.cc:2376] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8. Re-sending same reply.
I20260709 12:19:34.675925 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.703572 20177 raft_consensus.cc:2410] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:34.677908 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:34.658622 20255 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:34.684540 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1309) took 1013 ms. Trace:
I20260709 12:19:34.619141 25666 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:34.675333 25580 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:19:34.650342 25683 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:19:34.704852 21036 rpcz_store.cc:276] 0709 12:19:33.671151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.759669 (+ 88518us) service_pool.cc:224] Handling call
0709 12:19:33.760013 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:33.928419 (+168406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.684279 (+755860us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400665654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:34.684475 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385228672}
I20260709 12:19:34.719461 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:34.720351 21037 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.724507 20326 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:34.705052 20177 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:19:34.691655 25619 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:34.703977 20250 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:34.669855 25835 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:34.665544 25839 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:34.674485 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.732571 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:34.725939 20177 pending_rounds.cc:85] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 4
I20260709 12:19:34.736119 20177 pending_rounds.cc:107] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:19:34.736689 20177 raft_consensus.cc:2889] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:34.727459 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:34.730489 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:34.731027 20180 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:34.619297 25702 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:19:34.743861 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:34.745159 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:34.745321 25850 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:34.746361 25886 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.177s	user 0.000s	sys 0.014s
I20260709 12:19:34.747284 25580 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:34.747651 25837 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:34.741861 20180 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:34.749877 20180 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:34.750898 20180 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:34.753914 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:34.742666 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:34.782395 25845 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.617925 25883 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:34.651248 25834 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:34.785727 21073 heartbeater.cc:646] Failed to heartbeat to 127.18.132.126:44843 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.18.132.126:44843 timed out after 15.000s (SENT)
I20260709 12:19:34.733906 25733 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:34.815649 25733 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.816118 25733 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:34.787410 20325 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:34.818636 25835 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:34.788286 20327 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 12:19:34.733397 25701 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:19:34.798940 20179 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:34.748935 25849 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:34.820676 25884 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:34.821216 25849 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:34.822003 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2053) took 1138 ms. Trace:
I20260709 12:19:34.798187 25839 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:34.822486 20329 rpcz_store.cc:276] 0709 12:19:33.683430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.939228 (+255798us) service_pool.cc:224] Handling call
0709 12:19:34.821795 (+882567us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003acfd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:34.821938 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415756032}
I20260709 12:19:34.823285 25839 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:34.822328 25849 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:34.830564 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1348) took 1752 ms. Trace:
I20260709 12:19:34.811640 25619 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:34.822254 20179 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:19:34.849071 21037 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:34.830994 21041 rpcz_store.cc:276] 0709 12:19:33.077800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.079697 (+  1897us) service_pool.cc:224] Handling call
0709 12:19:34.491299 (+1411602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.554310 (+ 63011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.830347 (+276037us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54006617d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:34.830493 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219268864}
I20260709 12:19:34.866384 20252 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:19:34.867118 20173 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:34.867238 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:34.868029 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 282265us
I20260709 12:19:34.868156 20177 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:34.870100 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:34.872833 20173 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:34.873405 20173 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:34.698668 20075 rpcz_store.cc:269] 0709 12:19:19.663888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.664137 (+   249us) service_pool.cc:224] Handling call
0709 12:19:34.698000 (+15033863us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:29.341045 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:29.393939 (+ 52894us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:29.393987 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:19:29.394017 (+    30us) tablet.cc:662] Decoding operations
0709 12:19:29.395378 (+  1361us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:29.395458 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:29.395494 (+    36us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:19:29.396773 (+  1279us) tablet.cc:701] Row locks acquired
0709 12:19:29.396792 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:19:29.396987 (+   195us) write_op.cc:270] Start()
0709 12:19:29.397139 (+   152us) write_op.cc:276] Timestamp: P: 1783599569396920 usec, L: 0
0709 12:19:29.397161 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:19:29.398028 (+   867us) log.cc:844] Serialized 4809 byte log entry
0709 12:19:30.075936 (+677908us) op_driver.cc:464] REPLICATION: finished
0709 12:19:30.692975 (+617039us) write_op.cc:301] APPLY: starting
0709 12:19:30.697209 (+  4234us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:31.668360 (+971151us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18002687e0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddac370ec 00007f5ddac39af7 00007f5ddac3afb0 00007f5dde94f1bb 00007f5dde94f532 00007f5dde996b93 00007f5dde843de3 00007f5dde8436ab 00007f5dde844e77
0709 12:19:31.668923 (+   563us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:31.668952 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:32.356155 (+687203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:32.356610 (+   455us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:19:32.356679 (+    69us) write_op.cc:312] APPLY: finished
0709 12:19:32.359459 (+  2780us) log.cc:844] Serialized 113 byte log entry
0709 12:19:32.406592 (+ 47133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:32.406820 (+   228us) write_op.cc:454] Released schema lock
0709 12:19:32.406916 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:32.484497 (+ 77581us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:32.486718 (+  2221us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":237,"mutex_wait_us":535794,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":484921,"apply.run_cpu_time_us":31255,"apply.run_wall_time_us":1863757,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54359,"num_ops":12,"prepare.queue_time_us":101412,"prepare.run_cpu_time_us":18661,"prepare.run_wall_time_us":203973,"raft.queue_time_us":163492,"raft.run_cpu_time_us":92757,"raft.run_wall_time_us":287970,"replication_time_us":663012,"spinlock_wait_cycles":27158784,"thread_start_us":507341,"threads_started":5,"wal-append.queue_time_us":288279,"wal-append.run_cpu_time_us":27689,"wal-append.run_wall_time_us":2381481}]]}
I20260709 12:19:34.875841 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1098) took 1515 ms. Trace:
W20260709 12:19:34.880124 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.880581 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.876457 20324 rpcz_store.cc:276] 0709 12:19:33.360598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.360763 (+   165us) service_pool.cc:224] Handling call
0709 12:19:33.361131 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:33.361593 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:33.361997 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 12:19:33.395931 (+ 33934us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:33.406300 (+ 10369us) log.cc:844] Serialized 26 byte log entry
0709 12:19:33.406535 (+   235us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:33.406583 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.406677 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:34.745745 (+1339068us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:34.865693 (+119948us) raft_consensus.cc:1685] finished
0709 12:19:34.875646 (+  9953us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:34.875780 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1253,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":29206,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":21817,"spinlock_wait_cycles":11675904,"thread_start_us":10167,"threads_started":1,"wal-append.queue_time_us":206958}
I20260709 12:19:34.874284 20173 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:34.883770 20173 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:34.894090 20173 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:34.895117 20173 pending_rounds.cc:85] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 5
I20260709 12:19:34.895761 20173 pending_rounds.cc:107] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:34.896440 20173 raft_consensus.cc:2889] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:34.991746 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 377514us
I20260709 12:19:35.024423 21043 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:34.884646 25884 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:34.979899 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:35.024123 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2062) took 1119 ms. Trace:
I20260709 12:19:35.024732 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:35.050645 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 494996us
W20260709 12:19:35.003957 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.075079 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.080411 20321 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:35.081713 20323 rpcz_store.cc:276] 0709 12:19:33.905099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.489805 (+584706us) service_pool.cc:224] Handling call
0709 12:19:34.490141 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:34.545348 (+ 55207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.983784 (+438436us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b54002862a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae6fdc0 00007f5ddaefba02 00007f5ddaef7dd6 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:19:35.024044 (+ 40260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4363648}
I20260709 12:19:35.085429 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:35.082742 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 102965us
I20260709 12:19:35.086364 20324 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
W20260709 12:19:35.081583 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 426116us
I20260709 12:19:35.088827 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:35.089630 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 418894us
W20260709 12:19:35.093351 20144 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.848s (SENT)
I20260709 12:19:35.093981 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.094399 21039 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:35.094946 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.096789 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:35.083685 25884 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.109719 21041 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:35.103130 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:35.115504 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:35.115839 20144 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.865s (SENT)
I20260709 12:19:35.116302 21041 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:35.107846 25884 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:35.118953 20144 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.873s (SENT)
I20260709 12:19:35.120484 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:35.119069 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 388669us
I20260709 12:19:35.120828 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.108304 25839 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:35.111528 25687 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:35.125144 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:35.107252 25844 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:19:35.118170 25642 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:35.113731 25919 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:35.110332 25879 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.126470 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.142680 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:35.124562 25878 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.150830 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.128418 25619 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:35.132660 25835 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:35.154867 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.153594 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:35.157509 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:35.160935 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.161345 20171 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:35.161615 20144 leader_election.cc:336] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.945s (SENT)
I20260709 12:19:35.162263 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.166911 20180 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.126209 25845 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:19:35.172983 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:35.173985 25656 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:35.174319 25879 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:35.147126 25642 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.174623 25618 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:35.195814 25656 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:35.207653 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:35.208288 25656 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.209187 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:35.177897 25834 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:35.178761 25917 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:19:35.185181 25538 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.213047 20180 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:35.213937 25538 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:35.187031 25733 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.215517 21034 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:35.216787 25733 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:35.165200 25876 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.150228 25839 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.197302 20252 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:35.200979 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:35.201565 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:35.203125 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:35.176890 25619 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:35.223855 25619 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.224555 20171 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:35.226022 25619 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:35.231020 25914 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.536s	user 0.008s	sys 0.003s
I20260709 12:19:35.209555 25656 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:35.218420 25839 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.166185 25687 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:35.236670 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:35.237367 20251 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:35.240520 20253 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
W20260709 12:19:35.266906 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 177226us
I20260709 12:19:35.170293 25873 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:19:35.233938 25538 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:35.281944 25900 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.284427 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.285357 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.275846 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.289307 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.290066 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:35.287793 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 126219us
I20260709 12:19:35.289933 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.286051 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.291159 20329 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:35.236711 25618 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.292532 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.294771 20328 raft_consensus.cc:2376] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15. Re-sending same reply.
I20260709 12:19:35.295740 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:35.296025 20144 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.974s (SENT)
I20260709 12:19:35.297307 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.297398 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.298148 20323 raft_consensus.cc:2368] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:19:35.298259 20329 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:35.300753 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.302170 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.302640 20322 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:35.303066 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.303797 20330 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:35.275628 25879 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.305584 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.312094 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.312310 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.317588 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.318895 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:35.319084 25849 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:35.319288 20251 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:35.319514 20330 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.319900 20330 raft_consensus.cc:614] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:35.318907 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.318913 25618 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.292999 25733 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:19:35.314684 25683 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.322295 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:35.322846 20253 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.322965 25683 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:35.327518 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.318409 25938 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.330493 25938 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.330780 20247 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:19:35.329005 25939 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:19:35.332378 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:35.334543 20253 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:35.335266 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2057) took 1609 ms. Trace:
I20260709 12:19:35.335435 25573 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:35.335709 20321 rpcz_store.cc:276] 0709 12:19:33.726197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.469110 (+742913us) service_pool.cc:224] Handling call
0709 12:19:34.469418 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.083211 (+613793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.335020 (+251809us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001423d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:35.335189 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404483456}
I20260709 12:19:35.337540 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 794) took 1869 ms. Trace:
I20260709 12:19:35.337910 21043 rpcz_store.cc:276] 0709 12:19:33.467869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:33.468012 (+   143us) service_pool.cc:224] Handling call
0709 12:19:33.468308 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.079022 (+1610714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.337301 (+258279us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54004ad154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:35.337476 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3578294144}
W20260709 12:19:35.338526 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.339847 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:35.341014 25573 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:35.341845 25573 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.342974 25573 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:35.345798 25899 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.517s	user 0.019s	sys 0.011s
I20260709 12:19:35.347680 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:35.352869 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56880.8us
I20260709 12:19:35.352839 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:35.356909 20144 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 2.058s (SENT)
I20260709 12:19:35.355441 25923 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:35.358495 25057 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:35.362149 25923 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.363392 25923 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.365043 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 3174) took 1099 ms. Trace:
I20260709 12:19:35.365437 20175 rpcz_store.cc:276] 0709 12:19:34.265653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.265767 (+   114us) service_pool.cc:224] Handling call
0709 12:19:35.364879 (+1099112us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003e6a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:35.364981 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264259968}
I20260709 12:19:35.292007 25538 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.308571 25934 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.372938 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:35.372227 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.378495 20256 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:35.378859 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.293761 25900 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.380003 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.383854 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:35.377471 25798 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:35.384977 25798 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.378398 25934 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.386036 25934 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.387691 25838 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:35.387951 25687 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:35.388909 25724 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:35.388682 25687 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.390111 20076 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 11, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.392285 21043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:35.392155 20076 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:35.393039 21043 raft_consensus.cc:606] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.398379 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:35.399015 20173 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:35.400353 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:35.400930 20175 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.317350 25642 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.402262 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:35.315900 25879 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.398082 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:35.356604 25865 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:35.406361 20173 pending_rounds.cc:85] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:19:35.393597 20076 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 10, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.368568 25878 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.413690 20173 pending_rounds.cc:107] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:19:35.414242 20173 raft_consensus.cc:2889] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:35.415768 25865 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.411358 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.387290 25798 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:35.413072 21034 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:35.374183 25741 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:35.423811 20076 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 15, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.427919 20330 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:35.428596 20175 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:35.328940 20251 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:35.422727 20256 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:35.428921 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.457664 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:35.454078 25919 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:35.423504 25741 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:35.462968 21034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:35.462813 25884 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.463805 21034 raft_consensus.cc:606] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.464298 21034 raft_consensus.cc:614] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:35.466158 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:35.413604 25784 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.468917 21037 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:19:35.469044 25784 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.462872 25741 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.471952 25741 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:35.475603 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.422641 25878 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.478139 25878 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:35.477687 20076 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.478729 25878 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:35.416680 25865 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.486696 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:35.493496 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 64662.2us
I20260709 12:19:35.499845 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:35.501048 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:35.480093 20076 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.414295 25838 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:35.495173 20295 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:35.514274 20220 leader_election.cc:336] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.814s (SENT)
I20260709 12:19:35.420909 25687 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:35.517373 20076 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.421468 25867 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:35.516881 25849 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:35.490770 25919 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.507925 25701 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:35.521271 20076 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 14, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.465799 25884 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:35.519150 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 201671us
I20260709 12:19:35.516176 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.508075 25916 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.508630 25883 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:35.512379 25656 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:35.537952 20076 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 10, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 10 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:35.512471 25835 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.535269 20219 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.566468 20256 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:35.513671 25838 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:35.574085 20076 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:35.532938 25702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.012s	sys 0.021s
I20260709 12:19:35.491761 25845 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:19:35.608595 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.610420 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.625622 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:35.608526 25702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.012s	sys 0.022s
I20260709 12:19:35.639552 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.640663 20327 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:35.565788 25784 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:35.573963 25838 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:35.614751 25656 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:35.664997 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.657135 20076 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 9 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } }
I20260709 12:19:35.617246 25941 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:35.628851 25816 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:35.536108 25867 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.622895 25920 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:35.658522 25573 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:35.631781 25687 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:35.666457 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 150378us
I20260709 12:19:35.681080 20076 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.623508 25834 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:19:35.662045 25801 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:35.686945 20076 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.577263 25916 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.662869 25945 raft_consensus.cc:2764] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 12:19:35.689531 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 160718us
I20260709 12:19:35.686760 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:35.693751 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:35.681640 25597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.020s	sys 0.011s
I20260709 12:19:35.704178 20076 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.682974 25573 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:35.708741 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 297446us
I20260709 12:19:35.679661 25849 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.688800 25801 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:35.719051 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 98501.2us
I20260709 12:19:35.719661 20144 leader_election.cc:400] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:35.720675 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:35.729645 20172 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:35.706154 25900 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:35.708140 25597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.020s	sys 0.012s
I20260709 12:19:35.716974 25573 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.686720 25920 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.709386 25538 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:35.733570 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:35.719166 25879 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:35.727913 25865 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:35.689832 25687 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.757928 25687 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:35.727978 25801 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:35.732342 25656 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.738453 20076 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:35.737821 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86394.9us
I20260709 12:19:35.772244 20076 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 9, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:35.733799 25936 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:19:35.749923 20295 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:35.738713 25876 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:19:35.753227 20251 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:35.695466 25835 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.753942 25962 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:19:35.744797 20219 leader_election.cc:400] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:19:35.785099 20219 leader_election.cc:403] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:35.777035 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.753242 25849 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:35.782927 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63424.6us
I20260709 12:19:35.782666 20076 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:35.791891 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.745455 25865 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:35.796833 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54539.1us
I20260709 12:19:35.793540 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:35.793393 20076 catalog_manager.cc:5697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 8, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:35.803049 20172 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:19:35.793176 25952 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:19:35.806607 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:35.815688 25844 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:35.820816 25844 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:35.792893 25618 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:35.793871 25878 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:35.827179 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.827702 20172 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:35.801162 25865 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.832593 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.835981 20321 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:35.838330 20321 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:35.838755 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.839010 20326 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:35.804629 25687 raft_consensus.cc:2764] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:19:35.792577 25801 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:35.845044 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:35.849447 20322 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.787730 25934 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:35.804345 25538 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:19:35.810796 25965 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:19:35.830791 25618 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.846750 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:35.859875 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 82105.9us
W20260709 12:19:35.862823 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.864130 20322 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:19:35.864880 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.866447 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:35.866834 21034 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:19:35.869841 21037 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:35.832445 25702 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:35.876961 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:35.877856 21041 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.875437 25884 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.880199 25884 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:35.882143 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:35.884445 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47683.5us
I20260709 12:19:35.887358 20172 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:35.889350 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:35.866745 25618 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:35.916410 21042 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:35.867969 25867 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:35.918780 21041 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:19:35.887214 25933 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:19:35.855376 25878 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:19:35.857595 25687 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:19:35.855741 25941 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:19:35.930691 25883 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:35.933398 25934 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:35.859807 25954 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:19:35.937443 25867 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:35.941721 25816 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:35.944036 25850 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:35.944232 25878 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:35.900794 25965 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:35.944957 25883 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:35.954715 20220 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.220s (SENT)
I20260709 12:19:35.994391 20178 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:19:35.978223 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 77591.3us
W20260709 12:19:35.992090 25951 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:19:35.994904 20178 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:19:35.993148 25956 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:19:35.993314 25619 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:35.946640 25950 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:19:35.995836 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.918092 25879 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:19:35.955799 25941 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:36.014595 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:36.016268 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:35.957477 25816 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:36.020722 20178 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.021824 20178 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:35.963820 25850 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:35.963999 25878 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:35.998653 25687 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:35.991082 25965 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:35.953487 25972 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 12:19:36.015694 25941 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:36.037576 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:36.023916 25844 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:36.045264 20178 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:19:36.047895 20178 pending_rounds.cc:85] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:19:36.048192 20178 pending_rounds.cc:107] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:19:36.048491 20178 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:36.013355 25619 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.032264 25687 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:36.055727 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3369) took 1482 ms. Trace:
I20260709 12:19:36.056969 25981 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:36.056916 25702 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:36.036509 25784 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:36.058725 20179 rpcz_store.cc:276] 0709 12:19:34.573598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.855349 (+281751us) service_pool.cc:224] Handling call
0709 12:19:34.881374 (+ 26025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:34.883440 (+  2066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.883469 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:34.978360 (+ 94891us) log.cc:844] Serialized 26 byte log entry
0709 12:19:35.131175 (+152815us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:35.235575 (+104400us) log.cc:844] Serialized 14 byte log entry
0709 12:19:35.264050 (+ 28475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.264178 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.729897 (+465719us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b180044d460. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:36.047325 (+317428us) raft_consensus.cc:1685] finished
0709 12:19:36.055436 (+  8111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.055647 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1651,"prepare.queue_time_us":79288,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":7319,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":56390,"spinlock_wait_cycles":17920384,"thread_start_us":255352,"threads_started":2,"wal-append.queue_time_us":290544}
I20260709 12:19:36.036741 25977 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:36.046581 25920 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:36.052696 25945 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:36.072960 25981 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:36.081732 25981 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.083514 25981 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:36.053825 25816 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.104555 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:36.089200 25849 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.105293 20323 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:36.047401 25883 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.096401 25801 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:36.117027 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.063908 25850 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.117468 25580 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:36.119024 25580 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:36.108127 25945 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:19:36.124667 25580 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.071305 25878 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:36.137401 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 280321us
I20260709 12:19:36.124817 25619 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:36.133457 25573 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.147421 20144 leader_election.cc:400] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:36.147936 20144 leader_election.cc:403] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.167891 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.105700 25977 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:19:36.132897 25945 consensus_queue.cc:1243] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:36.134255 25883 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:36.113780 25849 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.185304 25849 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:36.186540 20323 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:19:36.178158 25944 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.897s	user 0.009s	sys 0.000s
W20260709 12:19:36.180193 25988 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:19:36.088905 25965 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.181241 25573 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:36.181865 25978 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:19:36.182804 25986 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:19:36.105235 25687 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.097354 25941 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.189313 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:36.181015 25989 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:19:36.179386 25992 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:19:36.172626 25878 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:36.150655 25972 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:19:36.170694 25995 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13.
I20260709 12:19:36.198125 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:36.217526 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 465093us
I20260709 12:19:36.222730 20254 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:36.222813 25954 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:36.224745 25873 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:36.225157 25873 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:36.225984 25873 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.227264 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:36.228153 20247 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:36.228308 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:36.229199 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:36.231068 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59904.4us
I20260709 12:19:36.235746 20247 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:36.236291 20254 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:36.235450 20249 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:19:36.238049 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.239720 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.229947 25945 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.240355 20171 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:36.236977 25884 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:36.229825 25865 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.237174 25844 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:36.242791 25656 raft_consensus.cc:993] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:19:36.242868 25865 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:36.243466 25990 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:36.237425 25642 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:36.244894 20254 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:36.244503 25642 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.245273 20325 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:36.246773 25642 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:36.248291 25838 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.003s
I20260709 12:19:36.248754 25838 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.243469 25656 raft_consensus.cc:1081] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
W20260709 12:19:36.253167 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.251008 25838 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:36.206760 25666 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:36.256245 25666 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:36.256465 25751 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:36.256840 25751 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:36.257246 25666 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.261762 25945 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:36.264225 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:36.264953 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.266335 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.262080 25965 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:36.282903 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.269750 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.283915 21042 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:36.284238 21041 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 12:19:36.271178 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.284668 21041 pending_rounds.cc:85] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 8
I20260709 12:19:36.270222 25884 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:36.284956 21041 pending_rounds.cc:107] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:19:36.288568 21041 raft_consensus.cc:2889] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:36.285333 21034 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:19:36.286404 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.289893 20178 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:36.286568 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.290894 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.291188 20254 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:36.287813 20173 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: []
W20260709 12:19:36.286722 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.259466 25618 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.294781 25618 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:36.295526 20327 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:19:36.295781 25991 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:19:36.300441 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2533) took 1098 ms. Trace:
I20260709 12:19:36.300841 20255 rpcz_store.cc:276] 0709 12:19:35.202771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.202888 (+   117us) service_pool.cc:224] Handling call
0709 12:19:36.300226 (+1097338us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54001c8c54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:36.300359 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263253760}
I20260709 12:19:36.223444 25954 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.300689 25884 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.309849 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:36.303952 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 63529.3us
I20260709 12:19:36.305716 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.310715 20175 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:36.311050 20173 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:36.308777 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.312744 20180 raft_consensus.cc:2410] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:36.309633 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:36.315709 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.325264 25618 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:19:36.331678 25618 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:36.333815 25850 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.335675 25963 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:36.336050 25993 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.207s	user 0.003s	sys 0.000s
I20260709 12:19:36.337747 25679 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.340814 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:36.340750 25679 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.347553 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:36.348196 21043 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:36.345278 25679 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:36.355914 25957 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:36.356329 25957 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:36.356804 25954 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:36.338636 25849 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:19:36.357190 25957 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.358448 25957 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:36.361196 25980 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:19:36.368263 25873 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:36.374292 20321 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:36.375557 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:36.376413 20327 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:36.331244 25597 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:19:36.380386 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:36.337452 25977 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:19:36.388818 25916 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:36.389191 25751 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.390193 25751 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:36.397545 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:36.378221 25844 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:36.447549 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:36.457582 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:36.465086 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.467295 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.468081 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.469231 20173 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
W20260709 12:19:36.470444 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.470994 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.472002 20180 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.485730 20254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40218
I20260709 12:19:36.486879 20254 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:36.487464 20254 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.492020 20329 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:19:36.492878 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:36.497901 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.498837 20255 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:19:36.501580 20126 auto_rebalancer.cc:893] Removing replace marker failed: Replica 85fa447fc35d4f88ab7c85630749ec78 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:19:36.502245 20126 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:19:36.502645 20126 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:19:36.510113 20175 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:36.523695 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.525103 20255 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:36.522635 20249 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:19:36.526675 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.535691 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:36.536922 20326 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:36.533149 20248 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:36.510859 20254 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.540890 20180 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
W20260709 12:19:36.542912 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.544652 20254 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:36.549014 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:36.553004 21008 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.010s (SENT)
I20260709 12:19:36.551311 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:36.559520 21042 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:36.564069 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:36.563287 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75990.7us
W20260709 12:19:36.588840 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.588716 25916 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:36.598450 25972 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:36.607867 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.610139 20247 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:36.607812 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:36.591326 25916 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:36.402676 25666 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:19:36.618748 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.600358 25724 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:19:36.619999 25878 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:36.621299 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:36.601368 25057 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:36.599813 25597 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.629833 21042 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:36.618790 25982 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.645028 25982 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.649783 26004 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:36.650311 25642 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:19:36.650671 26004 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:36.652882 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.653337 26004 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:36.655715 25966 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.627348 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:36.599529 25972 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:36.656631 25966 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.664489 25683 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:36.666385 25850 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.667822 25849 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:19:36.669732 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48741.9us
W20260709 12:19:36.672317 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54423.2us
I20260709 12:19:36.673578 25666 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:36.675390 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.605381 25844 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.643155 21042 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:36.696339 26004 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:36.696774 21042 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.698976 21042 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.699225 25941 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.699939 25850 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:36.706612 25968 consensus_queue.cc:1175] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "85fa447fc35d4f88ab7c85630749ec78" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 12:19:36.671414 25816 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:36.715824 25057 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.717811 25597 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.687686 25849 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:36.720118 25849 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:36.683243 25683 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:36.726837 25683 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.728565 25683 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:36.693681 25666 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:36.732103 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.734638 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:36.736382 25972 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:36.736855 25998 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.590s	user 0.004s	sys 0.000s
W20260709 12:19:36.741465 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 114335us
I20260709 12:19:36.744434 25573 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:36.747026 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2539) took 1417 ms. Trace:
I20260709 12:19:36.753470 20175 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:36.754889 20172 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:36.755759 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.756451 25966 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:36.703281 25850 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:36.783881 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.789654 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:36.794947 20329 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
W20260709 12:19:36.804580 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.808291 20173 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:36.816877 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.774497 20252 rpcz_store.cc:276] 0709 12:19:35.328990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.331644 (+  2654us) service_pool.cc:224] Handling call
0709 12:19:35.331939 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:35.407694 (+ 75755us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:36.187186 (+779492us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18000679c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf
0709 12:19:36.187355 (+   169us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.322886 (+135531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:36.322950 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:36.323019 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.746442 (+423423us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b5400310454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:36.746520 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.746782 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45487,"prepare.queue_time_us":241397,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4758,"raft.queue_time_us":48613,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":198081152,"thread_start_us":318386,"threads_started":2,"wal-append.queue_time_us":207217}
W20260709 12:19:36.827975 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.169s (SENT) [suppressed 27 similar messages]
W20260709 12:19:36.838593 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 107968us
I20260709 12:19:36.842192 25784 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:36.842413 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:36.843436 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.846719 20175 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.779068 25968 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:36.847442 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57512.8us
I20260709 12:19:36.855415 20251 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:36.858419 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:36.868468 25981 raft_consensus.cc:2764] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:19:36.880414 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 146025us
I20260709 12:19:36.881762 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:36.889096 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.898530 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50007.1us
I20260709 12:19:36.902681 25057 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:36.910156 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.861338 25996 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:36.925247 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:36.920023 25996 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:36.897958 25968 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:36.946518 20173 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:19:36.921711 25972 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:36.952904 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:36.956465 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.940732 25982 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:36.972790 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.928578 25850 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:19:36.992208 25867 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:36.997066 25965 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:37.000901 25968 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.001382 20179 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:37.045414 25995 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:37.045993 25995 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:37.046622 25687 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:37.051450 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:37.052294 20173 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.049566 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:37.064682 25751 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.657s	user 0.018s	sys 0.000s
W20260709 12:19:37.066159 26021 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:19:37.067900 25580 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:37.068392 25656 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:37.069094 25656 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:37.071784 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 95288.7us
W20260709 12:19:37.080586 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.088060 20251 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:37.042104 25972 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:37.106990 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.074759 25597 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:37.113114 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 77077.9us
W20260709 12:19:37.119309 25873 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.014s
I20260709 12:19:37.139493 21037 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:19:37.140419 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.142195 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.143146 20254 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:37.149658 20175 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:37.155206 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:37.140184 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:37.164054 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.157014 20248 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:37.169459 20176 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:37.156127 25573 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.142198 25920 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:19:37.175511 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.184191 25981 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:37.190119 20326 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:37.190461 21042 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:19:37.198690 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.200452 20173 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:19:37.176337 25883 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.911s	user 0.015s	sys 0.005s
W20260709 12:19:37.212394 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.222671 26018 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:19:37.171649 25867 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:37.228513 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.237862 25816 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:37.238761 26026 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:19:37.238641 25816 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.230074 25967 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.233094 25850 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.210937 25573 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:37.253990 25849 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.009s
W20260709 12:19:37.267011 26022 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:19:37.268563 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.269233 21037 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:37.270391 25981 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:37.271226 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:37.272138 26015 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:37.272636 21034 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.272704 26015 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.273317 26015 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:37.259895 26017 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:19:37.281785 25995 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.285398 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.286450 20321 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:37.286661 25957 consensus_meta.cc:287] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.928s	user 0.018s	sys 0.000s
I20260709 12:19:37.271080 25981 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.282122 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:37.283427 25995 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:37.303272 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.260931 25883 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.287381 25957 raft_consensus.cc:476] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Not starting pre-election -- already a leader
W20260709 12:19:37.340497 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 210914us
I20260709 12:19:37.347826 25883 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.348893 25981 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.349493 25981 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.350155 25883 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:37.350044 25981 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.246975 25867 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.332412 25982 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:37.287356 25850 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.330907 25967 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.338230 25972 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.292332 25849 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.287388 26015 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.371924 20179 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:37.357896 25982 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.354501 25957 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:37.377362 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.388397 20249 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:19:37.384831 25666 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.575s	user 0.014s	sys 0.001s
I20260709 12:19:37.384271 25982 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:37.420651 25057 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:37.421809 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48568.9us
I20260709 12:19:37.427052 25057 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.431608 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:37.419543 26023 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
W20260709 12:19:37.472587 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 103421us
I20260709 12:19:37.476693 20177 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:37.478488 25850 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.479790 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:37.424177 25666 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.484272 25057 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:37.485764 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.451134 25945 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:37.459604 25981 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.428294 25957 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.527474 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:37.530418 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 192338us
I20260709 12:19:37.535255 21034 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:19:37.538838 20171 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:19:37.539283 20171 pending_rounds.cc:85] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:19:37.539541 20171 pending_rounds.cc:107] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:19:37.539835 20171 raft_consensus.cc:2889] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:37.543694 26034 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:37.544250 26034 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:37.544663 26034 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:37.547788 26027 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:19:37.533748 25923 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:37.550021 25923 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.553004 25872 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:37.564364 25872 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.564670 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:37.566134 26035 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:37.566941 25883 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:37.567610 26032 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:37.568719 25666 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.569370 25883 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:37.564818 25872 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:37.533344 25573 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.585003 25923 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:37.586359 25957 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.595100 25996 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.596457 25996 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:37.593649 25580 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.003s
I20260709 12:19:37.531092 25945 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.587719 25849 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.608657 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:37.601579 25967 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:37.618646 26020 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.568s	user 0.000s	sys 0.004s
I20260709 12:19:37.620347 25816 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.621361 25784 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:37.621470 25945 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.621842 25784 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:37.622365 26015 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.622896 25784 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.627161 26031 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:37.628469 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2566) took 1061 ms. Trace:
I20260709 12:19:37.628877 20250 rpcz_store.cc:276] 0709 12:19:36.562589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.576926 (+ 14337us) service_pool.cc:224] Handling call
0709 12:19:36.608193 (+ 31267us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:36.608881 (+   688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:36.608916 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:36.609885 (+   969us) log.cc:844] Serialized 52 byte log entry
0709 12:19:36.825884 (+215999us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b180040dec0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5ddedcc58f 00007f5dd7e0b571 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd
0709 12:19:36.893441 (+ 67557us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:36.893491 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.893575 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:37.617852 (+724277us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:37.624110 (+  6258us) raft_consensus.cc:1685] finished
0709 12:19:37.624133 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.624271 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1735,"raft.queue_time_us":200,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"spinlock_wait_cycles":38158976,"thread_start_us":278097,"threads_started":1,"wal-append.queue_time_us":334278}
I20260709 12:19:37.636809 25683 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:37.637331 25683 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:37.638422 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 987) took 1349 ms. Trace:
I20260709 12:19:37.638351 25683 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.639639 25683 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.638903 20171 rpcz_store.cc:276] 0709 12:19:36.289068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.289479 (+   411us) service_pool.cc:224] Handling call
0709 12:19:36.289768 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.540352 (+1250584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.638068 (+ 97716us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540031b5d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:37.638293 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2871011584}
I20260709 12:19:37.646209 25883 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.647974 25883 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.648877 25580 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.648895 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.649632 25580 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.650303 25883 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:37.653453 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.656630 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.656903 26025 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
W20260709 12:19:37.659307 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.660435 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.674045 25784 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:37.675791 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.676484 20329 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:19:37.676859 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.665707 25941 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.678350 25941 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.678692 26034 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.671401 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:37.687125 25883 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:19:37.687356 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.681674 21034 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:37.687819 25865 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:19:37.693728 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.697892 25994 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.698413 25994 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.699958 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.697930 25873 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:37.701248 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:37.701361 25873 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.701866 20247 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:37.702921 25656 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.703533 25957 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.703780 25994 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.704124 25957 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.704444 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:37.703473 25873 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.698408 25867 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:37.707353 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:37.701994 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.709265 20256 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:37.708154 20249 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:37.712806 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.689913 25883 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.714330 25883 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:37.715330 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:37.715888 20251 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:37.730311 26006 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.452s	user 0.004s	sys 0.000s
I20260709 12:19:37.739467 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.740325 21043 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:37.740468 25957 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.739614 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.741113 20250 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:37.741540 20250 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:37.741431 21034 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:37.741990 21037 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:37.742496 20250 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.744401 25941 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.740689 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:37.747085 25538 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:37.747653 25538 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:37.748541 25945 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:37.748653 25538 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.743527 20250 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:37.751139 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.751060 25957 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.752027 25957 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:37.753017 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 159472us
I20260709 12:19:37.754266 25957 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.754184 26030 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:37.713133 25580 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.762837 26030 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.763492 26030 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.764868 25982 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.766147 26030 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.766484 20251 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:37.769589 21037 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:37.771915 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.772610 21037 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:37.772949 26034 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.777276 25982 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.777446 25883 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.778517 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:37.785234 26031 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.789146 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:37.795930 25724 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.797766 25872 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.826347 20247 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:37.844763 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:37.845929 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 67489.2us
I20260709 12:19:37.846774 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:37.849530 20250 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:19:37.851882 20321 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:37.853797 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:37.844978 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.855315 21037 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:37.856595 21034 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17.
I20260709 12:19:37.850075 20250 pending_rounds.cc:85] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 7
I20260709 12:19:37.857858 20250 pending_rounds.cc:107] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:19:37.858634 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:37.859464 20326 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:37.858752 20250 raft_consensus.cc:2889] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:37.858709 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:37.863098 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.863696 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:37.864013 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.865569 20254 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.865761 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.864739 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:37.866648 21043 raft_consensus.cc:2410] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:37.833422 25995 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:37.856936 25683 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:37.879514 25844 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:37.871341 26034 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.880785 25844 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:37.880712 26034 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.881296 25844 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:37.881480 25883 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:37.882326 25844 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.868965 25580 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:37.883148 26034 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:37.872224 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.875491 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:37.876047 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86973.7us
I20260709 12:19:37.876490 20323 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:37.859261 25724 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.879818 25683 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:37.883735 25580 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:37.871699 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:37.909332 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.909843 20322 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:37.884881 25844 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:37.861937 25945 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:37.887943 20249 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:37.894524 20325 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:37.869688 25784 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:19:37.895943 20329 raft_consensus.cc:2410] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:19:37.871538 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.905148 20295 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:37.910779 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.917385 21037 raft_consensus.cc:2410] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:37.922493 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:37.922250 25580 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:37.923175 21034 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:37.909283 25683 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.911686 25945 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.926446 25945 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:37.926505 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:37.927448 25883 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:37.928184 25883 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.928527 25883 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.929821 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:37.932399 20294 leader_election.cc:400] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17.
I20260709 12:19:37.932946 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:37.936842 20294 leader_election.cc:403] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:19:37.937032 20329 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:37.935529 20324 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:37.937077 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.623s (SENT)
I20260709 12:19:37.939225 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:37.944770 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.946556 20326 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:37.969264 25656 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.969415 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:37.974066 20327 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:19:37.975577 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70487.5us
W20260709 12:19:37.977878 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79066.6us
I20260709 12:19:37.965557 25849 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17.
I20260709 12:19:37.980800 26030 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:37.984771 25724 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.988019 25683 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.997033 25945 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.998752 25683 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:37.992215 25741 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:37.999495 25741 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.999955 25741 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:38.000002 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 82248.8us
I20260709 12:19:37.993691 25883 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:37.994887 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:37.979389 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:38.002398 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:38.004604 20329 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:38.012056 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:38.014828 20220 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.741s (SENT)
I20260709 12:19:37.952550 25995 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.019227 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:37.997120 26030 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:38.023152 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48558.9us
I20260709 12:19:38.031756 25724 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:38.032517 25724 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:38.033841 25724 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:38.024413 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:38.042260 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.048067 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:38.039582 25656 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:38.038731 25784 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:19:38.053448 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.035651 26031 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:19:38.062041 20330 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:38.067641 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:38.068130 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:38.068667 21035 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:38.073693 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70305.2us
I20260709 12:19:38.080457 25900 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:38.081128 25900 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:38.082195 25900 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.084914 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:38.085453 25995 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.085932 25942 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:38.086498 26030 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:38.088035 20329 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 16. Ops: []
I20260709 12:19:38.090641 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:38.091462 20327 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:38.052589 25656 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.104645 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:38.105724 20324 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:38.089246 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:38.107055 20321 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:38.105510 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:38.108040 20330 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:19:38.108539 21042 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:38.064531 25945 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:38.115794 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.116806 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:38.117498 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:38.108112 25656 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:38.120193 20254 raft_consensus.cc:2368] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 14.
I20260709 12:19:38.120638 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:38.121384 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:38.124769 20330 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 16. Ops: []
I20260709 12:19:38.125947 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:38.127642 25856 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:38.127910 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:38.129290 25798 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.131007 25883 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.131735 25883 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:38.132130 25883 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.132472 25883 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:38.118039 25683 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.137128 25683 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.140411 20327 raft_consensus.cc:1217] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Deduplicated request from leader. Original: 14.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 12:19:38.140879 20327 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:19:38.142045 20327 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:38.143096 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:38.143843 25733 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:38.144269 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:38.146514 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:38.146910 20327 raft_consensus.cc:2368] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:38.147845 25538 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.147898 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:38.148761 20327 raft_consensus.cc:2368] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:38.148591 25538 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.149169 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:38.150014 20329 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:38.150964 25538 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.152241 20326 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:38.152649 25872 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.153448 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:38.161461 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:38.163805 25683 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:38.166172 20220 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.082s (SENT)
I20260709 12:19:38.166721 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:38.172427 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:38.176020 25844 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:38.178601 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:38.171938 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:38.181398 21035 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:19:38.187196 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59712.8us
I20260709 12:19:38.188935 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:38.200623 20322 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:38.201996 20321 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:38.205744 20323 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:38.207237 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:38.207391 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54519.9us
I20260709 12:19:38.208174 20179 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:19:38.209479 20329 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:38.187997 25733 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:38.188050 25967 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
W20260709 12:19:38.231369 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.219924 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:38.221310 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:38.236766 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70642.3us
I20260709 12:19:38.417361 25923 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:38.557238 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 333290us
I20260709 12:19:38.569475 20171 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:38.563964 20177 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
W20260709 12:19:38.573469 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.591516 20174 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:19:38.594115 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:38.594780 20252 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.597056 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:38.601104 20171 raft_consensus.cc:2410] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:38.602658 20172 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:19:38.571554 25724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.009s	sys 0.027s
I20260709 12:19:38.606612 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:38.611192 20249 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.614255 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:38.612946 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 398257us
I20260709 12:19:38.563751 25945 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.625113 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:38.625449 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68281.4us
I20260709 12:19:38.630429 20179 raft_consensus.cc:2410] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:38.583670 25995 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:38.627064 25741 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.626s	user 0.017s	sys 0.022s
I20260709 12:19:38.670140 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:38.670986 20248 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:38.606417 25923 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.646754 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:38.680094 25923 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.680477 20172 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:19:38.680691 25798 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.551s	user 0.014s	sys 0.000s
I20260709 12:19:38.681186 25798 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:38.683353 25883 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.007s
I20260709 12:19:38.683849 25883 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.686380 25883 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.688211 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:38.688843 20179 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.691694 20178 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:38.696305 25741 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.698503 25741 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:38.704632 20252 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:38.732971 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:38.607182 25656 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.794788 20249 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:38.660832 25945 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.860323 21037 raft_consensus.cc:2368] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:38.669109 25995 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.892262 20247 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:38.905411 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:38.908138 21041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:38.908756 21041 raft_consensus.cc:606] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:38.909125 21041 raft_consensus.cc:614] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:38.912770 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.913769 25656 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:38.915194 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:38.918831 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:38.920496 25945 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:38.921269 25945 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.921725 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:38.921852 25945 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:38.799794 25733 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:38.945977 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:38.961232 20249 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:38.962651 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 338767us
I20260709 12:19:38.963718 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:38.965618 20248 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:38.872537 25683 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:19:39.004699 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:39.005800 21037 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:38.953178 25900 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.902961 26066 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:39.009671 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:39.010289 21039 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:39.009024 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:39.011286 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:39.011833 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 339205us
I20260709 12:19:39.002014 25967 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:39.025102 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 462769us
I20260709 12:19:39.035709 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:39.036409 20248 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:39.039324 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.044385 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:39.045594 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:39.053079 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:39.053872 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:39.054241 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.984288 20179 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:39.055716 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:39.056548 20329 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:39.057263 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.057921 20179 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:19:39.094331 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48816.4us
I20260709 12:19:39.095362 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:39.096544 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:39.025321 26031 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.108916 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:39.112236 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 112536us
I20260709 12:19:39.107996 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.113596 20254 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:39.123550 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 88974.3us
I20260709 12:19:39.038672 25642 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.034303 25967 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:39.021786 25900 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:39.139619 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44366us
I20260709 12:19:39.033779 25966 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.092s
W20260709 12:19:39.116508 26059 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:19:39.144750 20247 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:39.145857 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:39.138892 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:39.149597 20179 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:39.115203 25845 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:39.111263 26068 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.153129 20248 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:39.150022 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:39.161545 20322 raft_consensus.cc:606] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:39.155131 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:39.148518 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:39.157977 26077 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.166443 20330 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:19:39.164618 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.129024 26082 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.171509 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.130285 25883 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:39.133986 25945 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:39.199985 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.194646 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.126030 26031 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:39.200520 20256 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.022s
I20260709 12:19:39.161271 25845 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.212285 20325 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:39.213145 20325 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:39.210430 20174 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:19:39.210430 20256 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.022s
I20260709 12:19:39.206583 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3236) took 1004 ms. Trace:
W20260709 12:19:39.223453 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44720us
I20260709 12:19:39.226187 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.168543 26075 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:39.134541 25642 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.219010 20180 rpcz_store.cc:276] 0709 12:19:38.201941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.202155 (+   214us) service_pool.cc:224] Handling call
0709 12:19:38.560007 (+357852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.609376 (+ 49369us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:39.047971 (+438595us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.205864 (+157893us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.206121 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.206234 (+   113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:39.206270 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:39.206336 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.206407 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.206519 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9055,"prepare.queue_time_us":391352,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":462957,"threads_started":2}
W20260709 12:19:39.216063 26015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.013s	sys 0.015s
W20260709 12:19:39.253041 26015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.015s
I20260709 12:19:39.230458 25966 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:19:39.204587 26080 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:39.204865 26076 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.254514 26076 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.257287 26076 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.259071 20328 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:39.158490 25835 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:19:39.215783 25845 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.177654 25942 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:19:39.272231 20321 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.274104 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:39.229684 25872 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.223162 26071 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:39.252578 26075 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:39.275921 26076 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.293493 26075 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.293973 26076 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.179013 26068 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.321091 21039 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:39.304106 26032 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:39.278875 26080 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:39.212636 26082 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.278990 26072 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:39.295401 26056 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 12:19:39.175802 26077 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.304200 25835 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:39.300861 26073 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:39.367604 26069 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:39.396991 20219 leader_election.cc:400] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:39.324465 26032 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:39.372299 20329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:39.411892 20329 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:39.412344 20329 raft_consensus.cc:614] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:39.372637 26077 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.373234 26087 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.374384 26082 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.375458 20174 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 12:19:39.418120 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.378221 26079 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:39.379556 25642 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.385291 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3237) took 1182 ms. Trace:
I20260709 12:19:39.387894 25844 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:39.325158 25945 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:19:39.391263 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84104.4us
I20260709 12:19:39.393041 26068 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:39.370406 25900 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:39.397383 20219 leader_election.cc:403] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:39.369007 26072 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.398224 21041 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:39.406651 20321 raft_consensus.cc:2410] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:19:39.296675 25872 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:39.415892 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 219335us
I20260709 12:19:39.377501 25538 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:39.322978 25580 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 12:19:39.408511 26057 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:19:39.417999 20174 pending_rounds.cc:85] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 9
I20260709 12:19:39.444589 20174 pending_rounds.cc:107] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:19:39.445006 20174 raft_consensus.cc:2889] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:39.279665 25967 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:39.427858 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.009s	sys 0.024s
I20260709 12:19:39.418853 20176 rpcz_store.cc:276] 0709 12:19:38.202765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.207436 (+  4671us) service_pool.cc:224] Handling call
0709 12:19:38.565341 (+357905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.603852 (+ 38511us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:39.028133 (+424281us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.384750 (+356617us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.384920 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:39.384968 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:39.385028 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.385099 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.385211 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42361,"prepare.queue_time_us":448377,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":85,"raft.queue_time_us":32155,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":18414,"thread_start_us":547979,"threads_started":2}
W20260709 12:19:39.490698 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.028s	sys 0.042s
I20260709 12:19:39.397212 25683 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:19:39.487316 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 288769us
W20260709 12:19:39.445835 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 141118us
I20260709 12:19:39.437405 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:39.493134 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 683912us
I20260709 12:19:39.427189 26077 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.498349 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:39.426481 26085 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.516786 26032 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.517596 26085 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.518193 26032 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:39.521509 26082 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.522022 26082 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.524435 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:39.525120 20174 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:39.428509 25995 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:39.498690 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 61409.8us
I20260709 12:19:39.501617 20180 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:39.500525 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:39.514194 26072 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:39.419171 26069 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.539683 26077 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.540068 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:39.516949 26076 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.534392 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3241) took 1319 ms. Trace:
I20260709 12:19:39.542083 26077 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.541342 20171 rpcz_store.cc:276] 0709 12:19:38.214850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.624719 (+409869us) service_pool.cc:224] Handling call
0709 12:19:38.625069 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.953004 (+327935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.953091 (+    87us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.004213 (+ 51122us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.291890 (+287677us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:39.291932 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.292008 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.526168 (+234160us) raft_consensus.cc:1685] finished
0709 12:19:39.526202 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.534319 (+  8117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":507708,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":561468,"threads_started":2,"wal-append.queue_time_us":422082}
I20260709 12:19:39.542691 26070 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:39.543234 26070 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:39.542897 25942 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:39.539703 26030 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:39.544370 26082 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:39.544602 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:39.545262 20321 raft_consensus.cc:606] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:39.545703 20321 raft_consensus.cc:614] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:39.419379 26073 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.547183 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:39.547676 26070 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.548638 26073 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.549463 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:39.443620 25538 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:39.546154 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.447103 25945 consensus_queue.cc:1243] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:39.560240 25945 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:39.560549 26094 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:39.560907 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.551422 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.430789 25844 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:39.568280 26062 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:39.582851 26062 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:39.584574 26083 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:19:39.584086 26062 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.575838 26065 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:39.586014 26065 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:39.588076 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66803.8us
I20260709 12:19:39.587232 26065 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.588908 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:39.719033 26069 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:39.575834 26067 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:39.575172 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48455.8us
I20260709 12:19:39.578992 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3238) took 1373 ms. Trace:
I20260709 12:19:39.579870 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1165) took 1364 ms. Trace:
I20260709 12:19:39.576794 26107 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.526319 25900 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:39.526571 26031 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:39.560881 25945 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:39.621157 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:39.711623 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:39.636749 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 94941.6us
W20260709 12:19:39.702574 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.511736 25835 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.625478 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:39.735577 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 368214us
I20260709 12:19:39.758546 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:39.719898 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.760777 20174 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.428047 26087 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.429638 26079 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:39.737494 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 148669us
I20260709 12:19:39.674952 25642 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.744339 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1390) took 1737 ms. Trace:
I20260709 12:19:39.784277 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:39.744158 25942 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:39.677039 26085 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:39.751919 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.705485 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.741503 20324 rpcz_store.cc:276] 0709 12:19:38.215448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.563188 (+347740us) service_pool.cc:224] Handling call
0709 12:19:38.563556 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:39.023472 (+459916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.023507 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.046551 (+ 23044us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.430317 (+383766us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:39.430369 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.430435 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.579586 (+149151us) raft_consensus.cc:1685] finished
0709 12:19:39.579617 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.579788 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40021,"raft.queue_time_us":93452,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":32293,"thread_start_us":706457,"threads_started":2,"wal-append.queue_time_us":467483}
I20260709 12:19:39.762876 25835 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.763465 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:39.763926 20219 leader_election.cc:400] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:39.755882 26030 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:39.798641 20248 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:39.765187 20255 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:39.759194 20328 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:39.765811 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.799873 20179 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:39.766469 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 334792us
W20260709 12:19:39.767427 26092 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:19:39.767967 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:39.563876 26080 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.737298 25683 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.758235 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:39.740108 20175 rpcz_store.cc:276] 0709 12:19:38.205193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.205384 (+   191us) service_pool.cc:224] Handling call
0709 12:19:38.560363 (+354979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.959970 (+399607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.960021 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.043757 (+ 83736us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.486481 (+442724us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:39.510897 (+ 24416us) log.cc:844] Serialized 14 byte log entry
0709 12:19:39.511204 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.511306 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.578739 (+ 67433us) raft_consensus.cc:1685] finished
0709 12:19:39.578763 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.578920 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15401,"prepare.queue_time_us":38825,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":594543,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":24828,"thread_start_us":618835,"threads_started":2,"wal-append.queue_time_us":453170}
I20260709 12:19:39.751885 26069 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.753466 26074 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:39.754315 26067 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.764436 26063 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:39.799163 20255 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:39.782687 25900 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:39.817394 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:39.799506 25724 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:39.802713 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:39.792030 25942 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.794206 26112 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.811707 20178 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.811863 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:39.812966 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:39.784145 21034 rpcz_store.cc:276] 0709 12:19:38.001239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.001354 (+   115us) service_pool.cc:224] Handling call
0709 12:19:38.001710 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.021141 (+ 19431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.021186 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:38.040448 (+ 19262us) log.cc:844] Serialized 26 byte log entry
0709 12:19:38.406389 (+365941us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:38.406498 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.406687 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.737852 (+1331165us) raft_consensus.cc:1685] finished
0709 12:19:39.737890 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.738332 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10789,"raft.queue_time_us":15634,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1960,"thread_start_us":345448,"threads_started":1,"wal-append.queue_time_us":904429}
I20260709 12:19:39.819917 20255 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.820946 26079 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.822212 25900 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.823096 26063 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.824086 26030 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.772217 26107 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.810323 25683 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:39.820976 26087 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:39.793993 25642 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.836633 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:40.237998 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 425651us
I20260709 12:19:40.110543 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:40.075822 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:39.818032 20171 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:19:39.807343 21008 connection.cc:256] RPC call timeout handler was delayed by -1.4700645800000984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 12:19:39.974000 20174 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:39.862834 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:39.883985 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.045553 20179 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:19:40.236474 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 394493us
I20260709 12:19:40.243836 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.244593 20249 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:39.998030 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.246593 20177 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:39.849926 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:40.248230 20175 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14. Re-sending same reply.
I20260709 12:19:39.811407 26110 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:39.855909 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.241287 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.300613 20171 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:40.244267 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:39.848668 25942 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:40.124364 26109 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.096171 26068 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:40.280247 26113 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:39.848683 25798 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:19:39.848656 26075 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.005s
I20260709 12:19:40.235386 26062 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:40.339886 20180 raft_consensus.cc:2410] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:19:40.284282 20255 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.123803 25923 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:40.241530 21008 connection.cc:256] RPC call timeout handler was delayed by -1.4475645800000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:19:40.341846 21008 connection.cc:256] RPC call timeout handler was delayed by -1.3289034849999553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:19:40.342378 21008 connection.cc:256] RPC call timeout handler was delayed by -1.3214680140001747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:19:40.343104 21008 connection.cc:256] RPC call timeout handler was delayed by -1.2530680140000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:19:40.344393 21008 connection.cc:256] RPC call timeout handler was delayed by -1.231680636000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 12:19:40.285641 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:39.851670 26069 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:39.864699 25835 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:40.234543 25883 raft_consensus.cc:993] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:40.286926 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.288077 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:40.352589 20174 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:40.236049 26067 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:40.293148 26094 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.293916 20219 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:40.354171 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.250276 20252 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:40.354830 21037 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
W20260709 12:19:40.250267 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.312182 20247 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:19:40.355513 20247 pending_rounds.cc:85] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 5
W20260709 12:19:40.354552 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 60725.7us
I20260709 12:19:40.356132 20247 pending_rounds.cc:107] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:19:40.356412 20247 raft_consensus.cc:2889] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.354573 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.316115 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:39.968868 25845 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.673s	user 0.003s	sys 0.007s
I20260709 12:19:40.358796 20219 leader_election.cc:400] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10.
I20260709 12:19:40.345252 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.316624 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.360477 20175 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:40.360620 21037 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:40.251605 25844 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:40.348573 20178 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:40.350129 20179 raft_consensus.cc:2410] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:40.363826 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:39.852039 25872 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:40.355602 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.356415 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:40.317478 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 73295.8us
I20260709 12:19:40.317011 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.337387 25656 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:40.343895 26087 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:40.367815 20177 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:40.369084 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:40.364181 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:40.369921 20178 raft_consensus.cc:2368] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15.
I20260709 12:19:40.378945 25642 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:40.350221 26113 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:40.380272 21008 leader_election.cc:336] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.587s (SENT)
I20260709 12:19:40.385790 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:40.381852 20179 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:40.388916 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.392678 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.393528 20179 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:40.354995 25945 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:40.397451 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.398406 20175 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:19:40.394157 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 148494us
I20260709 12:19:39.815649 26074 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.405576 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.409746 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.410356 20173 raft_consensus.cc:2376] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15. Re-sending same reply.
I20260709 12:19:40.412706 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.412859 25683 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:40.361775 26111 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:40.394510 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.407611 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.414233 20179 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:40.414651 20175 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:19:40.399816 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.743s (SENT)
I20260709 12:19:40.405565 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.393370 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:40.366475 26094 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:40.372131 25656 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.413488 20177 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:40.415343 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:40.416005 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.416211 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:40.419760 20179 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:40.301352 26112 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:40.398298 20172 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:40.396283 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:40.417835 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.420748 20179 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:40.411345 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.349360 26068 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:40.346921 26075 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:40.337206 26109 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.350373 25923 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.432575 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3390) took 1050 ms. Trace:
I20260709 12:19:40.433127 20175 rpcz_store.cc:276] 0709 12:19:39.382225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.407135 (+1024910us) service_pool.cc:224] Handling call
0709 12:19:40.432502 (+ 25367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.434391 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3384) took 1056 ms. Trace:
I20260709 12:19:40.428719 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3383) took 1050 ms. Trace:
I20260709 12:19:40.423362 25656 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:40.384985 26069 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:40.318267 25538 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:40.318477 26110 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.434945 20179 rpcz_store.cc:276] 0709 12:19:39.378075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.415647 (+1037572us) service_pool.cc:224] Handling call
0709 12:19:40.434319 (+ 18672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.435603 20174 rpcz_store.cc:276] 0709 12:19:39.377823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.287830 (+910007us) service_pool.cc:224] Handling call
0709 12:19:40.428614 (+140784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.392673 26115 raft_consensus.cc:1081] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:40.445132 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:40.461236 20176 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.461745 20180 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:40.461796 20179 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:40.457777 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:40.446758 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3377) took 1070 ms. Trace:
I20260709 12:19:40.462913 20172 rpcz_store.cc:276] 0709 12:19:39.376078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.445829 (+1069751us) service_pool.cc:224] Handling call
0709 12:19:40.446171 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.446387 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.446412 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.446459 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:40.446511 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.446568 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.446691 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.466599 20177 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:19:40.466741 20172 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:40.461822 25784 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:40.467296 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3378) took 1090 ms. Trace:
I20260709 12:19:40.467780 26069 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:40.467868 20253 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:19:40.431170 25798 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:40.468870 20253 pending_rounds.cc:85] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 8
I20260709 12:19:40.476438 20253 pending_rounds.cc:107] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:19:40.467718 20177 rpcz_store.cc:276] 0709 12:19:39.376508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.451468 (+1074960us) service_pool.cc:224] Handling call
0709 12:19:40.466342 (+ 14874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.467034 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.467239 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10496}
I20260709 12:19:40.476744 20253 raft_consensus.cc:2889] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.430245 25724 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:40.469280 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3391) took 1080 ms. Trace:
I20260709 12:19:40.501195 20179 rpcz_store.cc:276] 0709 12:19:39.382530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.460574 (+1078044us) service_pool.cc:224] Handling call
0709 12:19:40.460900 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.462389 (+  1489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.462586 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.365898 25845 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:40.466610 20180 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:19:40.462438 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 224038us
I20260709 12:19:40.423043 26079 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:40.504252 20178 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:40.517446 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3395) took 1133 ms. Trace:
W20260709 12:19:40.512749 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 107721us
I20260709 12:19:40.469115 20174 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:40.520236 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3397) took 1136 ms. Trace:
I20260709 12:19:40.520738 20174 rpcz_store.cc:276] 0709 12:19:39.396664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.463927 (+1067263us) service_pool.cc:224] Handling call
0709 12:19:40.468789 (+  4862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.519814 (+ 51025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.520158 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.410550 26074 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:40.536018 26115 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.536585 26115 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.540297 20180 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:40.540704 20180 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:40.541460 20180 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.542359 20180 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:40.501363 26113 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:40.400719 26087 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:40.512012 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 259747us
I20260709 12:19:40.577423 20255 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:19:40.577955 20255 pending_rounds.cc:85] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 6
I20260709 12:19:40.578155 20255 pending_rounds.cc:107] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:19:40.578359 20255 raft_consensus.cc:2889] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.517818 20178 rpcz_store.cc:276] 0709 12:19:39.383604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.463313 (+1079709us) service_pool.cc:224] Handling call
0709 12:19:40.503816 (+ 40503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.517220 (+ 13404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.517399 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:40.451037 26111 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:40.619306 20330 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15.
I20260709 12:19:40.619391 20180 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:19:40.620563 20180 pending_rounds.cc:85] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 12
I20260709 12:19:40.620898 20180 pending_rounds.cc:107] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:19:40.621196 20180 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:40.576287 26032 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.058s	user 0.013s	sys 0.001s
I20260709 12:19:40.535168 25942 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.649727 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:40.641844 26073 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:19:40.669902 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.671118 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 217201us
I20260709 12:19:40.647787 25538 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:40.674350 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.572968 26079 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:40.648728 25967 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:40.676973 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:40.680308 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.839361 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.839948 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:40.847519 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.772367 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:40.804888 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 424637us
I20260709 12:19:40.684708 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:40.876379 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 476564us
W20260709 12:19:40.797370 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.880077 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.648s (SENT)
I20260709 12:19:40.881124 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:40.832720 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.700245 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 181173us
W20260709 12:19:40.800504 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:40.899055 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.888219 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:40.705698 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 130967us
I20260709 12:19:40.830261 25942 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:40.912986 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:40.874128 26094 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:40.679878 26127 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:40.909238 26074 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:40.674785 26063 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:40.907941 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.796s (SENT)
I20260709 12:19:40.874090 26031 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:40.929781 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:40.713555 26107 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:40.930753 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 90174.7us
I20260709 12:19:40.931069 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:40.851756 26115 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:40.797274 26075 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:40.702207 25967 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.676051 25724 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:41.092803 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.944904 20256 raft_consensus.cc:2368] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16.
W20260709 12:19:41.044353 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.976732 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:41.027750 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 126039us
I20260709 12:19:40.991429 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:41.101194 20328 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:41.103749 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.931759 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.059407 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.009063 20327 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:41.104743 21039 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:41.104801 20252 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:40.905714 26068 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.004475 20322 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:41.106325 20251 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:41.027923 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 93666.3us
I20260709 12:19:40.963806 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.108680 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:40.913720 25923 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:41.132412 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:41.086741 26146 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:19:41.130563 20176 consensus_meta.cc:287] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.000s
I20260709 12:19:41.095777 26110 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:40.927459 25845 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:40.977229 26131 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:40.958391 26112 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:41.004297 26142 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:19:41.091234 25656 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 12:19:40.798482 26111 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.129760 26119 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:41.132014 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3264) took 1314 ms. Trace:
W20260709 12:19:41.198105 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 65895.4us
I20260709 12:19:41.197335 20174 rpcz_store.cc:276] 0709 12:19:39.817256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.521776 (+704520us) service_pool.cc:224] Handling call
0709 12:19:40.522293 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.640621 (+118328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.640665 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.674952 (+ 34287us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.909751 (+234799us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:40.909795 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.909880 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.131796 (+221916us) raft_consensus.cc:1685] finished
0709 12:19:41.131826 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.131955 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95135,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"thread_start_us":244662,"threads_started":2,"wal-append.queue_time_us":410425}
I20260709 12:19:40.922932 25856 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:41.003445 26124 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 12:19:41.132948 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:41.068114 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 144062us
I20260709 12:19:41.199792 21042 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:41.172806 20176 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
W20260709 12:19:41.099126 26062 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.752s	user 0.006s	sys 0.003s
I20260709 12:19:41.145670 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3259) took 1332 ms. Trace:
I20260709 12:19:41.201650 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1010) took 1121 ms. Trace:
W20260709 12:19:41.175685 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 267770us
I20260709 12:19:41.118424 26031 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:40.926818 26079 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:41.194700 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 57645.9us
W20260709 12:19:41.185209 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8696142979999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 12:19:41.178464 26131 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:41.204104 21008 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.730s (SENT)
I20260709 12:19:41.202116 20176 rpcz_store.cc:276] 0709 12:19:40.080534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.363776 (+283242us) service_pool.cc:224] Handling call
0709 12:19:41.201563 (+837787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920}
W20260709 12:19:41.214996 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8696142979999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:19:41.222088 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.995s (SENT)
W20260709 12:19:41.203068 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.169s (SENT)
I20260709 12:19:41.213382 21034 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:19:41.201898 20172 rpcz_store.cc:276] 0709 12:19:39.812849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.468165 (+655316us) service_pool.cc:224] Handling call
0709 12:19:40.468487 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.618439 (+149952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.618489 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.619052 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.926474 (+307422us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:40.926528 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.926637 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.145361 (+218724us) raft_consensus.cc:1685] finished
0709 12:19:41.145392 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.145579 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113036,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":368974,"threads_started":2,"wal-append.queue_time_us":476435}
I20260709 12:19:41.299356 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.132786 26127 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:41.264846 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.355885 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:41.009721 26121 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.228s
I20260709 12:19:41.222558 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:41.222165 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6491142979998585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:19:41.368371 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6491142979998585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 12:19:41.368783 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6392142979998425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 12:19:41.368836 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:41.369168 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6392142979998425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:19:41.369510 20144 connection.cc:256] RPC call timeout handler was delayed by -1.630214297999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:19:41.369812 20144 connection.cc:256] RPC call timeout handler was delayed by -1.630214297999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:19:41.370118 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5816142979999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:19:41.370434 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5717142979999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 12:19:41.370905 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3382) took 1993 ms. Trace:
W20260709 12:19:41.370961 20144 connection.cc:256] RPC call timeout handler was delayed by -1.54651429799992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:19:41.292461 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.348308 26146 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:19:41.374698 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:41.375546 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:41.376277 20175 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:41.307377 26063 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.377056 26063 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.377429 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:41.378038 20175 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.306605 25580 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.379158 25580 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:41.380117 25538 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.700s	user 0.013s	sys 0.000s
I20260709 12:19:41.381439 25580 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:41.383755 25798 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.870s	user 0.013s	sys 0.000s
I20260709 12:19:41.350232 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.384217 25798 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.384593 20329 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:41.350560 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.384930 21036 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:41.352121 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.385552 20321 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:19:41.352022 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:41.214862 26118 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:41.352038 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:41.386637 20176 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.387041 20176 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.200767 25656 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.388314 26127 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:41.389231 25656 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.222718 26131 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:41.391242 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.392352 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.393720 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.394554 20329 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:41.395805 21037 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:19:41.396883 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 174818us
W20260709 12:19:41.397558 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.071s (SENT)
I20260709 12:19:41.397933 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.399499 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.400118 20323 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:41.400547 25900 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:41.400985 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.212560 25856 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.364713 26031 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:41.401722 26127 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:41.402019 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.402364 26127 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.348992 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.371358 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:41.371466 20171 rpcz_store.cc:276] 0709 12:19:39.377569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.458922 (+1081353us) service_pool.cc:224] Handling call
0709 12:19:40.459284 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.616834 (+157550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.616884 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.617618 (+   734us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.671032 (+ 53414us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:40.671075 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.671146 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.370700 (+699554us) raft_consensus.cc:1685] finished
0709 12:19:41.370723 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.370850 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157432,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":210008,"threads_started":2,"wal-append.queue_time_us":292646}
I20260709 12:19:41.403290 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.403774 20174 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:41.373716 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.376224 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.400592 26152 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:41.402122 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.393095 20321 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:19:41.407413 20323 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:41.402885 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:41.372059 20144 connection.cc:256] RPC call timeout handler was delayed by -1.54651429799992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:19:41.408172 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4709142980000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:19:41.408249 20326 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
W20260709 12:19:41.408558 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4709142980000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:19:41.404554 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:41.360170 26153 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:19:41.411422 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.412055 20322 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:41.413195 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.405740 20175 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:41.415860 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.289264 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:41.416953 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4538142979999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 12:19:41.417922 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4538142979999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 12:19:41.418234 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4106142979999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:19:41.409991 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.418501 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4106142979999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:19:41.418846 20144 connection.cc:256] RPC call timeout handler was delayed by -1.4025142979999146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 12:19:41.419111 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3935142979999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:19:41.419412 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3935142979999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:19:41.419711 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3710142979998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 12:19:41.419974 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3710142979998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 12:19:41.420241 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3701142979998622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:19:41.420521 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3701142979998622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:19:41.420815 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3548142979998374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 12:19:41.421156 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3548142979998374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 12:19:41.422013 20328 raft_consensus.cc:2410] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:19:41.427040 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:41.428372 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 225324us
W20260709 12:19:41.429008 20220 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.723s (SENT)
I20260709 12:19:41.429358 21035 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:41.429365 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.430945 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.432353 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.434667 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.435153 20323 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:41.437808 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.416945 25538 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:41.411924 26134 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:41.448222 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.449704 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:41.452914 25967 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.453063 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.440068 26112 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:41.453747 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.444159 20176 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.454430 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.458562 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.459035 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:41.466059 20175 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:41.467171 20174 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:41.469048 20328 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:41.469769 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:41.484119 20171 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:41.484526 20176 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.488700 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.454161 26063 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.483958 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.455747 25856 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:41.493685 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.492643 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.467628 26110 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:41.500819 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:41.502331 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.502774 21037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1400) took 1131 ms. Trace:
W20260709 12:19:41.496904 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 80737.8us
I20260709 12:19:41.498579 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:41.468523 25945 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:41.456017 26134 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.503154 21037 rpcz_store.cc:276] 0709 12:19:40.371143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.371441 (+   298us) service_pool.cc:224] Handling call
0709 12:19:40.383683 (+ 12242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:41.396190 (+1012507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.502558 (+106368us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54006022d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:41.502715 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327104896}
I20260709 12:19:41.496744 26031 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:41.514036 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:41.522243 20254 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.488417 26133 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:19:41.527451 26133 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.529783 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.507690 25724 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:41.468897 25538 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:41.514173 26031 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.527956 26133 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.509601 26110 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.550908 20254 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:41.512507 25945 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.543959 26031 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:41.540640 25724 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:41.532552 25845 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:19:41.570147 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.572084 20256 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:41.566294 26127 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:41.577934 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.577958 26127 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:41.578459 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.578591 26127 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.582245 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2610) took 1808 ms. Trace:
I20260709 12:19:41.586238 20253 rpcz_store.cc:276] 0709 12:19:39.773715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.796810 (+ 23095us) service_pool.cc:224] Handling call
0709 12:19:39.808059 (+ 11249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.514778 (+706719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.581942 (+1067164us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54003c9bd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:41.582176 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510993152}
I20260709 12:19:41.541199 25538 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.574949 26131 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.604939 26134 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.606784 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.606936 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.608352 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.609256 25538 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.610525 20253 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:41.611358 26131 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:41.611510 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.612362 20253 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:41.613161 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:41.614259 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.614635 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.615819 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.616294 25724 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.617220 26031 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.617004 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.615288 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.624512 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.627039 20252 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:41.630491 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.632040 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.636035 20253 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:41.632648 21043 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:19:41.640936 20220 leader_election.cc:336] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.625s (SENT)
I20260709 12:19:41.641558 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.643173 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:41.644085 20253 raft_consensus.cc:2410] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:19:41.628940 26161 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:19:41.616297 25945 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:41.660789 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.663970 20252 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:41.632336 26031 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:41.676573 20253 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:19:41.678771 20220 leader_election.cc:336] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.648s (SENT)
I20260709 12:19:41.679363 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.665614 26073 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:41.638948 26131 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:19:41.644302 25580 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:19:41.694813 20220 connection.cc:256] RPC call timeout handler was delayed by -1.156356446000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:19:41.696373 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0762564460001158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 12:19:41.696995 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0051564460000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 12:19:41.698130 26162 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:19:41.693759 26152 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:19:41.692265 25538 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.680972 25966 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:19:41.715709 26134 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.734565 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 98222.7us
I20260709 12:19:41.738029 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:41.739403 20322 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:41.739965 26166 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:41.740604 26109 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:41.744222 26140 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.890s	user 0.003s	sys 0.000s
I20260709 12:19:41.747668 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:41.749758 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.750201 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.753116 26122 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:41.750638 25580 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:41.757473 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.757071 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:41.759764 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:41.750419 26131 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:41.761284 25945 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:41.774269 26178 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:41.774832 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 338759us
I20260709 12:19:41.776386 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:41.778553 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:41.779785 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.737850 26134 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.771013 26068 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.783114 26068 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.784626 26138 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:41.785354 26138 raft_consensus.cc:2764] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:41.785851 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:41.762082 25923 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:41.789537 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.792793 26087 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:41.794116 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:41.782250 26079 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:41.796952 21008 connection.cc:256] RPC call timeout handler was delayed by -1.2278978140000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3168s for a response
W20260709 12:19:41.797361 21008 connection.cc:256] RPC call timeout handler was delayed by -1.0787333850000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3256s for a response
I20260709 12:19:41.798843 26116 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.799367 26116 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.803036 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:41.815346 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.468s (SENT)
I20260709 12:19:41.816022 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.819379 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:41.820180 25856 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:41.820782 26159 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:41.821722 26116 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:41.822124 25856 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:41.822553 25856 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:41.826776 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:41.829097 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.829869 20326 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:41.833045 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:41.833799 20174 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:41.834018 20322 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:41.837801 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3380) took 2460 ms. Trace:
I20260709 12:19:41.841974 26178 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:41.842422 26178 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:41.842803 26178 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.843624 20171 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:41.843232 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:41.848522 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:41.850565 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.785373 26068 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:41.787338 26134 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:41.838243 20173 rpcz_store.cc:276] 0709 12:19:39.377060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.447515 (+1070455us) service_pool.cc:224] Handling call
0709 12:19:40.464696 (+ 17181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.517989 (+ 53293us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:19:40.761701 (+243712us) log.cc:844] Serialized 14 byte log entry
0709 12:19:41.194075 (+432374us) log.cc:844] Serialized 14 byte log entry
0709 12:19:41.441037 (+246962us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b1800410080. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b522 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:41.451084 (+ 10047us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800410080. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:41.768175 (+317091us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b1800410080. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:19:41.837271 (+ 69096us) log.cc:844] Serialized 14 byte log entry
0709 12:19:41.837478 (+   207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:41.837518 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:19:41.837579 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:41.837644 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.837745 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":557207,"prepare.queue_time_us":476529,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":9362,"raft.queue_time_us":601940,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":7227,"spinlock_wait_cycles":51047296,"thread_start_us":608020,"threads_started":3,"wal-append.queue_time_us":426455}
I20260709 12:19:41.859139 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:41.859819 20176 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:41.846788 20323 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:19:41.856180 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 77737.7us
I20260709 12:19:41.861507 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:41.866197 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61617.5us
I20260709 12:19:41.867115 20174 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:41.802441 26131 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:19:41.823508 25856 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:41.852079 26111 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:41.870750 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.854995 25538 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.864099 25967 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:41.876503 25580 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:41.883545 20176 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:41.853577 26116 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:19:41.896833 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.871506 26159 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.902228 25656 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:41.902957 26174 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:41.911623 25856 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:41.921615 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.922763 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.923851 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.924834 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.925721 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:41.926903 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:41.929638 20219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.533s (SENT) [suppressed 26 similar messages]
I20260709 12:19:41.856969 25945 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:19:41.939229 21042 raft_consensus.cc:2410] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:41.939894 21037 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:41.940497 21038 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:41.941829 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 45506.3us
I20260709 12:19:41.943755 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.945015 25872 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:41.945600 25872 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:41.932344 21040 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:41.946587 25872 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:41.953172 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.875720 25900 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:19:41.969480 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.973073 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.928872 25580 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:41.974152 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 106291us
W20260709 12:19:41.977821 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 220389us
I20260709 12:19:41.974774 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:41.978808 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:41.750677 26107 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:19:41.973601 26079 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:41.975128 26087 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:41.975862 26138 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:41.973292 25967 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:41.948523 26116 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:19:41.968305 26180 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:19:41.998443 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:42.003036 20323 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:19:42.005458 20323 pending_rounds.cc:85] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 10
I20260709 12:19:42.005746 20323 pending_rounds.cc:107] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:19:42.005998 20323 raft_consensus.cc:2889] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:41.994283 26152 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:42.008136 26152 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:42.009078 26152 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.010363 26152 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.011862 26127 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:42.011705 25967 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.000174 26138 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.006634 26068 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:42.049497 26068 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:42.050062 26068 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:41.997922 25538 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:41.999336 26133 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:42.004015 25945 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:42.065095 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.051956 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73245.1us
W20260709 12:19:42.066373 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 88428.3us
I20260709 12:19:41.996577 26079 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:42.058357 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.049554 26180 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:42.073499 26180 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:42.047227 26087 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:42.074563 26180 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:42.074784 26087 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.081141 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.081979 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.084537 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.072746 25945 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:42.087641 26180 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:42.088245 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.075145 25966 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:42.092248 21042 raft_consensus.cc:2410] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:19:42.090621 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.013782 26030 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:19:42.094825 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.062242 26138 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.092522 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:42.079725 26079 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:42.081892 26181 raft_consensus.cc:2764] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:19:42.112044 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.064003 25580 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.060674 26068 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.089157 25945 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:42.443883 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.378875 26126 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:42.508853 26126 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.510344 26126 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:42.305181 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.518014 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:42.152997 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 60570.6us
I20260709 12:19:42.097218 26030 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:42.096975 25967 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:42.533489 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:42.538877 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.546281 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:42.113044 26110 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:42.524370 26196 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.567711 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:42.568532 20255 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
W20260709 12:19:42.535595 26182 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:19:42.576396 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:42.595889 26195 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:19:42.596328 26190 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.445s	user 0.001s	sys 0.000s
I20260709 12:19:42.593652 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:42.602137 20176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.017s	sys 0.012s
W20260709 12:19:42.602546 20176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.017s	sys 0.012s
W20260709 12:19:42.602643 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 522500us
I20260709 12:19:42.603431 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:42.600584 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.009s	sys 0.019s
W20260709 12:19:42.606762 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.019s
W20260709 12:19:42.607075 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 632337us
I20260709 12:19:42.608282 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:42.577695 26107 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:42.570310 25683 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.613843 26110 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:42.551167 25900 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:19:42.612169 26133 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.633050 26068 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:42.619571 26181 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:42.612090 25945 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.592434 26196 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.614065 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:42.639456 26110 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:42.657686 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43724.7us
I20260709 12:19:42.661425 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:42.671602 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:42.647505 26178 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.804s	user 0.001s	sys 0.009s
I20260709 12:19:42.652689 26181 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:42.675534 26180 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.004s
I20260709 12:19:42.657646 26110 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.657790 26068 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:42.659066 26196 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:42.714841 20144 leader_election.cc:400] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 14.
I20260709 12:19:42.720156 20144 leader_election.cc:403] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:19:42.723244 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 130603us
I20260709 12:19:42.730634 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:42.657228 25945 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.717885 26068 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.692379 26181 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:42.739437 26180 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.688899 26178 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.718710 26133 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:19:42.745934 26068 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:42.761785 20253 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:42.761994 20329 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 15. Ops: []
W20260709 12:19:42.763226 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2086) took 3588 ms (client timeout 1978 ms). Trace:
I20260709 12:19:42.763470 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:42.765399 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:42.691359 25683 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:19:42.747290 26213 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 14.
I20260709 12:19:42.778259 20251 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:42.780206 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:42.778023 20330 rpcz_store.cc:269] 0709 12:19:39.175022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.199734 (+ 24712us) service_pool.cc:224] Handling call
0709 12:19:42.761612 (+3561878us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000cdd54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:42.763135 (+  1523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3241080064}
I20260709 12:19:42.782984 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:42.784338 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:42.785727 20324 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:42.790093 20253 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:42.795806 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:42.802160 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2621) took 1319 ms. Trace:
I20260709 12:19:42.802587 20256 rpcz_store.cc:276] 0709 12:19:41.482275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.482419 (+   144us) service_pool.cc:224] Handling call
0709 12:19:42.801939 (+1319520us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b540004c754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:42.802074 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190318208}
I20260709 12:19:42.806577 21043 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:42.809087 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1472) took 1212 ms. Trace:
I20260709 12:19:42.809516 20252 rpcz_store.cc:276] 0709 12:19:41.597100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.682285 (+ 85185us) service_pool.cc:224] Handling call
0709 12:19:42.807686 (+1125401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.807875 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:42.807907 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:42.807955 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:42.807990 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:42.808047 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:42.808905 (+   858us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540004c750. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:42.809023 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2587243776}
I20260709 12:19:42.811928 21043 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:42.812662 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:42.812966 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.785311 26087 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.814648 26211 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:42.817387 25945 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:42.819497 26079 consensus_meta.cc:287] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.004s
I20260709 12:19:42.819665 26208 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:42.820149 26208 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:42.820008 26079 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.820573 26208 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:42.823851 26178 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:42.826848 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:42.828728 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:42.836179 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:42.836813 21041 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
W20260709 12:19:42.836611 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86002.8us
I20260709 12:19:42.837415 21041 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:42.840436 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:42.841049 20325 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:42.840878 26126 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:42.844396 26209 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 12:19:42.849257 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69152.9us
I20260709 12:19:42.849606 20325 raft_consensus.cc:2410] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:42.852077 20251 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:42.850731 21039 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:19:42.872411 21039 pending_rounds.cc:85] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 12
I20260709 12:19:42.876818 21039 pending_rounds.cc:107] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:19:42.877169 21039 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:42.879773 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:42.881120 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:42.848804 25580 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:42.846534 25945 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.884539 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:42.880028 26219 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:19:42.872296 26210 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:42.887991 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:42.888536 26212 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:42.883443 26213 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:42.893591 26181 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.876432 26134 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:19:42.838891 25683 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:19:42.888535 26147 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 2.033s	user 0.008s	sys 0.014s
I20260709 12:19:42.885674 26180 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:42.913563 20247 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:42.916697 26079 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:42.921060 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3262) took 3104 ms. Trace:
I20260709 12:19:42.926353 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:42.926666 20179 rpcz_store.cc:276] 0709 12:19:39.816746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.502105 (+685359us) service_pool.cc:224] Handling call
0709 12:19:40.502431 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.620033 (+117602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.620077 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.668431 (+ 48354us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.769393 (+100962us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:40.769447 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.769556 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:42.845668 (+2076112us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:42.920756 (+ 75088us) raft_consensus.cc:1685] finished
0709 12:19:42.920778 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:42.920979 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114607,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":12939008,"thread_start_us":180577,"threads_started":2,"wal-append.queue_time_us":171455}
W20260709 12:19:42.931190 21034 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1353) took 2261 ms (client timeout 1960 ms). Trace:
W20260709 12:19:42.931700 21034 rpcz_store.cc:269] 0709 12:19:40.668841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.672776 (+  3935us) service_pool.cc:224] Handling call
0709 12:19:42.929072 (+2256296us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54006d1fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:42.929197 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766474112}
I20260709 12:19:42.932960 26126 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:42.932973 26134 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.934518 20247 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:19:42.916317 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:42.948879 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:42.950762 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62842.2us
I20260709 12:19:42.951802 20144 leader_election.cc:400] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16.
I20260709 12:19:42.952152 20144 leader_election.cc:403] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:42.962576 26154 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.548s	user 0.018s	sys 0.011s
I20260709 12:19:42.953608 25942 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:42.965296 25942 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.965764 25942 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:42.968484 26180 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16.
I20260709 12:19:42.924685 26087 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:42.915285 26212 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.978754 26212 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.980661 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:42.983301 26062 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:42.983582 26073 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:42.984045 26073 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:42.973482 26211 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:42.986027 26068 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:42.983731 26062 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:42.988582 26062 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:42.990626 26205 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 12:19:42.970985 21034 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:42.972287 26075 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.973187 20176 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:19:42.898329 25945 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.975524 26030 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.004202 26030 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:42.987005 26208 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.997273 26181 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:42.988152 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3430) took 1582 ms. Trace:
I20260709 12:19:42.973124 26223 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:43.009428 26208 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.009694 26223 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:43.009213 20329 rpcz_store.cc:276] 0709 12:19:41.405518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.434881 (+ 29363us) service_pool.cc:224] Handling call
0709 12:19:42.761779 (+1326898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:42.782496 (+ 20717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:42.987957 (+205461us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000cdd50. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:42.988090 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3050926848}
I20260709 12:19:43.010299 26223 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:42.984968 26073 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:42.976717 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:43.018278 20247 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
W20260709 12:19:43.008935 26138 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.001s
I20260709 12:19:43.011300 26223 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.013689 25945 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:42.930166 25883 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 12:19:42.998003 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49212.8us
W20260709 12:19:43.024919 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.017021 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:43.019416 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:42.970513 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:43.022976 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:43.027459 21036 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:43.031100 20176 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:43.030913 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:43.033990 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63599.2us
I20260709 12:19:43.036614 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.037294 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:43.038276 26181 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:43.038522 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.038834 26181 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:43.039274 26087 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.039490 26181 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:43.040215 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.040894 26087 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.041385 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.042126 26087 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:43.042557 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.043184 26087 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:43.044258 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.046708 26192 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:19:43.047168 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.048303 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.048642 26079 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:43.049275 26079 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:43.051335 26180 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:43.033742 25856 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:43.051440 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.054716 26180 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:43.055401 26228 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:43.055977 26228 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:43.056598 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.056408 26228 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.060739 25538 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:43.061339 25538 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.043938 26223 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:43.022539 26138 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.056164 25683 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:43.066565 25683 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.066962 25683 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.069840 26134 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:43.072939 26062 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.075331 26062 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:43.052716 25856 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.076195 25856 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.076696 26068 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:43.079777 21039 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:43.079610 26212 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.082480 26212 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.083925 25538 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.088878 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:43.091784 26068 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:43.092891 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.093472 20328 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:43.087288 20219 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.099202 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:43.102842 20176 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
W20260709 12:19:43.103549 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47019us
I20260709 12:19:43.102223 25538 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.117328 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:43.118335 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 73685.5us
I20260709 12:19:43.091297 26110 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.131960 20176 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:43.142175 26138 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.144923 26112 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:43.216277 26228 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.221424 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:43.221745 26228 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:43.222098 20176 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:43.223008 20255 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
W20260709 12:19:43.166016 20220 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.543s (SENT)
W20260709 12:19:43.218652 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 113573us
W20260709 12:19:43.217516 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 112987us
I20260709 12:19:43.218391 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:43.239882 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73932.2us
I20260709 12:19:43.145498 26110 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.248019 20174 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:43.249118 21034 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:43.231530 20176 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:43.258630 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.145468 26112 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:43.240693 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.212934 26030 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.283758 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.285506 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.289420 26228 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.245574 26174 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:19:43.297526 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.298878 20329 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:43.299255 26112 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.298951 26212 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:43.300472 26112 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.300601 26212 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:43.301152 26212 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.127115 26070 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.152s
I20260709 12:19:43.315821 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:43.317107 26116 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:43.317667 26116 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:43.289758 26138 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:43.318656 26116 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.321058 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.293157 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.317111 26211 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 12:19:43.333833 26224 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:19:43.281221 25945 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:43.287596 26178 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.158475 25942 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.245632 25923 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:19:43.347110 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55555.7us
W20260709 12:19:43.377876 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.402227 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.403411 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.404963 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:43.417968 20178 raft_consensus.cc:2376] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15. Re-sending same reply.
I20260709 12:19:43.420040 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.421181 20175 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.419245 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.287789 26030 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.425662 20178 raft_consensus.cc:2376] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15. Re-sending same reply.
I20260709 12:19:43.437892 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.337335 26186 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:43.413688 20172 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:19:43.429221 20220 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.780s (SENT)
W20260709 12:19:43.442574 20220 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.789s (SENT)
I20260709 12:19:43.443008 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.434235 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.435722 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.439844 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.448149 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.448393 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.449167 20177 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.449512 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.450062 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.450349 25656 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.450701 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.451184 25656 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.451884 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.451213 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.457114 25942 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:43.336680 25856 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.341466 25967 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:19:43.465683 21035 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:43.465734 26064 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:43.466361 26064 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:43.366700 26178 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.347543 26138 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:43.473878 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.471136 20178 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:43.475518 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.488750 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.445386 20328 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
W20260709 12:19:43.485455 20220 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.855s (SENT)
I20260709 12:19:43.499044 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.422744 26174 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:43.467527 26064 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.511861 20176 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:43.516481 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:43.521281 20249 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:43.521651 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.522380 20176 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.523057 20176 raft_consensus.cc:2368] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:19:43.524060 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.524679 20176 raft_consensus.cc:1813] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Handling vote request from an unknown peer e929b30888874ed59248f1229cecd3c6
I20260709 12:19:43.525323 20176 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.532174 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.532900 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.533407 26178 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.517673 25945 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:43.534662 26174 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.536998 26174 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.473326 25538 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:43.533713 20180 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:43.557737 20172 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:43.564222 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.565461 20249 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:43.565668 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.566402 20172 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:43.568339 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.569316 20180 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.570144 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.567313 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.552606 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.571870 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.572791 20180 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:43.581135 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:43.422739 26181 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.582270 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:43.583638 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.582958 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:19:43.588871 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:43.572700 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.572702 20172 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
W20260709 12:19:43.555665 26147 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:19:43.472272 26212 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:43.597380 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83997.7us
I20260709 12:19:43.598767 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.597458 26212 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.604883 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:43.510739 26119 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:19:43.579030 26064 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:43.545342 26080 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:19:43.622155 26181 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:43.606902 20171 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.607339 20172 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.605731 26030 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.628372 20171 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:43.612241 26241 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:43.629477 20177 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:43.600126 26032 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:43.634455 26032 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.636791 26032 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:43.649291 25683 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.002s
W20260709 12:19:43.656738 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:43.657480 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.662668 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:43.664222 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.665755 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.666368 21034 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.647300 25656 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:43.649895 25683 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.674901 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.675550 21036 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.676764 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.680229 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.680819 21037 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:43.687846 20248 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:43.687901 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:43.689680 21034 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:43.690645 21038 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:43.706327 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.711097 21037 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:43.716427 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.721637 25683 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.724866 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:43.726747 21038 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:19:43.728004 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 312101us
I20260709 12:19:43.737902 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.741588 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.744201 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:43.745424 20324 raft_consensus.cc:2410] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:19:43.748694 21008 leader_election.cc:336] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.656s (SENT)
I20260709 12:19:43.752378 20220 leader_election.cc:400] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:19:43.752525 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:43.753348 21037 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:43.714459 26181 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.735998 25538 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.740495 25683 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.738907 26138 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.747816 26192 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:43.753104 26186 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.748148 26062 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:19:43.780055 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 198332us
W20260709 12:19:43.779417 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.681s (SENT)
I20260709 12:19:43.788100 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:43.788668 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.752907 25945 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:43.791482 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:43.796074 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45959.2us
W20260709 12:19:43.802994 21008 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.701s (SENT)
W20260709 12:19:43.803133 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 101192us
W20260709 12:19:43.804402 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.711s (SENT)
I20260709 12:19:43.804874 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.806248 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.807008 20171 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:43.808236 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:43.811046 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.798590 25967 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.835865 20172 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:43.833630 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:43.832010 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 233775us
I20260709 12:19:43.848193 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:43.813365 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:43.851370 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.833777 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.853866 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.852927 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:43.783252 26181 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.858086 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.859153 20172 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:43.859898 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.860819 20324 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.862841 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.863525 20322 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.865862 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.833894 25966 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:43.786723 26138 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:43.806306 25683 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:43.809806 26228 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.805920 26062 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:43.789958 26186 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.873783 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.874938 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:43.854156 26216 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.879004 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:43.881897 20327 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:43.879753 20177 raft_consensus.cc:2368] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:19:43.876263 20172 raft_consensus.cc:2376] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14. Re-sending same reply.
I20260709 12:19:43.864456 26192 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.890630 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.895255 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:43.871008 26112 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.850768 25945 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:19:43.877440 26178 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:43.873165 25942 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:19:43.915071 20172 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:43.918689 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.910744 21036 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:43.923954 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.927503 20322 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:43.929705 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:43.901117 26112 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:43.938571 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47013us
I20260709 12:19:43.941052 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.881557 26228 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.949683 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.889642 26216 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:43.951692 20176 raft_consensus.cc:2376] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14. Re-sending same reply.
W20260709 12:19:43.954629 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 141345us
I20260709 12:19:43.955780 20176 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:43.959077 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:43.899307 25835 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:19:43.961544 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.938527 26257 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.966521 20177 raft_consensus.cc:2368] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
I20260709 12:19:43.945484 26178 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:43.968645 20171 raft_consensus.cc:2368] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17.
I20260709 12:19:43.969542 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.984233 26228 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:43.984805 26228 raft_consensus.cc:2764] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:19:43.985545 26216 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:43.990819 20327 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:43.993465 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:43.993760 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:43.997876 20177 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:44.000203 26032 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:44.001775 26253 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:19:44.002453 26181 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:44.005085 20180 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:44.005563 26073 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:44.006656 20180 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:19:44.010375 26178 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.014644 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:44.015262 20178 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:44.018345 26227 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.906s	user 0.000s	sys 0.006s
I20260709 12:19:44.019778 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2641) took 1257 ms. Trace:
I20260709 12:19:44.020126 20254 rpcz_store.cc:276] 0709 12:19:42.762472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.796899 (+ 34427us) service_pool.cc:224] Handling call
0709 12:19:42.797222 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:42.876255 (+ 79033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:42.876301 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:42.876833 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:19:43.231767 (+354934us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:43.231825 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.231918 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:43.986977 (+755059us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:44.019439 (+ 32462us) raft_consensus.cc:1685] finished
0709 12:19:44.019459 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:44.019704 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79832,"raft.queue_time_us":79475,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5030,"spinlock_wait_cycles":33871616,"thread_start_us":203797,"threads_started":1,"wal-append.queue_time_us":227440}
I20260709 12:19:43.968572 26259 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:44.049832 20178 raft_consensus.cc:2410] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:19:43.996905 26112 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:44.022516 26255 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:19:43.951413 26062 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.057548 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:44.036397 26246 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 12:19:44.084784 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.085934 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:43.987145 26257 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.047899 26138 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:44.065383 25856 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:44.068895 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:44.094081 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:44.094709 20247 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:44.092648 21041 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:44.034611 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.075153 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:44.096623 20253 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:44.076398 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.077191 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.098016 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:44.077487 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.079309 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.041772 26259 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:44.084649 20179 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:44.082015 25683 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:44.107494 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:44.108042 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 106982us
I20260709 12:19:44.100333 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.109717 20178 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:44.106232 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:44.112680 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.091914 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:44.116129 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:44.122884 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 123038us
I20260709 12:19:44.124099 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.126920 20247 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:44.134511 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.137327 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.138713 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:44.115302 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:44.143643 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:44.144104 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:44.144444 20250 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:44.107153 26186 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:44.131979 26064 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 12:19:44.152343 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.109540 26259 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:44.159106 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.161453 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.131907 25538 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:44.135941 26112 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:44.141556 26192 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.169647 21039 raft_consensus.cc:2410] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:44.132220 26258 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:44.173112 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.176865 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.149797 26138 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:44.145267 26260 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.191450 26257 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:44.172816 25945 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:44.154506 26261 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.195748 26119 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.148047 26181 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:19:44.203435 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.199692 26228 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:44.210372 20324 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
W20260709 12:19:44.242273 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 105016us
I20260709 12:19:44.243305 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:44.213842 20253 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:19:44.136678 25683 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.249780 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.251209 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:44.261317 20249 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:44.233824 26257 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:44.264746 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.264928 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.267445 20172 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:19:44.239637 26138 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:44.272792 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.273808 26228 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.275076 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:44.275915 26276 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:44.276460 26276 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:44.277403 26276 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.282411 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.283272 26228 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.285410 26261 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.239979 26258 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:44.289429 26258 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.293774 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1377) took 1223 ms. Trace:
I20260709 12:19:44.295598 20256 raft_consensus.cc:2410] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:19:44.294190 21035 rpcz_store.cc:276] 0709 12:19:43.070496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.070663 (+   167us) service_pool.cc:224] Handling call
0709 12:19:43.071062 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:43.466197 (+395135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.293537 (+827340us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400602f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:44.293711 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906934016}
I20260709 12:19:44.221477 26119 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.271390 26278 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:44.309093 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65861.3us
I20260709 12:19:44.312493 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:44.314625 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.317008 26271 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:44.317279 26273 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:44.317503 26271 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:44.317996 26271 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:44.318651 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.322289 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.325795 26119 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:44.330228 25683 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:44.332182 26274 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.332967 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:44.334367 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:44.336776 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:44.312860 26073 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:44.352669 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:44.321276 26273 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.270870 26138 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:44.388023 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 51855.2us
I20260709 12:19:44.347345 26278 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:44.351069 26261 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:44.373596 26073 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:44.439695 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.449935 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.430011 26122 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:44.438807 26278 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:44.446244 26073 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:44.463181 26257 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.464902 26112 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:44.454124 26122 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:44.450960 25945 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:44.456434 26192 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:44.503257 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.503683 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.504343 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.504679 20177 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:44.516398 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.519819 26122 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.521193 26278 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.523346 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.544708 20253 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:44.524096 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.526418 26181 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:44.529906 20326 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:19:44.533871 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2657) took 1497 ms. Trace:
I20260709 12:19:44.536777 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:44.548744 20248 rpcz_store.cc:276] 0709 12:19:43.036501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.036717 (+   216us) service_pool.cc:224] Handling call
0709 12:19:43.047278 (+ 10561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:43.705468 (+658190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.533660 (+828192us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54002fc954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:44.533812 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472658816}
I20260709 12:19:44.553932 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.543659 26258 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:44.558902 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.443608 25683 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 12:19:44.551499 26067 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:44.551314 26126 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:44.561513 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.533174 26259 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.559607 26261 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:44.568812 26122 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:44.527545 26271 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.571097 26276 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:44.560567 26277 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.555976 26181 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:44.588987 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 133959us
I20260709 12:19:44.583072 26261 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:44.591950 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.596057 20252 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
W20260709 12:19:44.581224 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.173s (SENT)
I20260709 12:19:44.597548 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.597893 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.598361 20254 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:44.578006 26258 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:44.604519 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.604606 20248 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:44.605469 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.606021 20253 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:44.611711 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.576102 26067 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.577427 26126 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.618304 21008 leader_election.cc:400] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
I20260709 12:19:44.618778 21008 leader_election.cc:403] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:44.621340 26223 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:44.629508 26067 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:44.610442 26192 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:44.610638 25798 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:44.634254 20175 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:44.618546 26159 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:44.591521 26261 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.646832 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:44.653106 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.618614 25967 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:19:44.654480 25967 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:44.654858 25967 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:44.655848 26181 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:44.639384 26217 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13.
I20260709 12:19:44.660403 26259 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:44.649114 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.671169 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:44.673606 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:44.674897 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.676090 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:44.677573 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:44.678833 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.679666 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.679456 20177 raft_consensus.cc:2376] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21. Re-sending same reply.
I20260709 12:19:44.680765 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.681790 20329 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:44.684249 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.642279 26266 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:19:44.685261 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:44.688865 20175 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:44.690478 26112 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.691511 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.642163 26192 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.697113 26192 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:44.699021 26271 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:44.675208 25798 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:44.661592 26260 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:19:44.703974 26064 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:44.704365 26064 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:44.705201 26064 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.705830 26218 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:44.706229 26126 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:44.706286 26218 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:44.706488 26064 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:44.710300 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.710937 20324 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:44.701511 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:44.715296 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:44.716502 25798 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:44.707315 26218 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.717795 26218 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:44.686455 26067 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:19:44.717003 25798 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.719856 25798 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:44.723482 25942 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:44.724043 25942 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.729995 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.730690 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
W20260709 12:19:44.733119 26291 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:44.733022 26067 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:44.734396 26067 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:44.735294 26067 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.736552 26067 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:44.732944 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.750222 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.750883 20254 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:44.750900 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:44.743701 25967 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.759336 25967 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:44.762452 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.764120 26073 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.765187 20247 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:44.767650 20254 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:44.769984 21037 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:44.773963 21042 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:44.775357 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:44.778990 20253 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:44.781808 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:44.785404 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:44.791298 20175 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:44.766263 26159 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:44.793959 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:44.803412 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:44.800491 26277 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:19:44.806268 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:44.811964 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:44.815759 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.816651 26260 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.817049 21008 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.817845 26260 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.832366 26126 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:44.833076 25538 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:44.833494 26126 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:44.833866 26126 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:44.834476 25683 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:44.835029 25683 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:44.836054 25683 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.780858 26138 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:44.839857 26138 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.792956 26276 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:44.841929 26138 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:44.833523 25538 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:44.843044 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:44.843315 25538 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.844698 25538 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:44.850937 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.849356 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:44.854897 21037 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:44.795300 26293 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:44.857713 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 172106us
I20260709 12:19:44.818562 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:44.862558 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44077.9us
I20260709 12:19:44.869828 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:44.874261 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.874321 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:44.882655 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.884235 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:44.885452 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:44.852113 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48933.1us
I20260709 12:19:44.886960 26216 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:44.868709 20321 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:44.890388 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2109) took 1043 ms. Trace:
I20260709 12:19:44.892379 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:44.890832 20321 rpcz_store.cc:276] 0709 12:19:43.847002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.847132 (+   130us) service_pool.cc:224] Handling call
0709 12:19:44.842869 (+995737us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b5800150698. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:19:44.890301 (+ 47432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5967104}
I20260709 12:19:44.898156 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:44.856204 26118 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:19:44.873306 26192 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:44.883131 26159 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:44.913890 26126 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.926223 26126 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:44.924672 21038 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:44.916025 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:44.935707 26031 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:44.936156 26031 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:44.936978 26031 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:44.938297 26031 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:44.860224 26293 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.942356 26293 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:44.945937 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:44.946223 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1033) took 1136 ms. Trace:
I20260709 12:19:44.946611 20176 rpcz_store.cc:276] 0709 12:19:43.809845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.965118 (+155273us) service_pool.cc:224] Handling call
0709 12:19:43.965428 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:44.035886 (+ 70458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:44.035924 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:44.036506 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:19:44.099225 (+ 62719us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:44.108648 (+  9423us) log.cc:844] Serialized 14 byte log entry
0709 12:19:44.108928 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.109030 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:44.927883 (+818853us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18003897a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b522 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:44.942925 (+ 15042us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b18003897a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dd92a6 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1
0709 12:19:44.943409 (+   484us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b18003897a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:44.946006 (+  2597us) raft_consensus.cc:1685] finished
0709 12:19:44.946028 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:44.946156 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15410,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":25152,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":17787,"spinlock_wait_cycles":28862976,"thread_start_us":99171,"threads_started":2,"wal-append.queue_time_us":74186}
I20260709 12:19:44.950768 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2669) took 1362 ms. Trace:
I20260709 12:19:44.950901 26293 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:44.951238 20249 rpcz_store.cc:276] 0709 12:19:43.588341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.588530 (+   189us) service_pool.cc:224] Handling call
0709 12:19:44.950537 (+1362007us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54002fce54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:44.950707 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544300800}
I20260709 12:19:44.953269 25798 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:44.955865 21039 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:44.883874 26178 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:44.956285 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:44.957053 20249 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:44.869240 26062 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 12:19:44.972074 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74040.1us
I20260709 12:19:44.968227 20249 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
W20260709 12:19:44.975076 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 77616.7us
I20260709 12:19:44.986563 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:44.974638 26263 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:44.994817 20321 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:19:44.962304 26178 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.962965 25798 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:44.968828 26259 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.969787 25945 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:45.011190 20251 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:45.013170 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:44.969129 26273 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:44.975013 26112 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.020119 21036 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:44.995296 25942 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.002152 26263 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:45.024135 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51009.4us
I20260709 12:19:45.007084 26178 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:45.030525 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 53640us
I20260709 12:19:45.025728 26273 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.046463 26273 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.029848 26278 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.052076 26278 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.054214 26278 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.031912 26112 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.058668 26131 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:45.059109 26131 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:45.060160 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:45.033540 26073 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.063804 26174 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:45.064182 26174 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:45.064540 26174 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:45.064433 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.024096 26261 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.065250 26217 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:45.065716 26261 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.068245 26131 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.069708 26131 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:45.033926 26263 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:45.076339 26250 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:45.077294 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64219.2us
I20260709 12:19:45.078243 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:45.080139 26062 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:45.080582 26062 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:45.080960 26062 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:45.083433 20174 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 12:19:45.084519 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49629.2us
I20260709 12:19:45.089218 20172 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:45.092864 26261 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.094053 26112 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.095297 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:45.060235 26210 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:19:45.097364 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.098403 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:45.100063 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.104887 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.107158 20174 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:19:45.107733 20174 pending_rounds.cc:85] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 6
I20260709 12:19:45.108095 20174 pending_rounds.cc:107] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:19:45.108482 20174 raft_consensus.cc:2889] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:45.101109 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:45.113376 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:45.114688 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:45.120293 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.124286 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:45.117771 25724 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:45.140852 20249 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:45.141224 21035 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:45.145896 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.099144 26217 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:45.146391 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 254104us
I20260709 12:19:45.115396 26210 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:45.111814 26278 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:19:45.166389 20329 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:45.124125 25580 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:45.112126 26064 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 12:19:45.175304 20328 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:45.193248 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.144570 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:45.177872 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:45.180876 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.119750 26293 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:45.183856 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:45.177443 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 43717us
I20260709 12:19:45.200069 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:45.205565 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 61083.3us
I20260709 12:19:45.206040 20077 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 13, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:45.220232 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.226969 26118 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:45.216944 26223 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:45.218498 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:45.181915 26276 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:45.232801 26276 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.181704 26260 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.237576 20330 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:45.192530 25580 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.251631 26223 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:45.252066 25656 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.253971 20330 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:45.259792 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.260555 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.261742 26217 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.185526 26138 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:19:45.263546 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:45.271970 26250 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
W20260709 12:19:45.275060 26306 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:19:45.279683 26296 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:19:45.272472 25580 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:45.512158 25967 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.511989 26119 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.514459 26223 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.275976 26260 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.537065 26276 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:45.271927 26303 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:19:45.516535 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 120145us
W20260709 12:19:45.516378 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 216568us
W20260709 12:19:45.527710 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 264271us
I20260709 12:19:45.530537 25538 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:45.529522 26133 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.543637 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.546511 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:45.551448 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:45.538753 26260 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.570979 21039 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:45.518451 25798 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:19:45.593963 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:45.521927 25656 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.545240 26119 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.602654 26119 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:45.541464 25967 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:45.606793 26174 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.002s
I20260709 12:19:45.608062 26073 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:45.633689 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 87733.6us
I20260709 12:19:45.553589 26133 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:45.642838 26312 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:19:45.607362 26174 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.626922 26271 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:45.664599 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:45.651862 26263 consensus_meta.cc:287] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.003s
I20260709 12:19:45.665136 25835 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:45.663491 26062 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.581s	user 0.016s	sys 0.000s
W20260709 12:19:45.657402 26178 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.000s
I20260709 12:19:45.706342 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.707365 20250 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:45.709825 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:45.706537 25835 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:45.719192 26313 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:45.672962 26263 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.708182 26062 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.739974 25835 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.725188 25872 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:45.711825 26178 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.744633 20324 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:45.737012 26216 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.752804 26062 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.754650 26174 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.756093 26260 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.767025 26263 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.763808 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:45.755960 26216 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.776757 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:45.770249 26260 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.785372 26317 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.785938 26317 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.788820 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:45.798669 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 620839us
I20260709 12:19:45.805630 26293 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:45.799414 26261 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:45.808290 26210 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:45.808720 26210 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.809051 26210 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:45.809306 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.810583 26317 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.816911 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:45.818285 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:45.818903 20180 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:45.825011 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:45.825672 20250 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:45.828006 26263 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.828503 26263 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.829123 26212 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:45.829564 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:45.830614 26263 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.830569 26212 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:45.830840 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:45.832023 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:45.834370 26258 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:45.835078 26258 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:45.835714 26258 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:45.837551 26276 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:19:45.844082 26133 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.845309 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:45.845952 20249 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:45.851640 26228 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:45.857991 20180 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:45.864120 25967 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.805123 26216 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.866505 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.872115 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:45.869700 25580 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.880671 20326 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:19:45.884895 25580 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.896071 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:45.897811 25724 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:45.898662 25724 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:45.899977 25724 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.905995 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:45.909238 26210 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.912047 26210 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:45.918676 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.923998 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:45.924300 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:45.924793 21039 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:45.925675 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:45.926410 21041 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:45.927495 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:45.929150 26217 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:45.930013 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:45.933491 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:45.938963 26071 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.939587 26071 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:45.943481 26071 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:45.946334 26138 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:45.946941 26138 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.949075 25656 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:45.955310 26324 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.956063 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.956180 26324 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:45.960088 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 126109us
I20260709 12:19:45.960593 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.961213 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:45.966166 21039 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:45.967712 21040 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:45.968182 26261 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:45.968758 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47210.4us
I20260709 12:19:45.968680 26261 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.972553 26261 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.974781 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:45.975698 26216 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:45.976078 26216 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.976150 20251 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:19:45.976478 26216 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:45.977240 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:45.980834 26260 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:45.984323 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.985076 20330 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:45.988965 26178 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:45.990070 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:45.991432 26178 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.992161 26178 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.995373 26178 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:45.996426 20324 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:19:45.998101 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.000329 26138 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.004483 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:46.004398 26260 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:46.004776 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:46.005249 20251 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:46.005923 26063 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:46.016799 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.017593 20180 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:46.017871 26324 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.019117 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:46.020179 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:46.021035 26223 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:46.021488 26223 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.021929 26223 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:46.021986 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:46.024838 26323 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:46.004379 26216 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:45.860190 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:46.030682 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.030613 20077 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:46.031477 20176 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:19:46.032866 20077 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 14, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:46.035329 20077 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 12, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 12 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.043468 26261 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:46.044189 26261 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.048840 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.049024 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.049853 20177 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:46.056600 26261 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.057756 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.046422 26216 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.047076 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.046653 20077 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 12 to 15, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:46.068408 20174 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:46.069173 25683 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:46.071332 26322 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:46.071909 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:46.072227 26322 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:46.072558 21036 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:46.073853 26138 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:46.074295 26138 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:46.077754 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:46.073764 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.075238 26138 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.080888 26138 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:46.076907 20077 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 11, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 11 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:46.082440 20077 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:46.083655 26271 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.084273 26271 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.084870 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:46.086730 26271 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.087352 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:46.077692 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:46.092279 20250 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:46.092700 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.094067 26063 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:46.095840 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.097640 20249 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:46.105738 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:46.106376 20324 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:46.109413 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:46.110486 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:46.111349 20250 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:19:46.110785 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.115399 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.108078 20077 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: config changed from index 8 to 11, VOTER e929b30888874ed59248f1229cecd3c6 (127.18.132.66) evicted. New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:46.109812 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:46.119877 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:46.122067 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:46.122862 21036 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:46.124197 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:46.150049 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:46.150760 20177 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:46.158044 20324 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:46.093988 20256 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:46.168012 20256 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:19:46.173617 20077 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 13, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 13 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:46.175307 20077 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 12 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:46.176843 20077 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 11 to 14, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:19:46.120883 26260 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:46.125387 25656 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:46.193483 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:46.202117 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 92390us
I20260709 12:19:46.202947 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:46.171864 26276 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:46.217737 20250 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:46.190905 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:46.220211 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:46.229707 20324 raft_consensus.cc:606] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.114166 26181 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:19:46.171644 26122 raft_consensus.cc:2764] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:19:46.214347 26261 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:46.229254 26276 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:46.252615 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:46.238492 26159 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.238070 26133 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:46.257865 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 141240us
I20260709 12:19:46.246261 26121 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:46.246503 26218 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:46.264088 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:46.250933 26063 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:46.270864 26271 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:46.227138 26223 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.258620 26276 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:46.258435 26324 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.277880 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:46.279312 20324 raft_consensus.cc:606] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:19:46.279829 20324 raft_consensus.cc:614] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:46.261894 26133 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.267812 26121 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.286574 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:46.261577 25967 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:19:46.266803 26318 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:46.292891 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.263736 26159 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.282612 26133 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:46.282321 26261 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.313781 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.286739 26121 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:46.287168 25835 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:46.281046 26271 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.303089 26174 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:46.287729 26324 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.292111 25856 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:46.323338 20325 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:46.337720 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:46.354758 20324 raft_consensus.cc:606] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.355093 20324 raft_consensus.cc:614] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:46.335798 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.338975 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:46.320544 26263 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:19:46.355419 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 95355.2us
W20260709 12:19:46.322992 26334 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:19:46.360693 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.321784 26318 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:46.336416 26073 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:46.368145 26181 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:46.340786 26261 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.409749 26324 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.414011 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:46.414851 21034 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:46.410615 26343 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:46.418457 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:46.419313 20324 raft_consensus.cc:606] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.420060 21035 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:46.416206 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:46.417184 26343 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.440596 26343 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.441367 26261 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.443223 26218 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:46.368716 25856 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.446466 26324 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:46.400575 26073 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.426656 26344 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:46.426667 26330 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 12:19:46.427489 26335 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:19:46.437057 26271 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.418577 26131 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.438262 26159 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.452291 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:46.455684 26218 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:46.455188 26318 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.467260 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:46.484014 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:46.461887 26338 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
W20260709 12:19:46.463115 26337 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 12:19:46.460603 26328 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 12:19:46.460800 26324 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.461293 25856 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.463318 26073 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.531483 26321 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.530761 26064 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.623721 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.624603 20327 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:46.466390 26131 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:46.663964 26327 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:19:46.585426 26324 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:46.470579 26121 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.620726 26212 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:46.464251 26344 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.663856 26322 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:46.716354 20324 raft_consensus.cc:606] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:46.719049 20324 raft_consensus.cc:614] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:46.719390 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.677834 26073 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:46.707624 26337 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:19:46.725494 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.620239 26276 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.717201 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.736335 20323 raft_consensus.cc:2393] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:46.738415 20249 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:46.739275 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:46.675608 26064 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.717962 26342 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.676106 26321 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.729487 26070 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:46.724341 26212 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.787727 26343 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:46.732393 26073 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.728099 26322 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:46.908282 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 207263us
I20260709 12:19:46.791265 26342 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:46.917068 26353 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:19:46.917294 26342 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.924881 26321 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.822146 26070 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.939323 26322 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.942229 26131 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:46.942449 26344 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.944494 26073 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.908010 26181 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:19:46.947794 26181 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:46.948442 26181 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:46.951764 26064 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:46.952486 26276 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:46.980638 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 71453.5us
I20260709 12:19:46.901119 26343 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:46.994164 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:46.995426 20249 raft_consensus.cc:2410] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:19:46.846223 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 140586us
I20260709 12:19:47.000675 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:47.010645 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:46.953423 26276 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:46.953359 26121 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:47.019392 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.020380 20326 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:47.024580 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.024857 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:47.025457 20326 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:47.034683 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.035485 21034 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:47.015977 26322 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.018504 26276 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:47.068050 26343 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.073535 26070 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:47.078955 26133 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.730s	user 0.000s	sys 0.010s
I20260709 12:19:47.079329 21038 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
W20260709 12:19:47.080994 26218 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
I20260709 12:19:47.081913 26212 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.085201 26324 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.055110 26138 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.050343 26360 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:47.092928 26181 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.054963 26322 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.096975 26218 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.100333 26276 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.101998 26276 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:47.102874 26218 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.104957 26322 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.106974 26324 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.012090 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:47.143972 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 131804us
W20260709 12:19:47.148209 20219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.68:38217 timed out after 1.904s (SENT) [suppressed 19 similar messages]
W20260709 12:19:47.168074 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 108070us
I20260709 12:19:47.099174 26138 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:47.179949 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.093896 26133 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.184865 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.185628 26133 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.186453 26138 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.188438 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:47.191596 26181 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:47.197296 25580 raft_consensus.cc:993] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:47.200269 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:47.203150 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:47.204546 26340 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.795s	user 0.005s	sys 0.017s
I20260709 12:19:47.205324 25683 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.211766 26271 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.225368 26271 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:47.230408 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.230814 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.231695 21037 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 7.
I20260709 12:19:47.232060 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:47.233276 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:47.234999 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.216477 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.236204 21039 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 7.
I20260709 12:19:47.221621 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.217595 26181 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.237673 26181 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.237897 20327 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 6.
I20260709 12:19:47.239283 25580 raft_consensus.cc:1081] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:47.240854 26271 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:47.242725 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1457) took 1051 ms. Trace:
I20260709 12:19:47.243294 21036 rpcz_store.cc:276] 0709 12:19:46.190908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.191083 (+   175us) service_pool.cc:224] Handling call
0709 12:19:46.191611 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:46.192136 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:46.192178 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:46.192825 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:19:46.272470 (+ 79645us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:46.272519 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.272592 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:47.203406 (+930814us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:47.242021 (+ 38615us) raft_consensus.cc:1685] finished
0709 12:19:47.242047 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.242438 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9937,"raft.queue_time_us":104,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":20279,"spinlock_wait_cycles":7440640,"thread_start_us":21801,"threads_started":1,"wal-append.queue_time_us":166565}
I20260709 12:19:47.248761 20324 raft_consensus.cc:2410] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:47.250030 26223 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:47.258550 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 91258.6us
W20260709 12:19:47.259613 21035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1441) took 2061 ms (client timeout 1904 ms). Trace:
W20260709 12:19:47.260191 21035 rpcz_store.cc:269] 0709 12:19:45.197612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.201992 (+  4380us) service_pool.cc:224] Handling call
0709 12:19:47.259117 (+2057125us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006815d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:47.259316 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534441856}
I20260709 12:19:47.222463 26318 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:47.224081 25683 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.261811 21038 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:47.267516 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:47.268998 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:47.288111 20255 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:47.282785 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 112149us
W20260709 12:19:47.291918 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 143970us
I20260709 12:19:47.295455 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:47.296669 20250 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:47.299208 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:47.302969 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:47.303977 20249 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:47.304409 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.306262 20327 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 6.
I20260709 12:19:47.312928 26133 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.313722 26133 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.316402 26133 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.316638 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:47.317312 26133 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.317469 20327 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:47.318197 26133 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.321020 26133 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.322894 26133 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.323698 26133 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.325205 26278 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.330588 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:47.331763 26071 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:47.331804 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:47.332273 26071 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.332656 25683 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.332677 26071 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.340677 26376 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:47.341156 26376 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:47.341527 26376 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:47.343871 26278 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:47.345343 26070 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:47.346925 26278 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.349511 26366 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.350062 26070 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.350502 26366 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.352710 26070 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.354822 26366 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.354717 26181 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.356875 26181 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.362172 26364 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:47.363075 26364 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:47.364637 26364 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.374939 20323 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 21. Current term is 22. Ops: []
I20260709 12:19:47.375684 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 847) took 1225 ms. Trace:
I20260709 12:19:47.377043 25683 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.377887 25683 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.379766 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:47.380613 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 68586.3us
I20260709 12:19:47.383086 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:47.384452 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:47.385445 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.389246 21038 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:47.386752 20250 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:47.396025 26271 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.396852 26271 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.399317 26271 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.402412 26181 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.402362 26278 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.414176 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:47.381697 25683 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.416424 20247 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:19:47.420096 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 91179.9us
I20260709 12:19:47.421826 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:47.422713 20255 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.423180 20249 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:47.424928 26347 raft_consensus.cc:993] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:47.425565 26347 raft_consensus.cc:1081] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:47.421836 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.430531 26366 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.431383 26366 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.433794 26366 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.434294 26366 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.434886 26366 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:47.435707 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.030s	sys 0.046s
W20260709 12:19:47.436131 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.030s	sys 0.046s
W20260709 12:19:47.436471 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.07533e+06us
I20260709 12:19:47.447655 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:47.447811 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:47.448527 21042 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11. Re-sending same reply.
I20260709 12:19:47.448637 21037 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.376340 21040 rpcz_store.cc:276] 0709 12:19:46.150069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.151058 (+   989us) service_pool.cc:224] Handling call
0709 12:19:46.151337 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:46.151591 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:19:46.666166 (+514575us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.881540 (+215374us) log.cc:844] Serialized 14 byte log entry
0709 12:19:47.193949 (+312409us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b1800294e80. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b522 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:47.208727 (+ 14778us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b1800294e80. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:19:47.290822 (+ 82095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:47.294515 (+  3693us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:47.312035 (+ 17520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:47.323801 (+ 11766us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b1800294e80. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:47.327651 (+  3850us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.375410 (+ 47759us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":694100,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":116,"raft.queue_time_us":45060,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":18444,"spinlock_wait_cycles":84733952,"thread_start_us":718963,"threads_started":3,"wal-append.queue_time_us":433797}
I20260709 12:19:47.451783 26138 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:47.452371 26138 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.452723 26138 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:47.453744 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.454394 20177 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:47.454516 21036 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:47.414966 26318 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.460253 26318 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:47.463438 21037 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:47.463824 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:47.473759 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:47.429327 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.476153 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:47.476658 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:47.476926 20328 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.477314 26278 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.479790 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.481648 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:47.482316 20174 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:47.486191 26126 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:47.486804 26126 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:47.489818 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52515.4us
I20260709 12:19:47.493619 26344 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:47.495463 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:47.403429 26181 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.496672 26343 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:47.497076 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.498090 26112 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.498275 26181 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.498847 26112 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.499951 26359 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.500640 26359 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.500989 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:47.502972 26359 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.503098 25683 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.503901 25683 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.506134 25683 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.506290 26112 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.512710 20174 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
W20260709 12:19:47.523955 20076 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 309) took 24711 ms (client timeout 15000 ms). Trace:
I20260709 12:19:47.526247 26376 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.527369 20256 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:47.528720 25642 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:47.538378 25642 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:47.539546 25642 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.548360 26133 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.549573 26278 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.550282 26278 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:47.553081 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.554519 20178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:47.555298 20178 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:47.555765 20178 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.560365 26263 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:47.561015 26263 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.566753 20328 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:47.569149 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:47.571197 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.571331 20178 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.572502 20327 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:47.530526 26181 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.573875 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.551034 26278 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.592275 20255 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:47.595242 20178 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.600570 26181 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.602948 26181 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.603606 26276 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:47.604317 26276 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.606832 26276 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.613540 20219 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:47.614753 26344 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:47.615397 26344 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:47.616355 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:47.616585 26344 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.573691 26126 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.596966 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.665688 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:47.670841 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:47.683806 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.651118 26276 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:47.676611 26347 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:47.680112 26322 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:47.711867 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:47.524453 20076 rpcz_store.cc:269] 0709 12:19:22.812063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.812353 (+   290us) service_pool.cc:224] Handling call
0709 12:19:47.523601 (+24711248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:36.004335 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:36.005250 (+   915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:36.005302 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:19:36.005330 (+    28us) tablet.cc:662] Decoding operations
0709 12:19:36.007536 (+  2206us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:36.007649 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:36.007691 (+    42us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:19:36.009465 (+  1774us) tablet.cc:701] Row locks acquired
0709 12:19:36.009485 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:19:36.009689 (+   204us) write_op.cc:270] Start()
0709 12:19:36.009852 (+   163us) write_op.cc:276] Timestamp: P: 1783599576009615 usec, L: 0
0709 12:19:36.009883 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:19:36.096003 (+ 86120us) log.cc:844] Serialized 7104 byte log entry
0709 12:19:36.270046 (+174043us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b
0709 12:19:37.278188 (+1008142us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18001e37c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:37.698584 (+420396us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:19:37.935910 (+237326us) op_driver.cc:464] REPLICATION: finished
0709 12:19:38.098218 (+162308us) write_op.cc:301] APPLY: starting
0709 12:19:38.098351 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:38.219136 (+120785us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:38.219186 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:40.371895 (+2152709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:40.543714 (+171819us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:19:40.543768 (+    54us) write_op.cc:312] APPLY: finished
0709 12:19:40.544331 (+   563us) log.cc:844] Serialized 164 byte log entry
0709 12:19:40.671441 (+127110us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:40.712811 (+ 41370us) write_op.cc:454] Released schema lock
0709 12:19:40.771005 (+ 58194us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:41.459863 (+688858us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b18001e37c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b522 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:19:41.460056 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.460100 (+    44us) write_op.cc:454] Released schema lock
0709 12:19:41.743652 (+283552us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
Metrics: {"mutex_wait_us":2239291,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":120504,"apply.run_cpu_time_us":58472,"apply.run_wall_time_us":2758235,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79475,"num_ops":18,"prepare.queue_time_us":49360,"prepare.run_cpu_time_us":42931,"prepare.run_wall_time_us":375621,"raft.queue_time_us":124216,"raft.run_cpu_time_us":20112,"raft.run_wall_time_us":115909,"replication_time_us":1925787,"spinlock_wait_cycles":142914688,"thread_start_us":569351,"threads_started":5,"wal-append.queue_time_us":543084,"wal-append.run_cpu_time_us":20941,"wal-append.run_wall_time_us":3522751}]]}
I20260709 12:19:47.708986 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:47.713135 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.707724 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:47.679644 26071 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.704730 26126 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:47.695005 26271 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.716490 25798 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:47.732806 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.726742 26126 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.741940 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:47.750763 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.719511 26276 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.748624 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.744084 26126 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:47.761385 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 79780.5us
I20260709 12:19:47.762120 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:47.744339 26366 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.760385 26391 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.752849 26250 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:47.735016 26347 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.781064 25942 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.781849 25856 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.016s
I20260709 12:19:47.782248 26071 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.782768 25856 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:19:47.783116 25856 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:47.784116 25856 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.784286 26138 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.785410 25856 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:47.766845 26359 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.788120 26359 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.789762 26347 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.790548 26359 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.790954 26212 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:47.791971 20179 raft_consensus.cc:2368] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:47.792050 26250 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.781124 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.747664 25798 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.794530 26250 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.756978 25656 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:47.807790 26389 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:19:47.816159 26138 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.817083 26364 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:47.817793 26364 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.805107 26112 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.820712 26112 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.746083 26322 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.828382 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.842216 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.847043 26276 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.847903 26278 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.848637 26392 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.849289 26392 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.851749 26392 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.760636 26271 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:47.833374 26351 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:19:47.854172 26271 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.806845 26318 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:47.855310 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 116375us
I20260709 12:19:47.781818 25942 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:47.836369 26381 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:19:47.824168 26263 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.858901 25942 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.840929 25798 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.861644 26322 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:47.805985 26366 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:47.827808 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:47.867669 26387 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.004s
I20260709 12:19:47.874439 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:47.856927 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:47.876569 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:47.878013 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:47.878924 26278 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:47.879333 26278 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.879760 26278 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.879832 26366 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:47.880300 26366 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.880707 26366 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.882041 26271 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:47.882688 26271 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.884552 26112 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.825054 26393 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:47.887929 26112 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:47.888145 26393 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:47.888657 20177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:47.888509 26112 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:47.889308 20177 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:47.889832 20177 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:47.889226 26393 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.890935 26112 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:47.901312 26278 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:47.902220 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 81270.7us
I20260709 12:19:47.952149 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:48.172590 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 168464us
I20260709 12:19:47.933084 20177 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:47.944295 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:47.966199 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:48.230770 20255 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:47.836462 26344 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:47.917052 26322 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:48.060953 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.238271 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:48.194245 25656 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.239373 20324 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:48.240574 20180 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
W20260709 12:19:48.237123 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.196448 26388 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 12:19:48.061960 26376 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:48.249054 20177 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:48.193920 26392 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.208873 26260 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.952303 26278 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.256223 20172 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:48.246433 26276 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:48.257381 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:48.256237 25656 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.258208 26322 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:47.861696 26364 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:48.262743 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.243750 26344 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.264070 20171 raft_consensus.cc:2368] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:48.267122 20178 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:48.267819 26276 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:48.267969 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.268045 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:48.268991 26260 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.254365 26138 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.286155 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.286087 26138 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:48.286880 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:48.286940 20247 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:48.288550 26138 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.284147 20180 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:48.227859 26391 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.285356 20252 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:48.294554 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.279585 26392 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.296751 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:48.290437 26276 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.272651 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.276623 20179 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:48.276628 26344 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:48.303303 20176 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:48.310513 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.319250 21036 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:48.304167 26318 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.323527 20249 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:48.326696 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.336818 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:48.337486 20330 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:48.338438 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.317586 26271 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.355926 26321 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
W20260709 12:19:48.350099 25856 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.003s
I20260709 12:19:48.367967 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.371160 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:48.375366 26263 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:48.381326 21040 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:48.380704 20256 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:48.384019 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:48.384631 20249 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:19:48.389108 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.391603 20176 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:48.358899 25798 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:19:48.398722 20255 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:19:48.401315 21035 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:48.402163 20179 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:48.404198 20174 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:48.405516 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:48.406164 20179 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:48.362286 26322 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:48.386349 25942 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:19:48.433199 21036 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:48.436808 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:48.438808 20295 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:48.440128 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.418751 26394 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:19:48.442175 20176 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:19:48.444365 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:48.436640 26212 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.001s
I20260709 12:19:48.459421 20179 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:48.443604 26276 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:48.464006 20249 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:48.448837 25656 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.448681 26212 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:48.463227 25942 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:19:48.474534 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54555.2us
I20260709 12:19:48.483165 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:48.484226 25942 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:48.487419 26126 consensus_meta.cc:287] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.705s	user 0.008s	sys 0.005s
I20260709 12:19:48.491889 26212 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:48.500627 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:48.505415 26366 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.004s
I20260709 12:19:48.508118 25656 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:48.519047 20330 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:48.519960 26366 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:48.520103 25656 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.522356 26366 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.522501 25656 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.496594 26126 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.558698 21038 raft_consensus.cc:2368] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:48.560631 26126 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.524480 25942 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:48.561038 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.549017 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.549599 26392 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:48.550829 26260 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:48.551517 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.551970 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:48.568673 20256 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:48.552938 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.569432 21037 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:48.556205 26391 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:48.563033 20249 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:19:48.581004 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134685us
I20260709 12:19:48.535022 26344 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.582147 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:48.590466 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:48.591147 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.591377 20247 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:19:48.591835 20250 raft_consensus.cc:2376] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16. Re-sending same reply.
I20260709 12:19:48.598448 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:48.601922 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 260704us
I20260709 12:19:48.607496 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.610354 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.623692 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:48.624329 21036 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:48.624715 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.623797 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.623804 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.623217 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:48.637277 20251 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:48.603668 26212 raft_consensus.cc:2764] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:19:48.642195 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.643654 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.643687 20249 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:48.644376 21040 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:19:48.648469 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.648191 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.654181 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.648875 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.659686 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.660095 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.660563 26344 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:48.660883 26403 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:48.642233 26391 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:48.663424 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:48.655160 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:48.622737 25798 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:19:48.664932 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67714.4us
I20260709 12:19:48.671267 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.671476 21041 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:48.646014 25656 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:48.672483 20252 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:48.674201 25656 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:19:48.678248 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.678797 26276 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.679383 26276 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:48.681007 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:48.681651 20330 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:48.681826 26276 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:48.682848 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:48.683902 26391 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.648419 20073 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.684353 26391 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:48.684594 21042 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:48.685606 20073 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 15, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.686827 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:48.673295 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:48.674782 25656 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:48.688537 21040 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:48.670763 21036 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:48.691879 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:48.690428 20330 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 8.
I20260709 12:19:48.693305 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.687541 20073 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 14, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.693782 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:48.691939 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:48.701463 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:48.698746 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 106757us
I20260709 12:19:48.703644 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:48.710124 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:48.715672 21042 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:48.719787 25856 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:48.720463 25856 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:48.721510 25856 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.695515 25656 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.723711 26212 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:48.724326 26212 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.725912 20321 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:19:48.732609 21040 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:48.730060 20073 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 10, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.735751 26276 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:48.736403 26276 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.738763 20256 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:48.741078 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.741421 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.742093 20179 raft_consensus.cc:2368] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16.
I20260709 12:19:48.742861 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.742508 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.746047 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:48.748570 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:48.748740 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.749485 25798 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:48.749756 26276 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:48.749862 25798 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:48.743269 26250 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:48.750362 25798 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:48.751019 26212 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:48.751750 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60051us
I20260709 12:19:48.754015 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:48.759198 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.764827 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.760691 20073 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 17 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:48.779090 26397 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:48.782379 21042 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:48.787768 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:48.790835 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:48.790944 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:48.763739 26250 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:48.789654 20073 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:48.800894 20177 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:48.819178 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.820669 20073 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.812036 26344 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:48.837811 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.857959 20073 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.836786 26344 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:48.901829 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.899071 20073 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 13, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 13 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.908984 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:48.920490 20177 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:48.923553 20295 leader_election.cc:400] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:48.925715 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:48.927843 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:48.924360 20073 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.931890 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:48.857421 26406 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:19:48.937211 20073 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 16, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:48.927083 25942 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:48.955205 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:48.948645 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 87160.5us
I20260709 12:19:48.994019 20295 leader_election.cc:400] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:48.994701 20295 leader_election.cc:403] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:19:48.994948 26344 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.996235 26376 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:48.997886 26376 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:49.001327 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 69976us
I20260709 12:19:48.954032 26405 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:48.957630 26401 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:49.007625 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.009192 20073 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.948370 25798 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:48.992911 26322 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.002590 26347 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:49.004055 26276 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.010650 25942 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:49.011261 26401 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:19:49.032122 20077 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 312) took 21834 ms (client timeout 15000 ms). Trace:
I20260709 12:19:49.032198 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.013134 26362 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:49.015805 20073 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:49.039328 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45519.1us
W20260709 12:19:49.047600 26409 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.220s	user 0.000s	sys 0.007s
I20260709 12:19:49.048485 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.051041 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.051718 20172 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:49.051949 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.052752 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.053375 20171 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:49.055541 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:49.055967 26408 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:19:49.056200 20178 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:49.036435 26212 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.058007 26212 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.059623 26322 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.060884 26212 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.031317 25942 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:49.061367 26366 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.061832 26322 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.062019 26366 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:49.084005 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75865.7us
I20260709 12:19:49.038304 26401 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:49.095039 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.038101 26362 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:49.029487 26391 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.119597 26391 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.125113 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.125844 20172 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:19:49.062325 25942 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.128222 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:49.129478 26366 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.089982 26322 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.105569 20174 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:49.116168 26362 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.130609 26322 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.130118 20173 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:49.099457 20073 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.123155 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.143648 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.148896 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.152496 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.153210 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.154542 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.155197 20178 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:49.147650 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:49.160123 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.081262 26276 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.165834 25798 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.171895 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.173677 26322 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.155265 20073 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:19:49.037174 20077 rpcz_store.cc:269] 0709 12:19:27.108677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.111728 (+  3051us) service_pool.cc:224] Handling call
0709 12:19:27.291527 (+179799us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5de0cb6e9c 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:19:48.939933 (+21648406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:46.793764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:46.824446 (+ 30682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:46.824504 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:19:46.824539 (+    35us) tablet.cc:662] Decoding operations
0709 12:19:46.927012 (+102473us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:46.927125 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:46.927169 (+    44us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:19:46.939380 (+ 12211us) tablet.cc:701] Row locks acquired
0709 12:19:46.939450 (+    70us) write_op.cc:260] PREPARE: finished
0709 12:19:46.939772 (+   322us) write_op.cc:270] Start()
0709 12:19:46.940001 (+   229us) write_op.cc:276] Timestamp: P: 1783599586939663 usec, L: 0
0709 12:19:46.940036 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:19:46.941106 (+  1070us) log.cc:844] Serialized 4397 byte log entry
0709 12:19:47.108284 (+167178us) op_driver.cc:464] REPLICATION: finished
0709 12:19:47.109558 (+  1274us) write_op.cc:301] APPLY: starting
0709 12:19:47.109644 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:47.414790 (+305146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:47.517930 (+103140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:47.667309 (+149379us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:47.725628 (+ 58319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:19:47.730903 (+  5275us) write_op.cc:312] APPLY: finished
0709 12:19:47.819954 (+ 89051us) log.cc:844] Serialized 105 byte log entry
0709 12:19:47.820304 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:47.820823 (+   519us) write_op.cc:454] Released schema lock
0709 12:19:47.820911 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:47.821648 (+   737us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:47.821682 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":825925,"reported_tablets":47,"spinlock_wait_cycles":305471744,"child_traces":[["op",{"apply.queue_time_us":1013,"apply.run_cpu_time_us":21944,"apply.run_wall_time_us":711926,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50173,"num_ops":11,"prepare.queue_time_us":418976,"prepare.run_cpu_time_us":17155,"prepare.run_wall_time_us":318090,"raft.queue_time_us":27853,"raft.run_cpu_time_us":1300,"raft.run_wall_time_us":1325,"replication_time_us":168061,"thread_start_us":341199,"threads_started":4,"wal-append.queue_time_us":119296,"wal-append.run_cpu_time_us":16367,"wal-append.run_wall_time_us":1758057}]]}
W20260709 12:19:49.190896 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 259229us
I20260709 12:19:49.193333 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.194206 26421 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:49.148622 26411 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:49.148051 26418 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:49.176249 26362 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:49.152592 26397 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.200124 20073 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 15 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.206058 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:49.206363 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.212281 20177 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:49.213367 20175 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:49.214093 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.210878 20073 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.191675 25656 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.217430 26423 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:49.218573 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.223307 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:49.208207 26322 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:19:49.201793 26411 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.241081 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.235466 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:49.242785 21036 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:49.243669 20177 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:49.231144 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:49.229774 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:49.219527 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.225447 26423 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.254647 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.227720 26376 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:49.232292 26212 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:49.256943 20073 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.260635 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:49.255681 20177 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:19:49.261857 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.228494 26276 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:49.267493 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.272454 20073 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.274123 20073 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.254190 26344 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:49.251650 26421 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:49.253777 26423 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:49.229007 26425 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:19:49.216256 26397 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.305545 20073 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.305012 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:49.238664 25656 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.276800 26394 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:49.219801 26418 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.314055 20173 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 8: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:49.314761 20073 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 17, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.319897 20329 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:49.304553 26212 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:49.332041 26428 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:49.328755 26366 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:49.338251 21036 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:19:49.331084 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 53099.6us
I20260709 12:19:49.347615 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:49.356114 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:49.309752 26421 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:49.365307 20073 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 4 to 6, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 6 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:49.366974 20073 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 17 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:49.377586 26411 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:49.378759 26421 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:49.379796 26407 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.539s	user 0.003s	sys 0.000s
I20260709 12:19:49.372251 20073 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.385166 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:49.386442 26418 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.364554 26392 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:49.388012 25656 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.388833 26212 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:49.393404 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109318us
I20260709 12:19:49.400847 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:49.402798 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:49.403750 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 163512us
I20260709 12:19:49.391479 25942 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:49.383138 26428 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:49.417088 20073 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 7 to 12, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 12 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:49.391191 26401 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.421962 26423 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.423815 26417 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:49.426167 20176 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:49.393287 26392 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:49.421000 20073 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 12, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.434916 20073 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.435948 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:49.436482 20073 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:49.407128 26322 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.444624 26322 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.445109 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.446892 26322 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.447808 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.447544 26428 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.442910 26423 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.443379 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.462064 20294 leader_election.cc:400] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 7 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 7. Current term is 8.
I20260709 12:19:49.442987 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.456246 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.463615 20256 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:19:49.463773 26362 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:49.464273 26362 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.466257 26362 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.467015 26376 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:49.444023 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.452837 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.456211 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.456959 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.469508 20321 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:49.457137 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54440.7us
I20260709 12:19:49.457731 26397 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:49.459075 20253 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:49.438665 20073 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 15, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.475432 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.480259 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.484344 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.484450 26418 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:49.485932 21036 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:49.486334 21038 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:19:49.487469 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:49.497371 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44621.3us
I20260709 12:19:49.498164 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.499048 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.500957 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.501134 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.502028 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.453238 26263 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.507001 20323 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:49.506083 20073 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:49.540475 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.541247 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.541698 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.541976 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.542671 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.562320 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.563115 20330 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:19:49.544544 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.547922 26271 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:49.529665 26322 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:49.553388 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.485611 26392 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.564925 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.566622 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.581516 20328 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 8: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:49.583842 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.584277 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.586006 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.586961 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.589697 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.581857 26405 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:19:49.590551 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.591292 26405 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:49.591672 26405 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:49.489675 26376 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:19:49.592602 26405 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:49.593324 26376 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:49.593698 26376 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:49.593796 26405 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:49.594599 26376 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.582016 26397 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:49.595885 26376 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:49.595955 26397 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:49.596526 26397 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:49.506212 26126 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:49.581110 26263 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:49.592619 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 90666.8us
I20260709 12:19:49.602041 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.602671 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet ae0621ca652d416d9284323ec7eb2363 with delete_type TABLET_DATA_TOMBSTONED (TS e929b30888874ed59248f1229cecd3c6 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36730
I20260709 12:19:49.604243 26401 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.604940 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.577323 20321 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
W20260709 12:19:49.556061 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55906us
I20260709 12:19:49.577793 26423 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:19:49.606379 20329 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:19:49.576565 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74318.3us
W20260709 12:19:49.631918 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46003.3us
I20260709 12:19:49.633119 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.638317 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.639231 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:49.642398 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:49.643011 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.646136 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.646818 26431 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:49.640493 26423 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:49.648995 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.652477 20220 leader_election.cc:400] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16.
I20260709 12:19:49.652794 20220 leader_election.cc:403] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:49.610857 25942 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:49.656538 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:49.656325 25942 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.657702 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.658996 25942 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:49.659742 26263 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:49.666431 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:49.663450 20325 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:49.672816 26276 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:49.673262 26276 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.673645 26276 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:49.612792 26271 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:49.678704 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.681310 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:49.682835 26366 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:49.684772 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.685581 26435 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16.
I20260709 12:19:49.685767 26322 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:49.686260 26322 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:49.688876 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.689613 20171 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:49.677006 26428 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:49.690817 26212 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:49.691265 26212 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:49.691617 26212 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:49.692180 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.651201 26260 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.694618 26260 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.614029 26391 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:19:49.719946 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:49.723057 21040 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:49.719988 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.714208 26447 tablet_replica.cc:333] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:19:49.725214 21038 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:49.675205 26431 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:49.726011 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 93209.8us
W20260709 12:19:49.724694 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 114402us
I20260709 12:19:49.729591 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.737164 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.736608 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.738502 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:49.740427 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.735126 20324 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:49.741287 26271 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:49.741508 26366 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:49.748790 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.755791 26431 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:49.756785 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.782532 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.687238 26322 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.760769 26260 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:49.771066 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.771544 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:49.784765 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.785329 20324 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:49.787364 20325 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:49.788865 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.797060 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.798408 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.801364 26453 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:49.807076 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.829355 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:49.791204 26417 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:49.841816 26392 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:49.796334 26366 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:49.846755 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:49.791337 26428 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:49.849370 20324 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:49.836169 25683 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:49.802148 26271 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:19:49.830251 26394 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:49.859872 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:49.876097 20325 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:19:49.873628 26428 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:49.858551 26392 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.880069 26430 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:49.880515 26400 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.878034 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.872228 25798 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:19:49.904248 26392 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:49.924633 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 117658us
I20260709 12:19:49.928697 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.876971 26397 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.915097 26439 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:49.934311 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.935675 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:49.939174 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109887us
I20260709 12:19:49.931131 26423 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:49.922032 25656 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:19:49.940063 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:49.961922 21038 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:49.912114 26400 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:49.960564 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:49.941895 26423 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:49.942247 26456 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:49.949087 26447 raft_consensus.cc:2243] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:49.979264 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:49.980825 25967 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:49.970436 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:19:49.984131 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 48560.8us
I20260709 12:19:49.961123 26417 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:49.952883 26439 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:49.986694 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:49.946165 26455 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:49.994493 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:49.995528 26430 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:49.997334 26456 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:49.941269 26276 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:49.976486 26457 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:50.013338 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:50.005306 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:50.007470 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:50.016239 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:50.017990 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:50.015242 25967 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:19:50.019388 21041 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
W20260709 12:19:50.020761 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50443.2us
I20260709 12:19:50.021484 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:50.016227 21043 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:50.023459 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:50.025063 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:50.025671 20180 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:50.005511 26428 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:50.037721 26322 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:50.015439 26126 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:50.022249 25967 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:50.022627 26430 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:50.019474 26344 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:50.023018 26423 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:50.015825 26457 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:50.123368 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 97233.3us
W20260709 12:19:50.123404 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 96564.1us
I20260709 12:19:50.024956 26393 raft_consensus.cc:2764] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:19:50.024780 26250 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:50.031535 26431 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:50.130897 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:50.135813 26250 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.145910 26250 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.131986 26457 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:50.012087 26455 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.151871 26439 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.152879 26276 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.155426 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:50.158367 20176 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:50.158478 20172 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:50.159420 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.159647 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.160284 20177 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:19:50.122442 25967 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:50.162603 26423 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:50.162861 26455 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.120334 26126 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:50.164517 26126 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.176831 20324 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:50.181782 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:50.183471 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:50.165817 26126 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:50.186028 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55269.8us
I20260709 12:19:50.187327 21036 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:50.192318 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:50.192337 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:50.194485 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 169271us
I20260709 12:19:50.127764 26344 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:50.194792 26212 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 12:19:50.205410 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.135644 26447 raft_consensus.cc:2272] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:50.205684 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.207758 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:50.208199 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:50.208377 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:50.198814 26344 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.214032 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.211761 20251 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:50.133309 26467 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:19:50.209687 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:50.198616 26431 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:50.204228 25683 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:50.204895 26397 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:50.197382 26393 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:50.222024 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.215240 26411 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:50.236306 20321 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:50.209195 26430 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:19:50.220213 26347 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:50.213984 26366 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:19:50.222179 26322 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:50.210632 26212 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.225653 26418 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:50.223783 26393 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:50.218586 26406 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:19:50.261986 26212 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.262128 26393 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:50.256508 26400 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.241763 26347 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:50.264058 26347 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:50.267897 26406 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:50.268301 26406 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:50.268702 26376 consensus_meta.cc:287] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.672s	user 0.006s	sys 0.006s
I20260709 12:19:50.269147 26406 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.270551 26406 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:50.226367 25683 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.277626 25683 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.278378 25967 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:50.281729 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59795.7us
I20260709 12:19:50.282805 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.278944 26447 ts_tablet_manager.cc:1916] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:50.273334 26466 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:50.294449 25683 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:50.294909 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.305729 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.311009 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:50.318902 26430 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:50.332296 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.335398 21036 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:50.336031 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.336284 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:50.336900 20253 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:50.335297 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:50.337569 20323 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:50.322614 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.324240 26159 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:50.324681 26397 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:50.328775 25967 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.329193 21035 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:50.356364 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.357033 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:50.357409 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.357657 20177 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:50.352615 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.362219 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.310675 26466 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:50.365571 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:50.335094 26391 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:50.364641 26394 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:50.362231 26467 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:50.372524 26431 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:50.375798 26438 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:50.369537 26271 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:19:50.406618 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.409803 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:50.414232 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48740.2us
I20260709 12:19:50.416567 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.389081 26461 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:50.428788 20172 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:19:50.429761 20172 pending_rounds.cc:85] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 11
I20260709 12:19:50.419642 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.430930 25683 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:50.431300 25683 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:50.389752 26466 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:50.355335 26457 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.441648 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:50.429997 20172 pending_rounds.cc:107] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:19:50.457024 20174 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:19:50.457408 20172 raft_consensus.cc:2889] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:50.407640 26435 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:50.442251 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:50.465271 20328 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:19:50.443514 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:50.438254 21043 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:50.455482 20253 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:19:50.459407 20177 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:50.462980 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.418622 25942 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:19:50.475402 20176 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:50.465546 25683 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.478134 25683 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:50.474704 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 70225.1us
I20260709 12:19:50.488969 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:50.490094 20250 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:19:50.499357 20328 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
W20260709 12:19:50.496256 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 87777.6us
I20260709 12:19:50.513590 26470 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:50.514128 26470 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:50.514528 26470 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:50.521220 20174 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:19:50.481503 25798 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:50.524916 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:50.550487 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:50.552701 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 62607.6us
I20260709 12:19:50.556041 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:50.557255 26393 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.559904 20249 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:50.561020 26393 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.565117 26457 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.568321 26347 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.569041 26466 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.570557 26347 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:50.573486 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:50.571318 26466 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.581188 20252 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:50.584102 20325 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:19:50.585887 20325 pending_rounds.cc:85] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 11
I20260709 12:19:50.586232 20325 pending_rounds.cc:107] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:19:50.586491 20325 raft_consensus.cc:2889] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:50.550716 26392 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.616s	user 0.013s	sys 0.000s
I20260709 12:19:50.594826 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:19:50.598205 20253 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:50.602283 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:50.653786 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:50.654359 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 189407us
I20260709 12:19:50.654712 25683 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:50.662680 26478 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:50.596688 26276 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:50.680045 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:50.584916 26425 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:19:50.614751 26428 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:50.704898 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:50.716455 26276 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.719588 26276 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:50.732936 26401 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:50.738073 26401 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:50.734768 20249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:36746
I20260709 12:19:50.738826 20249 raft_consensus.cc:606] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.739177 20249 raft_consensus.cc:614] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:50.598479 26392 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.697131 26461 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:19:50.616210 26344 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.791841 20251 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
W20260709 12:19:50.779073 26472 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:19:50.777307 26428 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:50.803105 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:50.779872 26400 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:50.811964 20250 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:50.812525 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 163607us
W20260709 12:19:50.782383 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 166767us
I20260709 12:19:50.780164 26478 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:19:50.824259 20249 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:50.803658 26461 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:50.806521 26467 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:50.838171 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.843515 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:50.847965 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:50.852226 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:50.852942 20175 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:50.853684 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:50.853940 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.854806 25683 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:50.856463 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:50.860903 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:50.875322 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:50.875468 20171 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:19:50.889508 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46123.4us
W20260709 12:19:50.891155 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46936.5us
I20260709 12:19:50.895979 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.904637 26453 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:50.824198 26400 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:50.906437 26344 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.908735 26400 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.892282 26417 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:50.910881 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:50.920073 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:50.920202 26461 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:50.921466 26486 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:19:50.924264 20329 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:50.926486 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:50.925166 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:50.925738 26474 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:19:50.924685 26477 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:19:50.930677 26447 ts_tablet_manager.cc:1929] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 12:19:50.940964 20325 raft_consensus.cc:606] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:50.927376 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:50.900619 26126 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:51.083904 20325 raft_consensus.cc:614] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:51.040491 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:50.990460 26392 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:50.989202 26470 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:50.985834 26485 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:19:50.987442 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:50.992767 26497 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:19:50.982740 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 47715.7us
I20260709 12:19:51.064092 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:50.934211 26405 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:51.102892 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 175599us
I20260709 12:19:50.916582 26428 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:50.985064 26447 log.cc:1199] T ae0621ca652d416d9284323ec7eb2363 P e929b30888874ed59248f1229cecd3c6: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/wals/ae0621ca652d416d9284323ec7eb2363
I20260709 12:19:51.091918 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:51.094317 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:51.120358 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:51.093065 25798 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:19:51.096700 26126 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:51.125504 21036 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:51.197085 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.124966 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:51.298782 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 173901us
I20260709 12:19:51.321528 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:51.322964 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 126022us
W20260709 12:19:51.313791 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 174096us
I20260709 12:19:51.173730 26492 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.334092 26492 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:19:51.237066 26508 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 12:19:51.336562 21039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:51.370172 21039 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.370786 21039 raft_consensus.cc:614] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:51.131654 26410 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:51.305015 26493 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:19:51.375311 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 236730us
W20260709 12:19:51.373695 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.025s	sys 0.027s
I20260709 12:19:51.205106 26466 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.175s
W20260709 12:19:51.385226 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.025s	sys 0.027s
I20260709 12:19:51.390471 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:51.336221 26418 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:51.338207 26425 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:51.348199 26406 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:19:51.395798 26492 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:51.412089 26470 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:51.425721 26447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36730 (request call id 0) took 1825 ms. Trace:
I20260709 12:19:51.426332 26447 rpcz_store.cc:276] 0709 12:19:49.600733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.602316 (+  1583us) service_pool.cc:224] Handling call
0709 12:19:49.695752 (+ 93436us) ts_tablet_manager.cc:1151] Deleting tablet ae0621ca652d416d9284323ec7eb2363
0709 12:19:49.695850 (+    98us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:19:50.721260 (+1025410us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:50.930497 (+209237us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:51.425565 (+495068us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107819,"tablet-delete.queue_time_us":92452,"thread_start_us":50668,"threads_started":1}
I20260709 12:19:51.434909 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet ae0621ca652d416d9284323ec7eb2363 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
W20260709 12:19:51.448314 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 111895us
I20260709 12:19:51.450356 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:51.450412 26425 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:51.451049 20328 raft_consensus.cc:606] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.454975 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:51.455440 20249 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:51.455698 20328 raft_consensus.cc:606] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.459362 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:51.461591 20328 raft_consensus.cc:606] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.461436 26405 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:51.462024 20328 raft_consensus.cc:614] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:51.462597 26405 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:51.463858 26492 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:51.463977 26434 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:51.464279 26492 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:51.464516 26434 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:51.464829 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:51.465296 26492 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.465487 26434 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.466625 26492 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:51.467578 26405 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:51.468696 26405 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:51.469065 26405 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:51.469904 26493 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:51.470381 26493 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:51.470014 26405 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.471365 26405 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:51.471244 26493 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.472719 26493 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:51.467528 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 282509us
I20260709 12:19:51.476549 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:51.477239 20249 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:19:51.477952 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 139335us
I20260709 12:19:51.481230 26434 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:51.491863 25942 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.492445 25942 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.348426 26421 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:19:51.495365 26517 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.518603 20219 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.519320 25683 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:51.519774 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.520737 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.527817 20329 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:51.522729 26392 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:51.535246 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.535415 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:51.535768 25942 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:51.509513 26517 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.500031 26126 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:51.533404 26523 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:51.561520 26376 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:51.564219 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:51.568725 25942 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.569101 25942 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.569424 25942 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.588562 26401 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.589821 26517 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:51.589965 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:51.590023 26401 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:51.597307 20172 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:51.603883 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:51.609839 26428 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.612214 26428 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.613979 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:51.614508 26428 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:51.614639 20178 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:51.606491 20175 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:51.626034 26406 raft_consensus.cc:993] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:51.626672 26421 raft_consensus.cc:1081] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:51.632278 20328 raft_consensus.cc:606] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.632874 20328 raft_consensus.cc:614] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:51.636157 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:51.637543 26421 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.637960 26421 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.638293 26421 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.605365 26517 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.641101 26517 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:51.645933 20329 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:51.654598 20178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:51.655519 20178 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.656030 20178 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.611387 25942 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:19:51.671228 26525 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:19:51.672714 25942 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:51.688645 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1438) took 1258 ms. Trace:
I20260709 12:19:51.689087 21036 rpcz_store.cc:276] 0709 12:19:50.430671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.430820 (+   149us) service_pool.cc:224] Handling call
0709 12:19:50.431107 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.302533 (+871426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.688421 (+385888us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400738a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:51.688584 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588649344}
I20260709 12:19:51.690474 20321 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:51.691637 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:51.702234 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:51.703135 20249 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
W20260709 12:19:51.701726 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55797.4us
I20260709 12:19:51.708729 26366 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:51.709755 26456 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:51.710019 26517 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:51.710148 26456 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:51.711284 26456 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:51.712592 26456 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:51.717087 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:51.726572 26271 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:51.727151 26271 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:51.729310 26271 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:51.730001 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:51.730677 20250 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:51.735917 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:51.736582 21036 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:19:51.737270 26421 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.738507 20324 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:51.738893 20179 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:19:51.742197 20178 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.738960 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:51.740283 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:51.744580 20251 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.745960 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:51.758322 20251 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:51.761252 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:51.762064 20176 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:51.775699 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:51.777245 20178 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:51.755723 26271 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:51.782452 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:51.783118 20251 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.785836 26504 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.792431 26504 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.792768 26504 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.794236 26400 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:19:51.805322 20251 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:19:51.804235 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:51.811342 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:51.785166 26271 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:51.815992 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.819252 25656 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:19:51.819849 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 110588us
I20260709 12:19:51.822742 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:51.823464 20328 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:51.813344 26520 raft_consensus.cc:993] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
W20260709 12:19:51.824712 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 81719.8us
I20260709 12:19:51.825237 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:19:51.825536 26376 raft_consensus.cc:1081] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:51.827001 26276 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:51.827544 26276 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:51.828534 26276 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.830686 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:51.830964 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.832691 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:51.832818 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:51.832991 26484 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:51.833249 20324 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:51.833552 26484 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:51.833631 20324 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:51.834915 20175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:51.834671 20324 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.835791 26517 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:51.835934 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:51.836387 26517 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:51.836796 20171 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.837328 26517 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.827548 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:51.835435 20175 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.840085 20175 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:51.834548 26484 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:51.861431 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:51.854063 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:51.855836 20329 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:19:51.859393 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:51.849556 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:51.813849 26271 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:51.884790 26521 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:51.877497 26473 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:51.901279 26473 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.901706 26473 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:51.903422 26533 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:19:51.906697 20324 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:51.905679 26467 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:51.887288 26405 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:19:51.922351 26421 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:51.968004 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:51.977743 20171 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:51.946326 26521 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:51.980976 20324 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
I20260709 12:19:51.984432 25656 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:19:51.981516 26397 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:19:52.003365 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 62588.6us
I20260709 12:19:52.007886 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:52.008544 20253 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.032946 26521 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:52.064916 20180 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:52.052232 26478 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:52.099169 20253 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:52.104107 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:52.146091 20175 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.113680 26430 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.131815 26263 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:52.177415 20175 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:52.181901 26540 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.217s	user 0.003s	sys 0.006s
I20260709 12:19:52.110173 26478 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.135910 25798 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:19:52.191177 26263 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:52.184902 26430 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.195420 26545 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:52.246871 26545 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.249034 26545 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:52.244211 26539 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:19:52.262367 21043 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:52.263059 26263 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.191825 26504 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.266687 26504 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.267431 20176 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:52.267506 26430 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.328655 26347 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.329444 26347 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.329838 26478 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.339285 26535 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:52.339394 26347 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:52.340018 26535 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:52.340962 26535 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:52.342069 26535 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:52.350292 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:52.351037 20323 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:19:52.350365 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:52.355372 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:52.356089 20324 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:52.361059 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:52.361305 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:52.361655 20329 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:52.362005 20329 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:52.364068 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:52.366330 20329 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.367580 20329 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:52.369614 26545 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:52.370048 26545 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.370409 26545 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:52.372316 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:52.335069 26473 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:52.373085 26456 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:52.373485 26456 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:52.373817 26456 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:52.374434 26541 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.374s	user 0.001s	sys 0.003s
I20260709 12:19:52.376483 20176 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:52.399101 20329 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:19:52.420953 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 171044us
I20260709 12:19:52.423997 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:52.229334 26271 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:52.374457 26473 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:52.415345 26366 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:52.662343 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 211758us
W20260709 12:19:52.626775 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 233059us
W20260709 12:19:52.663416 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 248684us
W20260709 12:19:52.653389 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 152969us
W20260709 12:19:52.680697 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.686360 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:52.691753 20249 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:19:52.711856 26565 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.712568 26565 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.716699 20256 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:52.722020 26565 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.723690 26271 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:52.741588 26545 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:52.748222 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45626.8us
I20260709 12:19:52.755352 20251 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:52.669139 26366 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.771457 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:52.772374 20250 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:52.780264 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:52.781438 20251 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:52.784134 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:52.785192 20253 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:52.882995 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:52.891398 26366 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.892866 26545 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.698293 26456 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.959895 20253 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:52.937935 26411 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.936669 26560 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:52.965929 20250 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:19:52.972975 26558 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:19:52.965782 26456 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:52.967557 26411 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:52.976128 26560 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:52.978542 26560 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:52.978816 26411 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:52.982156 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 304380us
I20260709 12:19:52.981720 26421 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.991838 26421 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.016010 26421 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:53.013875 26566 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:53.016989 26566 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.020323 26566 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:53.039440 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:53.041628 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:53.042874 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:53.043466 20176 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:53.046700 26528 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:53.046870 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:53.048563 26528 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:53.051009 26428 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.051539 26428 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:53.053747 26428 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:53.054705 20173 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.066027 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:53.070940 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:53.101665 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:53.118036 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:53.125296 21038 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:19:53.130201 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:53.131165 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:53.705075 20249 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:53.237423 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:53.133818 20329 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:53.134595 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:53.135015 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:53.233083 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:53.153463 20173 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:53.131724 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:53.709806 20325 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:53.163151 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:53.130084 20252 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:53.264582 20171 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:53.745163 26580 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.745905 26580 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:53.748978 26580 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:53.749691 26580 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:53.750351 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 587249us
I20260709 12:19:53.705164 20323 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:19:53.784885 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 275903us
W20260709 12:19:53.157497 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 167262us
I20260709 12:19:53.816907 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:53.817730 20321 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:53.821153 26577 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.821775 26577 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.822932 26581 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.149353 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:53.826225 20330 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:53.587399 26566 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.549773 26376 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:53.592211 26545 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.861698 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:53.566452 26401 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:53.589612 26569 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.146757 26506 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:53.549739 26405 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:53.869307 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:19:53.871932 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:53.873922 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:53.877579 20175 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:53.893401 20177 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:53.458534 26428 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.450716 25656 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.353622 26435 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.484786 26576 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:53.450838 26492 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:53.458348 26467 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:53.342648 26461 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:53.897326 20327 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:19:53.894497 20329 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:19:53.849117 26580 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:53.879237 26376 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.915302 26577 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:53.925698 26520 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:53.926368 26263 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:53.879989 26566 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.891242 26545 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:53.823599 26581 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.908741 26506 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:53.889312 26401 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.949580 26523 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:53.897895 26569 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.904213 26405 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.967741 20325 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:54.006408 20326 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:53.963438 26553 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.027698 20322 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:53.914157 26435 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:53.910096 26428 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.996392 26577 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.913937 25656 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.963953 26576 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.985342 26461 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.979980 26467 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:53.969026 26492 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.054740 20250 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:53.997395 26580 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:53.996937 26263 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.034842 26523 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:54.067184 26263 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.035725 26553 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:53.995090 26520 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.082196 26569 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.087150 26376 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.052934 26577 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.087751 26467 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:54.109676 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 332862us
I20260709 12:19:54.114842 26467 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.116734 26435 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.116631 26467 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.117566 26566 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.118700 26467 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.119307 26559 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.119975 26401 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.119864 26559 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.122076 26559 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.122563 26559 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.123010 26559 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.127933 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.129156 26520 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.129781 20250 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:54.085014 26506 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.113384 26478 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.123464 26405 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.126510 26467 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.134760 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.133432 26545 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.138283 26467 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.140481 26581 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.109884 26523 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:54.165378 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 350664us
I20260709 12:19:54.145687 26577 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.172609 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.173663 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:54.180619 20179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.017s	sys 0.028s
W20260709 12:19:54.181133 20179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.017s	sys 0.028s
I20260709 12:19:54.182940 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.183789 21038 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:54.139524 26478 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.205834 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.209444 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.214604 26553 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.212361 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.156481 26428 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.215793 20256 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:54.214926 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.217434 20252 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:19:54.223423 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.225170 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.225258 20249 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:54.203233 26580 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.184598 26576 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.214648 26577 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:19:54.237112 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.216961 26405 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.244338 26405 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.202821 26492 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.216455 26581 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.248165 26581 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.184983 26435 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:19:54.250440 20321 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:54.226366 26428 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.247399 26405 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.239871 26461 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.282622 26581 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.277390 26553 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.277158 26580 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:54.284147 26583 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:54.294356 26467 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.274041 26428 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.290702 26576 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:54.289633 26559 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:54.289764 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.029s
I20260709 12:19:54.296320 26583 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:54.310021 26581 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:19:54.366106 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.015s
W20260709 12:19:54.366598 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.011s	sys 0.015s
W20260709 12:19:54.366942 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 541581us
W20260709 12:19:54.343922 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.029s
W20260709 12:19:54.388019 20296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.022s
I20260709 12:19:54.292773 26553 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:54.397047 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.020s
I20260709 12:19:54.325197 26576 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:54.292488 26580 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:54.399657 20296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.000s	sys 0.022s
W20260709 12:19:54.401052 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.020s
W20260709 12:19:54.446593 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 1.29722e+06us
W20260709 12:19:54.452371 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.017s	sys 0.025s
W20260709 12:19:54.458035 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.017s	sys 0.025s
I20260709 12:19:54.363920 26428 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:54.454310 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46097.8us
I20260709 12:19:54.451462 26478 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.469790 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.470628 20324 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:54.472707 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 295369us
I20260709 12:19:54.455978 26586 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.399933 26581 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:54.480387 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 364867us
I20260709 12:19:54.490423 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1108) took 1391 ms. Trace:
I20260709 12:19:54.461601 26418 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:19:54.490864 20179 rpcz_store.cc:276] 0709 12:19:53.099101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.100827 (+  1726us) service_pool.cc:224] Handling call
0709 12:19:53.117322 (+ 16495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:53.117601 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:19:54.181580 (+1063979us) log.cc:844] Serialized 14 byte log entry
0709 12:19:54.485441 (+303861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:54.486282 (+   841us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:19:54.490130 (+  3848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:54.490247 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:54.490363 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5661,"prepare.queue_time_us":22130,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"thread_start_us":1360581,"threads_started":2}
I20260709 12:19:54.480952 26428 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.518337 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:54.484679 26545 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.504189 26520 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:54.521725 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 283243us
I20260709 12:19:54.498004 26566 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.524858 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.555605 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:54.562762 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54915.7us
I20260709 12:19:54.486246 26586 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.522409 26595 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.522390 26461 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:19:54.570765 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 97438.2us
I20260709 12:19:54.484076 26576 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.576695 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.537150 20074 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 10 to 12, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:54.574836 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69687.9us
I20260709 12:19:54.598425 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:54.530999 26478 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.579939 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:54.600168 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 75775.8us
W20260709 12:19:54.612020 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 61147.7us
I20260709 12:19:54.564339 26575 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:54.530431 26545 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.562628 26484 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.537858 26428 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:54.571744 26582 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.542714 26520 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.566735 26588 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.544032 26566 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:54.638594 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74515us
I20260709 12:19:54.642905 26592 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.644456 26608 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.617611 26595 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.653944 26520 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:54.654922 26581 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.617859 26575 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.675022 26582 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.641008 26484 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.704145 26582 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.704721 26484 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.639026 26401 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:19:54.706229 26583 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.709764 26595 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.658579 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:54.630796 26467 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.638155 26576 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:54.604642 26461 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.678128 26588 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.690583 26506 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:54.692183 26593 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.718636 26597 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:54.724632 26467 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.724931 26597 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.725342 26506 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.725929 26506 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.693008 26566 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:54.693996 26615 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.694583 26608 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.695417 26405 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:54.695999 26600 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.637506 26601 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.677510 26553 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.723222 26586 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.731851 26405 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.730036 26577 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:54.732331 26586 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.732630 26577 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.733103 26577 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:54.732949 26586 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.734162 26608 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.734859 26615 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.736275 26461 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.735973 26601 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.738040 26615 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.696484 26619 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:54.617645 26478 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.679494 26592 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.694595 26545 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:54.717326 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 58806.2us
I20260709 12:19:54.707401 26583 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:54.753449 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 173580us
I20260709 12:19:54.845188 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:54.749846 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 70847.3us
I20260709 12:19:54.726962 26597 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:54.848215 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.738466 26601 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.717981 26575 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:54.864310 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:54.732403 26405 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:54.869287 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:54.868557 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 234799us
I20260709 12:19:54.722040 26580 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.726958 26467 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.722045 26428 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.831156 26588 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.728466 26506 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.878121 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:54.871321 20253 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:54.837525 26619 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.794054 26608 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.738642 26615 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.881273 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.720120 26628 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.885996 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.886397 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.924644 21036 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:54.887661 26588 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.793395 26586 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.729203 25656 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.897037 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.912287 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.900774 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.889971 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:54.930436 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.931043 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.873365 26601 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.926118 26484 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.931813 26601 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.932672 26484 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.866204 26545 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.933511 26622 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:54.933946 26545 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.934036 26622 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.934827 26484 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.887104 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.914069 20073 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 310) took 9694 ms. Trace:
I20260709 12:19:54.935904 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.750452 26600 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.937666 26478 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:54.752794 26593 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.888315 26428 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:54.932372 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.941287 20250 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:54.943635 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 341862us
I20260709 12:19:54.944154 26588 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.948222 26492 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:54.949847 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.950167 26467 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.943632 26615 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.950683 26467 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.950979 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.952657 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.952857 26467 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:54.915918 26591 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:54.954917 26591 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:54.955478 26591 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:54.957224 26428 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.942830 26608 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:54.966230 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.869066 26620 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:54.890866 26609 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:54.877031 26581 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.989640 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:54.990320 20249 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:19:54.982969 20074 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.999536 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.000337 20251 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:19:54.935853 20073 rpcz_store.cc:276] 0709 12:19:45.188887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.216319 (+ 27432us) service_pool.cc:224] Handling call
0709 12:19:54.883486 (+9667167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:50.216792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:50.279746 (+ 62954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:50.279802 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:19:50.279818 (+    16us) tablet.cc:662] Decoding operations
0709 12:19:50.558454 (+278636us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:50.558563 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:50.558592 (+    29us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:19:50.561128 (+  2536us) tablet.cc:701] Row locks acquired
0709 12:19:50.561179 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:19:50.561367 (+   188us) write_op.cc:270] Start()
0709 12:19:50.598830 (+ 37463us) write_op.cc:276] Timestamp: P: 1783599590561295 usec, L: 0
0709 12:19:50.604054 (+  5224us) op_driver.cc:348] REPLICATION: starting
0709 12:19:50.784615 (+180561us) log.cc:844] Serialized 12171 byte log entry
0709 12:19:51.466587 (+681972us) op_driver.cc:464] REPLICATION: finished
0709 12:19:51.468044 (+  1457us) write_op.cc:301] APPLY: starting
0709 12:19:51.468172 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:51.659455 (+191283us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800275260. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddac370ec 00007f5ddac39af7 00007f5ddac3afb0 00007f5dde94f1bb 00007f5dde94f532 00007f5dde996b93 00007f5dde843de3 00007f5dde8436ab 00007f5dde844e77
0709 12:19:51.703641 (+ 44186us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b1800275260. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5dde92eef0 00007f5dde92f489 00007f5dde93171a
0709 12:19:51.733485 (+ 29844us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:51.733520 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:53.575822 (+1842302us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b1800275260. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddac370ec 00007f5ddac83c0a 00007f5ddac834f7 00007f5ddac83490 00007f5ddac3af48 00007f5dde94f1bb 00007f5dde9965d4 00007f5dde8428da 00007f5dde8453cb
0709 12:19:53.764820 (+188998us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:53.765390 (+   570us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 12:19:53.765437 (+    47us) write_op.cc:312] APPLY: finished
0709 12:19:53.766031 (+   594us) log.cc:844] Serialized 268 byte log entry
0709 12:19:53.820245 (+ 54214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.820909 (+   664us) write_op.cc:454] Released schema lock
0709 12:19:53.820996 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:53.896484 (+ 75488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.901648 (+  5164us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":342710,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1151,"apply.run_cpu_time_us":101902,"apply.run_wall_time_us":2388852,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133893,"num_ops":31,"prepare.queue_time_us":241422,"prepare.run_cpu_time_us":26901,"prepare.run_wall_time_us":787016,"raft.queue_time_us":83900,"raft.run_cpu_time_us":4414,"raft.run_wall_time_us":237577,"replication_time_us":859424,"spinlock_wait_cycles":60132864,"thread_start_us":340230,"threads_started":5,"wal-append.queue_time_us":340359,"wal-append.run_cpu_time_us":28862,"wal-append.run_wall_time_us":2491041}]]}
I20260709 12:19:54.972995 26263 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:54.969587 26586 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:19:55.020892 26263 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.005406 26478 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:19:54.986595 26624 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:55.036049 26624 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:55.038280 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:54.946184 26628 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:54.946154 26619 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:55.092360 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 183797us
W20260709 12:19:55.094131 20219 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.933s (SENT) [suppressed 10 similar messages]
I20260709 12:19:55.094745 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:54.989877 26581 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.096401 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.099202 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.099632 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.100258 20329 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:55.100466 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.100531 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.095530 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.104085 20249 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:19:54.981591 26620 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.135468 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.138427 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.139333 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.138427 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.139722 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.143487 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.144150 20330 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:55.150709 20074 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 9 to 10, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 10 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.154937 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.154887 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.157891 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.157891 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.161212 20323 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:55.166944 21035 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:55.168056 26601 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.169152 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.169381 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.170993 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.175899 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.184058 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.193073 26263 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.171100 26622 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:55.222594 26581 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.223886 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.235487 26263 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.236466 26628 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.236366 26263 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:55.239007 26263 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:55.240005 26619 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.241886 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.242736 20255 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:55.183182 26405 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:55.245026 26577 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.001s
I20260709 12:19:55.245309 26405 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:55.245599 26577 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.246467 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.249480 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.250062 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.251446 26588 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.250245 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.252740 26608 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:55.254189 26405 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.254879 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.255285 21034 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:55.255924 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.260092 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.260807 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.261085 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.276259 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.277045 20324 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:55.284080 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.284511 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.284703 26592 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:55.284900 26624 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:55.285173 20327 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:19:55.286113 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.286254 26545 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.286727 20326 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:55.287250 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.288727 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.293529 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:55.305848 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.306478 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:19:55.307928 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.290210 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:55.318496 26428 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:55.319133 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 225034us
I20260709 12:19:55.321377 26615 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.331743 21035 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:55.331988 26636 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:55.289487 26586 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:55.332442 26636 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:55.333014 26636 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:55.333050 26586 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.337827 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.338495 20172 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:55.339538 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.339845 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.340198 20175 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:55.340412 20327 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:55.341138 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.341261 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.341729 20174 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:55.273850 26588 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:55.342748 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.341786 20327 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:19:55.308068 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:55.343710 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.344156 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.344566 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:55.344792 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.345206 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.345661 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:55.345870 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:55.346698 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57317.9us
I20260709 12:19:55.347945 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.349809 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.350483 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:55.342494 26588 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.390092 26577 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:55.390695 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:55.391556 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.392032 25656 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:55.392211 20177 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:55.392481 25656 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:55.392912 25656 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:55.393704 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.394071 26545 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:55.394693 26545 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.351212 20255 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.351903 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.404305 20325 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:55.346457 20324 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:19:55.358280 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.371539 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:55.405704 26520 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:55.379303 26628 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:55.406028 26580 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:55.380105 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.406469 26580 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:55.407166 26580 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:55.381333 26617 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:55.407552 26520 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.385696 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:55.406677 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.408041 26520 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.406431 26628 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:55.408439 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.408831 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.407869 26617 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.335381 26586 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.409574 26617 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:55.386412 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.410390 20172 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:19:55.386549 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.387778 26581 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:55.414569 26581 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:55.385377 26263 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:55.416456 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.388846 26608 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:55.417320 20328 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:19:55.416584 26263 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:55.418246 26263 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:55.407095 20179 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:19:55.389629 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:55.419998 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.306682 26405 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:55.424139 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.272710 26553 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:55.429198 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.429366 26591 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:55.442269 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.445415 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:55.926810 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:55.466244 20255 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:55.927296 20175 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:55.435370 20172 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:19:55.451408 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79924.6us
I20260709 12:19:55.914350 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:55.927539 20251 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:19:55.930584 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.929253 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:55.937333 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.938239 20174 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:55.925915 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.940505 20180 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:55.942014 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.939369 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.943835 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:55.933018 26580 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.004s
I20260709 12:19:55.991724 20176 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:19:55.933128 26263 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
W20260709 12:19:55.944077 26575 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.068s	user 0.013s	sys 0.005s
W20260709 12:19:55.985037 26643 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:19:55.517396 26626 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:55.944809 26617 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.535s	user 0.014s	sys 0.002s
I20260709 12:19:55.899039 26405 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:55.998494 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.664484 26608 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:55.322928 26600 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:55.987712 26595 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:56.003674 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.002498 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:56.006085 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81544.5us
I20260709 12:19:56.011498 20176 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:19:56.008355 20174 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:56.015758 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.013410 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:56.016593 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.016687 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.018230 26581 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:55.944383 26553 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:55.894757 26506 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
W20260709 12:19:56.030570 26520 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.001s
I20260709 12:19:55.996054 26580 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.044288 26628 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.045306 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.045933 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:56.046537 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.047168 20172 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:19:56.023531 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.021853 20176 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:56.007035 26617 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.000348 26575 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.009181 26595 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:56.034758 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.037532 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:55.826699 26636 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:55.998198 26263 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.047266 26620 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.052359 20173 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:56.052394 20179 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:19:55.878207 25656 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.053673 26595 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:56.083886 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.032419 20251 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:19:56.067181 20326 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:56.036038 26593 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.047734 26581 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.010911 26608 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.008104 26626 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.063372 26617 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.061779 26575 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.093853 20323 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:56.050096 26520 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.099778 26581 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.158423 26588 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.152777 26581 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.156184 26580 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.183456 26263 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.186079 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:56.187052 20325 raft_consensus.cc:606] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.187516 20325 raft_consensus.cc:614] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:56.191045 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 271033us
I20260709 12:19:56.178818 26591 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.179075 26545 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:56.193323 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 270721us
I20260709 12:19:56.217994 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:56.226012 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:56.229239 20326 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:56.232362 26617 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:56.243364 20329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "937144b407c548958468c2b27f8cd054"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:56.245765 20329 raft_consensus.cc:606] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.246204 20329 raft_consensus.cc:614] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:56.252772 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 338546us
I20260709 12:19:56.244587 26617 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:56.257943 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 329403us
I20260709 12:19:56.256968 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.245253 26553 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.269179 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.252130 25656 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.277489 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:56.278107 20323 raft_consensus.cc:606] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.278393 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:56.278501 20323 raft_consensus.cc:614] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:56.257171 26636 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.263375 26617 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.283277 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.279194 26588 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:56.276600 26553 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.290339 26581 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.297667 26553 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.298307 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de701338877c4a78b14dec4df55119c2"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:56.298662 20178 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:56.298924 20323 raft_consensus.cc:606] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.299343 20323 raft_consensus.cc:614] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:56.300168 26553 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.278880 26608 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.297040 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:56.282202 26520 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.281908 26629 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:56.296447 26626 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.283679 26506 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:19:56.295588 26263 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:19:56.308288 20178 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:56.304225 26545 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:19:56.308511 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 296332us
I20260709 12:19:56.304342 26588 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:56.315933 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.322803 20250 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:19:56.324301 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.318220 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.318599 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:56.318977 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.326488 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:56.327054 20326 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.324929 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.328027 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:56.358456 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.345552 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 400143us
I20260709 12:19:56.352144 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:56.337478 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.371848 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.372500 21037 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:19:56.337682 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.336771 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.375447 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:56.375929 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.376217 20254 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:56.370347 20219 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:56.310539 26263 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:56.381570 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:56.384657 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.382788 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.388924 21043 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:19:56.309410 26629 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:56.390575 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.393417 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.394186 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.313794 26545 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.394384 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:56.378634 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:56.398562 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.399381 20251 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:19:56.404349 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.406944 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.321274 26577 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:56.410619 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.394989 20323 raft_consensus.cc:606] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.312963 26591 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:56.403190 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.415191 21041 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:56.402204 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:56.417706 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 184717us
I20260709 12:19:56.380393 26553 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:56.429003 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.388018 26263 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:56.380527 26592 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:56.428665 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:56.396132 26626 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:56.400491 26545 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.444196 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.446692 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.446821 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.446523 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:56.442459 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63900.7us
I20260709 12:19:56.458706 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:56.516769 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 130149us
I20260709 12:19:56.461781 20326 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:19:56.486933 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50193.1us
I20260709 12:19:56.524260 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:56.524784 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:56.551460 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 92844.5us
I20260709 12:19:56.422551 26577 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.552450 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.429152 26591 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.432662 26593 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:56.434301 26553 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:56.524657 26580 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.439407 26626 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.435995 26648 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:56.452052 26600 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:56.567302 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 129528us
I20260709 12:19:56.567863 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.489480 26633 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:56.568439 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.446520 26651 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.562060 26654 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:56.591002 26553 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:56.568457 26586 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:56.561829 26620 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:56.574817 26608 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.636631 26608 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:19:56.638985 26608 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:19:56.575950 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3577) took 1147 ms. Trace:
I20260709 12:19:56.639672 20173 rpcz_store.cc:276] 0709 12:19:55.428834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.070637 (+641803us) service_pool.cc:224] Handling call
0709 12:19:56.070955 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.071363 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.071404 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.097539 (+ 26135us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.431418 (+333879us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:56.431477 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.431585 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.575687 (+144102us) raft_consensus.cc:1685] finished
0709 12:19:56.575708 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.575877 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":623,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11595,"thread_start_us":291004,"threads_started":1,"wal-append.queue_time_us":439833}
I20260709 12:19:56.577127 26577 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.577719 21034 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:56.442502 26592 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.643175 26592 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.587126 26263 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.643762 26660 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:56.644239 26660 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:56.644619 26660 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.645288 26263 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.447913 26506 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:56.489619 26650 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:56.647558 26405 raft_consensus.cc:993] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
W20260709 12:19:56.598438 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 169871us
I20260709 12:19:56.648133 26263 raft_consensus.cc:1081] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:56.615453 21039 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 8.
W20260709 12:19:56.624436 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 72949.5us
I20260709 12:19:56.653721 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:56.625108 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 100405us
I20260709 12:19:56.626188 26633 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.489614 26628 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:56.657466 21035 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:19:56.592271 26580 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.629604 21042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:56.673931 21042 raft_consensus.cc:606] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.577149 26661 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:56.449251 26647 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:56.627519 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:56.669617 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:56.684801 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 121394us
I20260709 12:19:56.686250 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:56.627174 26581 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.593152 26626 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.688535 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:56.692297 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:56.518316 26588 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.683949 26580 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.695746 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:56.701033 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 176978us
I20260709 12:19:56.683416 26592 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:56.556178 26629 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.685319 26662 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:56.706875 26662 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.707159 26670 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:19:56.709017 26662 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.708701 26617 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.709443 26581 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:56.709913 26581 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.710309 26581 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.710837 26617 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.713505 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:56.716814 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:56.695643 26600 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:56.730739 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.702728 26661 raft_consensus.cc:2764] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:19:56.732059 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 105176us
I20260709 12:19:56.632588 26651 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.695271 26628 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:19:56.739107 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.739475 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:56.672640 26654 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.742033 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:56.742992 20171 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.742264 20174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:19:56.744400 20174 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:56.744897 20174 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.727991 26600 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.747767 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:56.722021 26666 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:56.734498 26590 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:56.750156 20177 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:56.729068 26668 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.749010 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:56.751240 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 55032.8us
I20260709 12:19:56.761986 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:56.747628 26575 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:56.801618 26575 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.803730 26405 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:56.751616 26600 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.804407 26405 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.806582 26405 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:56.808184 26655 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:19:56.804098 26575 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.814379 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3588) took 1427 ms. Trace:
I20260709 12:19:56.814762 20176 rpcz_store.cc:276] 0709 12:19:55.387309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.060000 (+672691us) service_pool.cc:224] Handling call
0709 12:19:56.060436 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.060810 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.060834 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:56.061313 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:19:56.389890 (+328577us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:56.389934 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.390008 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.814151 (+424143us) raft_consensus.cc:1685] finished
0709 12:19:56.814173 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.814313 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7628,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11947,"spinlock_wait_cycles":72192,"thread_start_us":328207,"threads_started":1,"wal-append.queue_time_us":455177}
I20260709 12:19:56.816746 26600 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.832420 20171 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:19:56.833529 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84600.5us
I20260709 12:19:56.835963 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:56.749683 26650 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.840863 26677 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.847481 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.847901 20177 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:19:56.841486 26647 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:19:56.840574 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 152933us
I20260709 12:19:56.819382 26600 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.760053 25656 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:56.851220 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:56.851908 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:56.852389 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:56.852543 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:56.849578 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:56.850685 20174 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.761145 26590 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.857255 20328 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:19:56.751154 26667 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.861123 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:56.866964 20322 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:56.868086 20174 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.856848 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:56.841940 26668 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.863797 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:56.865744 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.892607 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:56.836962 26577 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:56.893887 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:56.896967 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:56.865223 26590 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.859268 26662 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:56.759375 26626 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.861729 26674 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:56.762708 26666 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.908327 26674 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:56.908744 26674 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:56.909117 26674 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:56.869268 26581 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.910174 26666 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.855543 26680 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:56.911343 26581 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.912149 20180 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:56.911898 26680 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:56.858194 26591 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.860175 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:56.914880 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54797.2us
I20260709 12:19:56.917361 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:19:56.856724 26650 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.898101 25656 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:56.893092 26668 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.922787 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.948503 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.949749 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:56.920868 26658 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:19:56.944345 26653 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:19:56.909219 26595 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.002s
I20260709 12:19:56.951122 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:56.951293 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:56.951890 21035 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:56.954522 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.964900 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:56.964576 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:56.972913 21043 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:56.914044 26680 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:56.860445 26677 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:56.915216 26633 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:56.909278 26626 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:56.921924 26663 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:57.012466 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:57.006960 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 300481us
W20260709 12:19:57.007684 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 157591us
I20260709 12:19:56.949160 26577 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:56.921672 25656 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:57.021956 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:56.870716 26667 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.015772 20295 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:57.017340 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:57.017903 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:57.019796 20176 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:57.029855 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:56.964219 26662 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:57.148192 26662 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.021786 26592 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:57.152624 26592 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:57.069526 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 162643us
W20260709 12:19:57.092042 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 69132.7us
I20260709 12:19:56.918485 26545 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.158653 26545 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:57.151289 26662 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:57.095458 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 79763.7us
I20260709 12:19:57.015663 26663 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:57.163612 26663 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:57.143241 26651 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.172284 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:57.173331 26617 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:19:57.173969 26617 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:57.015313 26577 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:57.190526 26577 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:57.193440 26667 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.194517 26674 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.195760 21042 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
W20260709 12:19:57.195938 26643 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:57.196884 26674 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.198799 26677 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.031358 25656 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:56.947712 26647 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.175068 26617 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.178319 26263 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:57.184945 26671 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:56.975153 26590 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.060668 26586 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:57.189893 26666 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:56.996565 26595 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:57.200199 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 43699.4us
I20260709 12:19:57.214144 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:57.215461 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 239504us
I20260709 12:19:57.216109 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:57.216663 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 211603us
I20260709 12:19:57.233140 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:57.234930 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 220809us
I20260709 12:19:57.236709 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.240269 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.241559 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.241678 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.242340 21043 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:19:57.242897 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:57.243055 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:57.244577 21035 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:19:57.245922 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.248281 26650 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.248524 26590 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.205384 26675 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:57.253952 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.254699 20326 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
W20260709 12:19:57.256166 20294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.011s
I20260709 12:19:57.256744 20324 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:19:57.257992 20294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.000s	sys 0.011s
I20260709 12:19:57.257184 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:57.261656 21043 raft_consensus.cc:2410] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:19:57.264380 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:57.296768 20252 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:57.260267 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:19:57.395974 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 135793us
I20260709 12:19:57.396888 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.233388 26545 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.322589 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:57.313990 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:57.313458 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:57.314054 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:57.236847 26588 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.222242 26586 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.256943 26648 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.324460 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:57.422626 26648 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:57.423090 26648 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:57.424410 26682 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:19:57.319795 26506 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:57.339455 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 95573.6us
I20260709 12:19:57.299176 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:57.324589 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 65917.8us
I20260709 12:19:57.429229 26577 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:57.429817 26676 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
W20260709 12:19:57.398469 26553 consensus_meta.cc:287] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 12:19:57.434257 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.435531 20326 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:57.435979 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.437492 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.435979 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.436309 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.436396 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.442929 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.262612 26644 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.263470 26666 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:57.412117 26593 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:19:57.418929 26580 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.002s
I20260709 12:19:57.420708 26595 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:57.422140 26671 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.456580 26671 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.297173 26653 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:19:57.460354 26660 consensus_meta.cc:287] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.815s	user 0.015s	sys 0.000s
I20260709 12:19:57.461001 26649 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.445976 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.446770 20326 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:57.443801 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:57.323073 26626 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:19:57.414777 26670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.005s	sys 0.020s
I20260709 12:19:57.449018 20328 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:57.464593 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.447767 26553 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.455304 26580 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:57.400496 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.455331 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:57.460906 26660 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.451004 25656 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.267700 26675 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.406288 26654 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.453250 26663 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.451436 26593 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:57.461189 26653 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:57.483311 26683 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.295s	user 0.000s	sys 0.002s
I20260709 12:19:57.469051 26674 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:57.589895 26660 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:57.590552 26675 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.464128 26649 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.471591 26626 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.566267 26648 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.593309 26626 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.471256 26651 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:57.594300 26651 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:57.594741 26651 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:57.471895 26666 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.596374 26648 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:57.597214 26663 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:57.470763 26668 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.600101 26668 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.462935 26671 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:57.464438 26670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.005s	sys 0.021s
I20260709 12:19:57.605412 26651 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.608340 26651 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:19:57.645665 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 248644us
I20260709 12:19:57.648527 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.651743 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.654284 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:57.662916 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:57.431231 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:57.685316 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 254030us
I20260709 12:19:57.687108 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:57.690119 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:57.694622 20249 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:57.412468 20250 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:57.700534 20253 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:57.448518 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:57.415323 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:57.595249 26593 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:57.707821 20254 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:57.594666 26580 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.693035 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:57.478765 26586 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.733952 26620 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:57.734748 26620 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:57.735212 26620 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:57.736840 26644 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.739977 26671 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.741001 26671 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.742285 25656 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.743301 26648 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:57.743805 26648 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:57.743970 26647 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:57.744288 26648 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:57.744822 26647 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.748665 26669 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.749675 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1649) took 2240 ms. Trace:
I20260709 12:19:57.592988 26649 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:57.750149 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:57.875705 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 221685us
I20260709 12:19:57.891367 26626 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:57.896380 20254 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:57.899052 26668 raft_consensus.cc:2764] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:19:57.562603 26577 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:57.937721 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:57.478653 26553 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:57.750140 20252 rpcz_store.cc:276] 0709 12:19:55.508584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.508713 (+   129us) service_pool.cc:224] Handling call
0709 12:19:55.991021 (+482308us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3eee 000000000036eb39 00007f5ddfe471e0 00007f5ddff100c4 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:19:55.991251 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.395232 (+1403981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.749082 (+353850us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001969d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:57.749425 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2918293376}
I20260709 12:19:57.803174 26660 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.785022 26670 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.950911 26670 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.804772 26666 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.953907 26665 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:57.784324 26650 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:57.794790 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 346219us
I20260709 12:19:57.954526 26665 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:57.839413 26702 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:57.840843 26620 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.983749 26672 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:57.984431 26672 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:57.986161 26672 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:57.986702 26620 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:57.995955 26665 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:57.998255 26665 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:58.060484 26702 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:58.138862 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.163619 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 168293us
I20260709 12:19:58.164896 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.167109 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:58.171962 26670 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:19:58.174775 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.179718 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 191417us
I20260709 12:19:58.180464 26263 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:58.180974 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.184010 26620 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:58.187222 26681 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.993s	user 0.008s	sys 0.000s
W20260709 12:19:58.188158 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46265.1us
I20260709 12:19:58.181105 26263 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:58.191488 26714 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:58.191998 26714 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:58.190902 26263 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:58.193029 26263 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:58.196177 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:58.192461 26714 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.204735 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1661) took 1255 ms. Trace:
I20260709 12:19:58.183499 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.150401 26671 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:58.207697 20249 rpcz_store.cc:276] 0709 12:19:56.947384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.950529 (+  3145us) service_pool.cc:224] Handling call
0709 12:19:56.950816 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.695387 (+744571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.202108 (+506721us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54001018d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:58.202341 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709079296}
W20260709 12:19:58.214792 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.216061 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.214785 26405 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.219029 26704 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.219247 26702 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.219026 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.224460 20250 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:58.219141 26647 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.224664 20256 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:58.227293 26620 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:58.232551 26620 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:58.233021 26620 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:58.239997 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 73117.2us
I20260709 12:19:58.240470 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1567) took 1039 ms. Trace:
I20260709 12:19:58.240986 21035 rpcz_store.cc:276] 0709 12:19:57.200938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.201795 (+   857us) service_pool.cc:224] Handling call
0709 12:19:57.244325 (+ 42530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.245169 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.239916 (+994747us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54004e9dd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:19:58.240186 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96967424}
W20260709 12:19:58.244109 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 60954.2us
I20260709 12:19:58.244427 26662 raft_consensus.cc:993] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:58.243003 26593 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.245218 26662 raft_consensus.cc:1081] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:19:58.245158 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:19:58.247310 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.247648 26506 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:58.248035 26506 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:58.248427 26506 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:58.249442 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:58.230396 26704 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.254041 26704 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.256464 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.259820 26714 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:58.260736 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 116652us
I20260709 12:19:58.263293 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:19:58.267521 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45993.1us
I20260709 12:19:58.268690 26672 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:58.273021 20177 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
W20260709 12:19:58.273888 26715 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.054s	user 0.000s	sys 0.008s
W20260709 12:19:58.282401 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 589640us
I20260709 12:19:58.283872 26685 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:58.285096 26685 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:58.285301 26649 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:58.285629 26685 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:58.291306 26714 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.291229 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:58.287067 26685 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.305423 26687 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:58.306252 26687 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:58.306715 20174 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:58.307622 26663 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:58.308219 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:58.308921 20329 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:58.309167 26591 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:58.309329 20176 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:58.309588 26591 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:58.310875 26591 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.311498 26685 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:58.312184 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.312642 26591 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:58.316084 26687 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:58.316920 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:58.322225 26648 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.002s
I20260709 12:19:58.328136 20329 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:58.324699 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2861) took 1012 ms. Trace:
I20260709 12:19:58.329789 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:58.331358 20321 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 23. Current term is 24. Ops: []
I20260709 12:19:58.336931 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1663) took 1383 ms. Trace:
I20260709 12:19:58.340507 26663 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:58.341378 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:19:58.289531 26629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.008s	sys 0.019s
I20260709 12:19:58.291603 26620 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.352528 20323 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:58.373665 26620 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:58.353961 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 66140us
I20260709 12:19:58.356099 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.374891 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.375212 20176 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.347662 20253 rpcz_store.cc:276] 0709 12:19:56.953815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.954715 (+   900us) service_pool.cc:224] Handling call
0709 12:19:56.954969 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:57.701211 (+746242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.336639 (+635428us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54003d86d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:19:58.336856 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712782080}
I20260709 12:19:58.356603 26591 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:58.376456 26591 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:58.377697 26591 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.357892 20328 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:19:58.354511 26629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.009s	sys 0.019s
I20260709 12:19:58.362247 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.322818 26648 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.362892 26663 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:58.363191 20321 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:19:58.363324 26672 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:58.363777 20177 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:58.231869 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:58.366166 20172 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:19:58.347327 20255 rpcz_store.cc:276] 0709 12:19:57.312619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.312751 (+   132us) service_pool.cc:224] Handling call
0709 12:19:58.323578 (+1010827us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:19:58.323945 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.324193 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:58.324218 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:58.324286 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:58.324323 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.324373 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.324505 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4244736}
I20260709 12:19:58.387930 26675 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:58.393085 26648 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.394795 26620 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:58.395290 26620 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:58.395704 26620 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:58.382915 26663 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.383960 26591 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:58.400456 26663 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:58.412189 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 168708us
I20260709 12:19:58.407186 26593 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.429468 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.439129 26665 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:58.439615 26697 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:58.442950 26636 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:58.443327 26645 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:58.443428 26636 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:58.443986 26645 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:58.444788 26636 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:58.445194 26645 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.449008 26636 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:58.449585 26645 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:58.453810 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.462616 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.472800 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.473240 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.473637 20172 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.474321 20177 raft_consensus.cc:2410] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:19:58.475343 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.477231 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.478992 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.479790 20176 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:58.481463 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.481174 20072 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.482326 26620 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.483747 20072 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 15 to 18, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 18 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.484736 26620 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.492033 20174 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
W20260709 12:19:58.491875 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 78019.5us
I20260709 12:19:58.495237 26506 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.496528 20072 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 9 to 14, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.497519 26506 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.498075 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.498940 20177 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:58.499647 20072 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 6 to 8, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 8 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.501516 20072 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 11 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 14 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.503970 20176 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:58.503651 20072 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 12 to 15, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 15 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.505470 20072 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 11 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 14 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.511231 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.511591 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:19:58.511786 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 48712us
I20260709 12:19:58.513073 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.514048 26697 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:58.514478 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:58.515434 26591 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.515976 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.516273 26697 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:58.517573 26263 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:58.517959 26263 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:58.518168 20177 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:58.519160 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:58.519061 26263 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.520381 26688 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:58.520473 20219 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:58.520900 26688 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:58.521354 26688 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.522106 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:58.522948 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.498638 26663 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.523710 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.524427 20180 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.525413 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.523734 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.526604 20177 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.520334 26620 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:58.527735 26620 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:58.528334 26697 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:19:58.530078 26620 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:58.530418 26697 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:58.533682 20174 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:58.536885 20178 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:58.525609 26663 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:58.538714 26645 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:58.507697 20072 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 11 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 14 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.542384 26591 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:19:58.544162 26263 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:58.544092 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.544658 26591 consensus_queue.cc:1243] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 24.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 12:19:58.545171 20176 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:58.545394 26591 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:19:58.546031 26591 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:58.547084 26591 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.548446 26591 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:19:58.548949 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:58.549959 26697 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:58.550732 26697 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:58.550865 20072 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.552166 26697 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.553074 20072 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:58.543748 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:58.556540 26662 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:58.557062 26662 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:58.558076 26662 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.559762 26675 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:19:58.560228 20074 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 320) took 30961 ms (client timeout 15000 ms). Trace:
I20260709 12:19:58.561156 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet ae0621ca652d416d9284323ec7eb2363 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:36730
I20260709 12:19:58.556555 26688 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:58.597090 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 75063.8us
W20260709 12:19:58.671494 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.604008 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55248.3us
I20260709 12:19:58.566603 26675 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:58.668255 20177 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:19:58.673516 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.674768 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.675999 26668 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:58.676514 26688 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:58.685326 20176 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:58.686965 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:58.690133 20249 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:58.693221 20172 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:58.692178 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:58.697615 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:19:58.701937 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.685913 26668 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:58.686746 26650 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:58.716550 26672 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:58.621366 20074 rpcz_store.cc:269] 0709 12:19:27.598835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.599114 (+   279us) service_pool.cc:224] Handling call
0709 12:19:58.559842 (+30960728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:56.238511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:56.291862 (+ 53351us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:56.291905 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:19:56.291924 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:56.334678 (+ 42754us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:56.381026 (+ 46348us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:56.388193 (+  7167us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:56.452330 (+ 64137us) tablet.cc:701] Row locks acquired
0709 12:19:56.487417 (+ 35087us) write_op.cc:260] PREPARE: finished
0709 12:19:56.528101 (+ 40684us) write_op.cc:270] Start()
0709 12:19:56.562745 (+ 34644us) write_op.cc:276] Timestamp: P: 1783599596525060 usec, L: 0
0709 12:19:56.565819 (+  3074us) op_driver.cc:348] REPLICATION: starting
0709 12:19:56.699429 (+133610us) log.cc:844] Serialized 1302 byte log entry
0709 12:19:57.578237 (+878808us) op_driver.cc:464] REPLICATION: finished
0709 12:19:57.592486 (+ 14249us) write_op.cc:301] APPLY: starting
0709 12:19:57.592585 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:57.598211 (+  5626us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:57.598333 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:57.600615 (+  2282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:57.601018 (+   403us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:19:57.601067 (+    49us) write_op.cc:312] APPLY: finished
0709 12:19:57.601303 (+   236us) log.cc:844] Serialized 41 byte log entry
0709 12:19:57.601480 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:57.602315 (+   835us) write_op.cc:454] Released schema lock
0709 12:19:57.602365 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:57.602890 (+   525us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:57.602933 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":209876,"reported_tablets":48,"spinlock_wait_cycles":22400,"child_traces":[["op",{"apply.queue_time_us":13964,"apply.run_cpu_time_us":6458,"apply.run_wall_time_us":10373,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":779310,"prepare.run_cpu_time_us":35117,"prepare.run_wall_time_us":691969,"raft.queue_time_us":147016,"raft.run_cpu_time_us":5851,"raft.run_wall_time_us":13361,"replication_time_us":1012234,"thread_start_us":394862,"threads_started":4,"wal-append.queue_time_us":275894,"wal-append.run_cpu_time_us":25755,"wal-append.run_wall_time_us":1670431}]]}
I20260709 12:19:58.724536 20253 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:19:58.734715 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.748488 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.749517 20248 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:58.751488 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.752755 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.752791 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.754063 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.755046 20179 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.755281 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.756096 20176 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.756379 25656 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:58.757076 25656 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.758417 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.759287 20178 raft_consensus.cc:2410] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:19:58.726135 26668 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:58.758597 20173 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 23. Current term is 24. Ops: []
I20260709 12:19:58.740159 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.767068 20172 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.767993 25656 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:58.768517 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.769635 20248 raft_consensus.cc:2410] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:58.729773 26645 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.774665 26645 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.775976 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.776907 20172 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 9: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.776928 26645 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:58.778664 20249 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:58.784714 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.788061 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.789322 20248 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:58.789708 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.792233 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.793051 20172 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.804924 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.806589 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.806696 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.808604 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:58.809557 20252 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:58.811744 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.815004 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.813614 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:58.818284 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 122102us
I20260709 12:19:58.824162 20180 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:58.827126 20249 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:58.837553 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.839071 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:58.840142 20247 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:58.840890 26620 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:19:58.841269 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet ae0621ca652d416d9284323ec7eb2363 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:19:58.841593 26620 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.816078 26663 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:58.851130 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:58.855605 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.832707 26662 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:19:58.861215 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 185785us
I20260709 12:19:58.767488 20072 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.881240 25656 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:58.881704 25656 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:58.882664 25656 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.884176 25656 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.889423 20180 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:58.869411 26663 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:58.922427 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 95239.9us
W20260709 12:19:58.919471 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 80962.6us
W20260709 12:19:58.926250 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.928045 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.931275 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.904131 26662 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.952121 26620 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:19:58.958012 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 131328us
I20260709 12:19:58.961282 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.962213 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:58.962882 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:58.963292 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:58.964227 21042 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:19:58.965729 26670 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:58.966339 26670 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:58.968914 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "463ac757068e4382abd72beef4bbf682"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:58.969619 20322 raft_consensus.cc:606] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:58.969754 26670 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:58.970032 20322 raft_consensus.cc:614] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:58.972229 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:58.974261 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:58.974969 21034 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:58.975528 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:58.960374 20072 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 13, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:58.979735 26662 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:58.980376 21035 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:19:58.984472 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:58.984769 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:58.984812 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.985088 20179 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:58.987766 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:58.988521 20178 raft_consensus.cc:2368] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16.
I20260709 12:19:58.989248 20177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:60784
I20260709 12:19:58.989912 20177 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:58.990283 20177 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:58.992736 20175 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
W20260709 12:19:58.960143 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.564s (SENT)
I20260709 12:19:59.020227 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:58.978637 20072 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 9 to 11, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 11 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:19:59.023006 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:59.023667 20176 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.030381 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.031140 21041 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.031415 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.035471 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.028048 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.038110 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.038787 25656 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.040443 26723 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:59.040629 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:59.041064 26723 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:59.041520 20175 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:59.041687 25656 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.042140 26723 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.042680 26724 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.044301 25656 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.048936 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:59.055953 26685 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:59.056674 26685 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.057572 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:59.057917 20178 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:59.058360 20178 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:59.056752 21041 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:59.059106 26685 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.059368 20178 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.060060 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:59.060774 20178 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.060925 20173 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:59.061211 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.061427 21042 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:59.062110 20255 raft_consensus.cc:2368] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18.
I20260709 12:19:59.062775 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:59.060750 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.064802 26263 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.065135 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.064850 26663 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:59.066098 26263 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.066821 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.068265 20072 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 13, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 13 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.069415 20255 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:19:59.054636 20177 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.079845 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.080374 20177 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:59.080432 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.080749 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.081252 20329 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:59.081543 21041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:19:59.081941 26263 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:59.082218 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.082232 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.084679 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:59.086947 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.088928 20178 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:59.082247 21041 raft_consensus.cc:606] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.090207 20322 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:19:59.097914 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.109970 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.114977 21041 raft_consensus.cc:614] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:59.119396 20322 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:59.122260 20176 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:59.133916 20175 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:59.135900 20328 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:59.137547 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:59.139947 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 267835us
I20260709 12:19:59.139369 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.141435 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.141904 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:59.134461 20175 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:59.144102 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:59.145509 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.138878 25656 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:59.149452 20323 raft_consensus.cc:2410] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:59.147177 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.152104 20322 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:59.155481 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.161304 20329 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:59.161515 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:59.162079 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.645s (SENT)
I20260709 12:19:59.172560 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.173456 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:59.191284 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.191967 20248 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:59.192932 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.194319 20255 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:59.193929 20330 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:19:59.204741 21042 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:59.209303 21035 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
W20260709 12:19:59.212145 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59750.7us
I20260709 12:19:59.212988 26680 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.213560 26680 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:19:59.212999 20220 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.655s (SENT)
I20260709 12:19:59.217461 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.224609 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.225425 20256 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.226047 26680 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:59.227982 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.228708 20328 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:59.233498 21043 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:59.234468 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.235715 20175 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.236861 20175 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:59.238256 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.246564 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:19:59.247326 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.249293 20255 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:19:59.250538 21035 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:59.251601 20256 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:19:59.256904 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.257501 20254 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.258577 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:59.259320 20176 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:19:59.259645 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.260556 21038 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:19:59.238305 26730 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.256925 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.261904 21037 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:59.257541 21043 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:59.264806 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:59.254266 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:59.266479 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.268338 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:19:59.270049 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.273057 21041 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.269068 26670 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:59.273715 21039 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:59.273762 26670 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.274317 26670 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.274870 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:59.275468 20327 raft_consensus.cc:606] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.275836 20327 raft_consensus.cc:614] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:59.276564 26675 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:59.277001 26675 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:59.277361 26675 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.278043 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:19:59.279014 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 86187.3us
I20260709 12:19:59.283313 21037 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:19:59.269353 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.285578 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.291980 20247 raft_consensus.cc:2368] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:19:59.299464 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:59.301535 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.305047 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.305537 20322 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.305670 21039 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:59.306274 26577 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:59.306687 26577 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:19:59.307072 26577 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.307871 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.308531 21038 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:59.311867 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:59.304538 20325 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 10.
I20260709 12:19:59.314751 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.319901 21035 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:59.323079 20322 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:19:59.267127 26724 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.326521 21041 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:19:59.331921 20175 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:19:59.332782 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 119837us
I20260709 12:19:59.298369 26685 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:19:59.387161 21038 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:19:59.383891 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.402027 21034 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:19:59.404335 21043 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:19:59.406037 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.407795 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:59.412470 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.412587 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.414783 26577 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.390699 21039 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:19:59.387161 20328 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:19:59.415292 26636 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:59.415544 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:59.300803 20144 connection.cc:256] RPC call timeout handler was delayed by -2.490767237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 12:19:59.423888 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:59.426347 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:59.453941 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.427369 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:19:59.427991 26741 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.241s	user 0.003s	sys 0.003s
I20260709 12:19:59.434942 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.435262 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:59.435523 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:19:59.456557 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2351672370000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:19:59.468667 20144 connection.cc:256] RPC call timeout handler was delayed by -1.39240562100008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:19:59.469228 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3789056210000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:19:59.469591 20144 connection.cc:256] RPC call timeout handler was delayed by -1.3627056210000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:19:59.472385 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 189808us
I20260709 12:19:59.479480 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.481853 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.467780 26666 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:59.494362 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.486502 26672 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.471863 26730 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:59.472144 26636 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:59.503701 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.513422 20326 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.513294 21008 leader_election.cc:400] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16.
I20260709 12:19:59.524860 21008 leader_election.cc:403] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:19:59.511548 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.531005 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.531301 26672 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16.
I20260709 12:19:59.532675 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.533834 26752 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.534628 26724 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.500475 26730 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.500730 26662 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:59.539074 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 123612us
I20260709 12:19:59.535508 26724 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.519869 26577 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.552517 26744 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:59.553049 26744 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.554025 26744 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:19:59.567912 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 152124us
I20260709 12:19:59.506989 26746 raft_consensus.cc:2764] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:59.575918 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.538160 26730 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:59.579764 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 89569.7us
I20260709 12:19:59.581000 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.586899 20326 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.591295 26723 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:59.598961 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59073us
W20260709 12:19:59.599861 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 67265.7us
I20260709 12:19:59.600768 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.518882 26636 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.606695 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.607642 26665 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:59.608896 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.612133 20254 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:59.615012 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.617302 26746 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.618005 26746 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:59.621104 26744 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:59.628268 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.629274 26729 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:59.630245 26729 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:59.617960 26675 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.632738 26675 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.632468 26591 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:59.633787 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.634450 20323 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.639753 26670 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.641963 26670 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.644207 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.644834 20324 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.646232 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:19:59.650480 26730 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.651587 20328 raft_consensus.cc:2368] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:59.652611 20324 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:59.655280 20323 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:59.657454 21039 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:59.658243 26757 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.655972 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:59.658821 26757 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.659701 26675 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:59.660537 26675 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:59.661557 26688 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:59.661827 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 61199us
I20260709 12:19:59.662323 26688 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:59.661701 26675 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.662760 26688 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:59.663517 26752 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:59.662885 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.664774 26760 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:59.665172 26760 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.666478 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.667779 26650 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:59.668851 26668 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:59.669236 26668 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.669581 26668 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.666157 26760 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.673458 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:59.678260 26756 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:59.678864 26756 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:59.680171 26756 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.673969 26688 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.693704 26688 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:59.667436 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.698457 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:59.705821 20180 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.705983 26724 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:59.712030 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44698.9us
I20260709 12:19:59.712847 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.713634 26688 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:59.714772 20180 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:19:59.717089 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:59.717504 26724 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.718035 26666 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:59.718657 26666 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:59.719720 26666 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.689268 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.722268 26697 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.725868 26764 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:59.726271 26764 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:19:59.727090 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:19:59.735549 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 119031us
I20260709 12:19:59.736022 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:59.736320 26757 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.736769 26746 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:19:59.736979 20255 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:19:59.737391 26746 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.738140 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.740397 26746 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.740607 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.741905 26757 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:59.756958 26668 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.760241 26668 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.699536 26730 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:19:59.762215 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.745757 20219 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.768061 20326 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:19:59.776188 20327 raft_consensus.cc:606] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.769260 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:19:59.786278 26663 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:59.786410 26765 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.787389 21039 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:19:59.800105 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54470us
I20260709 12:19:59.801566 26688 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.794500 26663 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:19:59.802148 26688 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.802740 26663 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.804410 26688 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:59.800865 20219 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.792315 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.807246 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.811368 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:59.811968 20327 raft_consensus.cc:606] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.813874 26760 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:59.815678 26650 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:59.817322 26765 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:59.817777 26650 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:59.818151 26650 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:19:59.812743 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 217592us
I20260709 12:19:59.821420 20219 leader_election.cc:400] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:59.821753 20219 leader_election.cc:403] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:59.810114 26668 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:59.824098 26668 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.825157 26668 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.828917 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:19:59.830360 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.831512 26765 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:59.831619 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:19:59.832311 20327 raft_consensus.cc:606] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.832825 20327 raft_consensus.cc:614] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:59.809144 26724 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:59.833568 26724 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.834344 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:59.834537 26724 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.836542 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:59.837785 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:59.838737 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.819581 26650 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.832316 26765 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:59.846807 26650 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.849436 26752 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.852475 26697 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.853060 26697 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.857187 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:19:59.865886 20180 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:19:59.856433 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.868161 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.838837 26688 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:59.870496 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:19:59.855530 26697 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:59.871783 26645 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:59.872546 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.886504 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.884343 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.887817 26636 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:59.888710 26636 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.888526 26697 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:19:59.727195 26764 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:19:59.884608 26730 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:59.887742 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:19:59.876932 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.890154 26730 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.890766 26730 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:59.891089 26666 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:59.891433 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.891677 26666 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.892164 26666 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:59.892757 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.893639 26636 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:59.894375 26636 raft_consensus.cc:2764] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:19:59.896018 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:19:59.899608 26697 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:59.900307 26697 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:19:59.901849 26666 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.902472 26697 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.904639 26666 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:59.902987 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.905283 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:19:59.906453 20176 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:19:59.908102 26636 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.905674 26764 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:59.917588 20326 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.918413 20327 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
W20260709 12:19:59.920475 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 76886.7us
I20260709 12:19:59.921356 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:19:59.922685 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.923390 26650 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:59.924906 26760 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:59.883958 26675 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.925899 26675 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.928241 26675 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:19:59.929240 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:19:59.929904 20254 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:19:59.931061 20327 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.932560 21043 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.933084 21034 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:59.933311 20323 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:19:59.936337 26685 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:59.936578 21039 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:59.936527 26762 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:59.940100 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.940907 20323 raft_consensus.cc:2368] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
W20260709 12:19:59.941854 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73771.5us
I20260709 12:19:59.943343 21043 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:59.943126 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.944563 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:19:59.908510 26666 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:19:59.949362 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:19:59.951694 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:19:59.952486 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:19:59.952905 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:19:59.954027 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.954188 21038 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.954813 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.955271 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.955844 20329 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:19:59.956605 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.950573 21043 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:19:59.957545 20323 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:19:59.958959 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.937691 26650 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.960413 26752 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:19:59.960793 26650 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.961319 26752 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:59.937997 26668 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:59.962723 26668 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.963709 26668 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.936347 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:19:59.971105 20327 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.971943 20328 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:19:59.973413 20323 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:59.974668 21034 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:59.939780 26688 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.977020 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:19:59.979472 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 149267us
I20260709 12:19:59.971505 26675 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:59.976060 26685 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.983946 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.985107 26771 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:19:59.985708 26771 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.985764 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.988000 26771 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:19:59.988916 26762 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.989656 26762 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:59.991016 26762 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:59.992277 26760 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:59.992660 26762 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:59.992851 26760 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.993163 26762 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:19:59.994436 26760 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.982693 26724 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:19:59.996302 26762 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.997499 26771 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:59.997815 26730 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:19:59.998415 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:19:59.999035 26769 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:20:00.017426 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:19:59.999504 26685 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.002115 20326 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:00.006402 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 70545.3us
I20260709 12:20:00.010043 26746 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:00.012859 26724 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:00.013638 26688 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.001140 26675 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.018043 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:00.020779 26746 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.018196 26760 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:00.049068 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50745.1us
I20260709 12:20:00.049962 26774 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:00.050318 26775 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:00.051200 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.051504 26774 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:00.051891 26774 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:00.052847 26774 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.054196 26774 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:00.055866 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:00.056602 20329 raft_consensus.cc:2368] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:00.059890 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:00.061474 26746 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.062175 26762 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:00.062389 26775 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:00.062901 26746 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:00.061429 20219 leader_election.cc:400] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
I20260709 12:20:00.064177 20219 leader_election.cc:403] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:00.061374 26752 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:00.068014 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:00.045495 26765 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:00.071038 26744 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:00.071442 26765 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.073721 26765 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.074193 26765 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:00.074690 26765 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.033627 26724 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:00.033334 26771 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:00.077875 20327 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:00.079486 20328 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:00.080571 21043 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:00.080456 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8aef67aa330543a191ab5ab5dc30e84c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:00.080777 21034 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:00.044258 26675 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:00.083125 26765 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.078720 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:00.083768 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66425.3us
I20260709 12:20:00.088006 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:00.088719 21034 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:00.089164 20219 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:00.076766 26752 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.102896 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:00.109181 21041 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:00.128487 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:00.112799 26752 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:00.135138 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.120791 26775 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:00.120309 26776 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.133875 26771 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:00.110754 26729 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:20:00.110503 26263 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:20:00.141093 26775 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:00.134347 26765 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:00.141264 26636 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:00.176401 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:00.177073 20175 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:00.195017 20175 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:00.128968 26724 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.208726 26775 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:00.209648 26777 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:20:00.210072 26730 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.211376 26771 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:00.214635 26724 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:00.144356 26776 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.246950 20180 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:20:00.247489 20180 pending_rounds.cc:85] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:20:00.177646 26765 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.215258 26744 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14.
W20260709 12:20:00.250737 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.251367 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 159252us
W20260709 12:20:00.272472 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 74935.1us
I20260709 12:20:00.247812 20180 pending_rounds.cc:107] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:20:00.274852 20180 raft_consensus.cc:2889] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:00.273046 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:00.216773 26665 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:00.231303 26746 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:20:00.287912 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.248974 26752 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.292924 26665 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.288368 26263 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:00.301834 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.326782 20328 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:00.334307 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:00.335135 21041 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:00.312664 26746 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:00.362639 20327 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:20:00.371721 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70414.6us
I20260709 12:20:00.382109 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.384390 26744 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:00.390509 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.344589 26746 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.367903 26724 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:00.371155 26650 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:00.423106 26665 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.387530 26263 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:00.434571 21041 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
W20260709 12:20:00.436213 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.417721 26781 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.438866 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.437323 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81939.9us
I20260709 12:20:00.436717 26650 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:00.446468 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56203.5us
I20260709 12:20:00.400097 26788 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:20:00.450016 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:00.451133 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:00.453748 20255 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:00.439136 26685 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:00.468231 20254 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:00.472980 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:00.436286 26675 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.479079 26650 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:00.483726 26782 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.186s	user 0.001s	sys 0.001s
I20260709 12:20:00.488220 26798 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:20:00.453783 26786 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:00.499861 26765 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.443384 26781 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.468528 26776 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:00.522699 26785 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:20:00.473565 26752 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.500779 26263 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.470549 26746 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.516181 26765 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.540534 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 264070us
I20260709 12:20:00.512986 26786 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:00.546937 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.539942 26781 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.552654 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:00.547978 26746 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:00.563338 26675 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:00.541059 26765 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.572808 26765 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:00.572945 26786 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:00.573140 26680 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:00.573635 26680 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:00.574594 26680 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.576457 26680 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:00.573470 26765 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:00.577452 26765 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:00.561762 26752 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.579869 26764 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:00.580338 26764 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.580045 26752 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.581363 26764 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.582650 26764 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:00.583763 26752 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:00.587200 21038 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:00.590232 20251 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:00.568135 26781 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:00.592093 26685 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:00.595183 26764 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:00.597878 26752 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:00.598549 26796 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:20:00.601699 21008 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.588s (SENT)
I20260709 12:20:00.615365 20329 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:00.617241 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:00.604693 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.558s (SENT)
I20260709 12:20:00.618028 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.619765 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:00.620441 20247 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:20:00.615281 26799 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:20:00.615717 26697 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 12:20:00.628036 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.605s (SENT)
I20260709 12:20:00.628521 26757 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:00.628655 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.594827 26636 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:20:00.630499 25656 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:00.608794 26764 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.609329 26781 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.645589 20327 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:00.645581 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:00.645907 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:00.647177 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:00.647475 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:00.651818 21041 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:00.651913 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:00.653951 26762 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:00.654264 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:00.654917 20328 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:00.655840 25656 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:00.657480 26779 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.466s	user 0.002s	sys 0.002s
I20260709 12:20:00.659852 26666 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:00.617708 26796 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.660274 26666 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:00.661171 26796 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.662262 26796 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:00.662534 20321 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:00.652235 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:00.651408 26774 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:00.664637 26774 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:00.628053 26697 consensus_queue.cc:1243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:00.666567 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:00.672588 21038 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:00.674836 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46833.7us
W20260709 12:20:00.675726 21008 leader_election.cc:336] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.644s (SENT)
I20260709 12:20:00.676222 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.680307 20328 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:00.681993 26774 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:20:00.690611 26730 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:00.690456 26798 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:20:00.694087 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 89448.5us
I20260709 12:20:00.649811 26803 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:00.690932 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:00.695593 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:00.698181 20255 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:20:00.700978 20180 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:00.701851 20248 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:00.704506 20249 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:00.708487 26663 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:00.719936 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:00.691017 26730 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:00.719192 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.573s (SENT) [suppressed 28 similar messages]
I20260709 12:20:00.674332 26729 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 12:20:00.736352 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60685.1us
I20260709 12:20:00.736613 20247 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:00.736812 26263 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:00.698803 26803 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:00.755298 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.661211 26666 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.729967 26800 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:00.705498 26636 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 12:20:00.803649 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47686.5us
W20260709 12:20:00.807775 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 246654us
I20260709 12:20:00.808719 20144 leader_election.cc:400] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:00.809031 20144 leader_election.cc:403] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:20:00.759088 26680 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:00.817255 26263 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:00.829658 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:00.832026 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:00.833009 20180 raft_consensus.cc:2368] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15.
I20260709 12:20:00.823604 26746 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:00.842638 20180 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:00.843209 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:00.844703 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:00.847771 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:00.849629 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:00.850931 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:00.854146 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.814694 26800 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:00.743134 26764 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.824782 26680 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.860056 26793 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:20:00.809674 26791 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:20:00.867240 20173 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:00.861426 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:00.780164 26781 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:00.870688 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.886869 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.871997 20171 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:20:00.860723 26801 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:20:00.873987 26680 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:00.875599 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:00.838765 26771 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:20:00.852643 26803 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:00.840417 26730 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.898548 26800 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.910285 21041 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:00.914502 26752 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:00.925570 20177 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:20:00.926600 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.927829 21008 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.764s (SENT)
I20260709 12:20:00.928503 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:00.953734 26756 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:00.966517 26730 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:00.967484 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:00.968210 21038 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:00.968508 21038 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:00.969295 21038 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:00.970168 21038 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:00.930673 26796 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:00.971074 26796 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:00.979136 21038 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:20:00.982549 26764 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:00.994755 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:01.002074 26803 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:01.005771 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:01.003361 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75575.3us
I20260709 12:20:01.013078 21043 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:01.021405 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:01.023165 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:01.024016 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.020197 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:01.042100 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:01.015324 21008 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.796s (SENT)
I20260709 12:20:01.045465 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:01.048261 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.963264 26666 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:01.062479 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.064350 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:01.065074 21034 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:01.065150 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.069590 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.074471 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:01.071784 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.075295 20248 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
W20260709 12:20:01.081209 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65942.3us
I20260709 12:20:01.072504 26814 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.051708 26752 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:20:01.078935 26762 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:01.008389 26796 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.079480 26688 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:01.106982 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 254884us
I20260709 12:20:01.083390 26784 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:01.116082 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 223942us
I20260709 12:20:01.121007 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:01.073738 26685 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:20:01.088439 26798 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:20:01.130306 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:01.100965 26774 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:20:01.136821 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:01.137454 26765 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:01.137662 26771 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:01.138091 26765 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:01.138253 26771 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:01.139973 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:01.093902 26756 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:20:01.139830 26781 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:01.160054 26781 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:01.160180 26724 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.160776 26724 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.161036 26781 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.163051 26724 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:01.163982 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:01.164274 20324 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:01.164618 20329 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:01.165501 26795 raft_consensus.cc:993] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:01.166083 26665 raft_consensus.cc:1081] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:01.142319 26809 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:01.167585 20324 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:01.168455 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:01.169728 20330 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:01.170665 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:01.173728 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:01.176919 26796 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:01.177134 20177 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:01.181656 20174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:01.182176 20174 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:01.182600 20174 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:01.183720 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:01.143013 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:01.143646 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:01.151065 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:01.150983 26697 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:01.185942 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:01.152366 26799 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.153959 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.195948 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:01.195861 26799 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.198388 26799 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:01.200696 20329 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
W20260709 12:20:01.204101 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 118117us
W20260709 12:20:01.204824 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.105789 26814 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.200129 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:01.224673 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:01.225590 20249 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:01.209316 20174 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.229143 20176 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:01.231451 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.233318 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.233629 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:01.221516 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 127953us
I20260709 12:20:01.234302 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.234786 20174 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:01.235411 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.237214 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.238018 26688 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:01.224996 26724 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.240113 26724 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.245652 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.250854 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:01.251772 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:01.217422 26788 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:01.234321 20180 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:01.256188 20144 leader_election.cc:400] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18.
I20260709 12:20:01.256528 20144 leader_election.cc:403] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:20:01.221819 26809 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:01.225342 26665 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.252453 20171 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:01.260210 26839 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:20:01.244405 26781 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:01.265403 26814 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:01.231137 26776 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:01.269781 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:01.304037 20329 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:01.270231 20177 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:01.270834 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:01.304860 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:01.278319 21034 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:01.242872 26746 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:01.289795 21008 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.898s (SENT)
I20260709 12:20:01.290434 20179 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:01.246685 26724 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:01.305670 20180 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14. Re-sending same reply.
W20260709 12:20:01.302798 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 216833us
I20260709 12:20:01.321226 20177 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:01.323557 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:01.139114 26765 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.277880 26826 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:01.334048 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.367506 25656 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:01.374004 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 125051us
I20260709 12:20:01.246301 26771 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.355464 26814 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18.
I20260709 12:20:01.339293 26746 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:01.302875 26665 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.367221 26801 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.402289 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:01.399971 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 96796.5us
I20260709 12:20:01.372102 26788 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:01.405282 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 115518us
I20260709 12:20:01.385476 26685 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:20:01.392534 26752 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:01.378924 26775 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:20:01.416814 26781 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:01.404729 26794 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.128s
W20260709 12:20:01.486176 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 102502us
W20260709 12:20:01.489377 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 76089us
I20260709 12:20:01.490231 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:01.498229 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86910.6us
I20260709 12:20:01.499917 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:01.500617 21034 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:20:01.501001 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.405455 26801 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.478693 26800 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.496214 26814 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.533027 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:01.535321 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:01.496510 26784 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.548660 26845 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:20:01.520802 26848 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:01.563016 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:01.584360 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:01.518388 26791 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:20:01.483774 26809 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:01.592963 26784 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.616356 26809 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.570065 26814 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.620019 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:01.534986 26800 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:01.640908 26844 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:20:01.604056 26798 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:01.622944 26666 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.004s
I20260709 12:20:01.514966 26746 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:01.647776 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.987s (SENT)
W20260709 12:20:01.648792 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 126054us
W20260709 12:20:01.736068 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54854.8us
W20260709 12:20:01.718946 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.525830 26788 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:01.670182 26730 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.698s	user 0.013s	sys 0.001s
I20260709 12:20:01.738687 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:01.739609 20324 raft_consensus.cc:606] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:01.739979 20324 raft_consensus.cc:614] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:01.744308 26860 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:20:01.746649 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 98895.7us
I20260709 12:20:01.743892 26837 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:01.669819 26776 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:01.775682 26837 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.776576 26837 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:01.605789 26781 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.779534 26776 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.680243 26798 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.725296 26857 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.725438 26665 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:01.722694 26774 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:01.802826 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:01.812050 21008 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.181s (SENT)
I20260709 12:20:01.812592 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:01.806914 26803 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.003s
I20260709 12:20:01.801144 26798 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:01.828327 20171 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 8. Current term is 9. Ops: []
W20260709 12:20:01.832099 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 57246.6us
I20260709 12:20:01.836227 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:01.811882 26776 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:01.853150 20144 leader_election.cc:400] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:20:01.857781 20144 leader_election.cc:403] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:01.831492 26663 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.873903 26764 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.891s	user 0.013s	sys 0.009s
W20260709 12:20:01.905174 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52195us
I20260709 12:20:01.855322 26781 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:01.949622 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:01.953905 26865 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.954789 26865 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:01.957814 26865 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:01.958627 26850 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.959391 26850 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.962334 26850 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:01.814013 26857 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:01.967733 20176 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:01.978355 26861 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:02.000932 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:01.890440 26663 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:02.003422 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 200547us
W20260709 12:20:02.005616 21008 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.201s (SENT)
I20260709 12:20:02.006232 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.006606 26840 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.008365 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:02.010135 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:01.974188 26764 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:02.021250 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:02.009058 20324 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.027829 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:01.984633 26814 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.023764 26850 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:02.023195 26788 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:02.031219 26796 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:02.042919 26868 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:20:02.044185 26867 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
W20260709 12:20:02.045794 26862 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:20:02.007272 26840 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.044865 26881 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:02.048117 26866 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:20:02.047516 26881 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.051808 26881 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:02.052274 26663 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:02.040138 26847 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:20:02.053956 26801 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:02.055050 26878 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:02.056092 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:02.056761 20324 raft_consensus.cc:606] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.057111 20324 raft_consensus.cc:614] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:02.056922 26878 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:02.061154 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.054636 26663 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:02.065835 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.069386 20252 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:02.067711 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.032676 26853 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:02.072073 21043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:20:02.069430 20251 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
W20260709 12:20:02.053972 26869 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:02.077081 21043 raft_consensus.cc:606] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.079491 21043 raft_consensus.cc:614] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:02.079591 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:02.080284 20254 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.082756 20329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:02.083360 20329 raft_consensus.cc:606] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:02.083731 20329 raft_consensus.cc:614] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:02.083784 26873 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.084393 26873 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.086077 26863 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:02.086563 26863 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:02.086962 26863 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:02.087698 20329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:02.088295 20329 raft_consensus.cc:606] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.088654 20329 raft_consensus.cc:614] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:02.089808 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:02.092505 26724 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.093264 26724 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.036708 26851 raft_consensus.cc:2764] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:20:02.104398 26840 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:02.117990 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:02.127735 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:02.128225 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:02.130769 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:02.129405 26788 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:02.131081 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:02.131284 21043 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:02.134011 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:02.129858 26853 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.142104 20254 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:02.145387 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:02.150588 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.151649 20180 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:20:02.152033 20180 pending_rounds.cc:85] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 9
I20260709 12:20:02.152314 20180 pending_rounds.cc:107] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:20:02.152561 20180 raft_consensus.cc:2889] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:02.152722 20177 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:02.154978 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.154891 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:02.147146 26788 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:02.160616 26798 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.163122 26798 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.165139 26837 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:02.165820 26846 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.632s	user 0.000s	sys 0.001s
I20260709 12:20:02.169530 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.168936 20175 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:02.149295 26765 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:02.147559 26771 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.171033 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.174857 20177 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:02.140954 26853 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.177277 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.157428 26857 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.179911 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.183679 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:02.184255 20176 raft_consensus.cc:2376] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15. Re-sending same reply.
I20260709 12:20:02.182245 26786 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.185838 26786 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.188153 26786 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.188186 26789 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:02.189399 26789 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:02.190294 26789 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.188901 26800 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.191741 26853 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.193562 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.197898 20252 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:02.176620 26873 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.205509 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.193507 26863 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.209059 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.210732 26800 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:20:02.210165 26675 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:02.253479 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:02.258410 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.259253 20254 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:02.261067 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1490) took 1006 ms. Trace:
W20260709 12:20:02.304718 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.336519 20252 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:02.338832 20176 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:02.344703 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1174) took 1087 ms. Trace:
I20260709 12:20:02.261991 21038 rpcz_store.cc:276] 0709 12:20:01.254486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.254621 (+   135us) service_pool.cc:224] Handling call
0709 12:20:01.256014 (+  1393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.256406 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.256438 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.256905 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.381563 (+124658us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:01.381626 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.381798 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.165144 (+783346us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:02.218952 (+ 53808us) raft_consensus.cc:1685] finished
0709 12:20:02.218987 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.260969 (+ 41982us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":723,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":103814400,"thread_start_us":117900,"threads_started":1,"wal-append.queue_time_us":173222}
I20260709 12:20:02.352267 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.352492 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.353350 20254 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:02.181742 26771 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.345117 20171 rpcz_store.cc:276] 0709 12:20:01.248015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.294893 (+ 46878us) service_pool.cc:224] Handling call
0709 12:20:01.295155 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.833755 (+538600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.335386 (+501631us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54000a5854. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:02.335668 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220027776}
W20260709 12:20:02.442538 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 233149us
I20260709 12:20:02.326754 26850 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.337518 26663 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.352018 26873 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.340368 26853 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.481207 20179 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:02.258419 26765 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.191s
W20260709 12:20:02.488300 26889 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:20:02.498442 26851 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:02.499886 26724 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.445016 26781 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.450649 26814 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:02.505338 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:02.403694 26881 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 12:20:02.482333 26850 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.517557 26840 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:02.503129 26873 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.501842 26663 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.506248 26853 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:02.539814 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 96335.7us
I20260709 12:20:02.511140 26781 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.540874 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:02.546300 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:02.547408 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:02.549018 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 193439us
I20260709 12:20:02.549955 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:02.552419 26796 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:02.557819 21034 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:02.548776 26765 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:02.539633 26840 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.562920 21038 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:20:02.563289 20173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1161) took 1329 ms (client timeout 1764 ms). Trace:
I20260709 12:20:02.549532 26852 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:02.567065 20173 rpcz_store.cc:269] 0709 12:20:01.230074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.236911 (+  6837us) service_pool.cc:224] Handling call
0709 12:20:02.556364 (+1319453us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54002369d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:02.556495 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533518208}
I20260709 12:20:02.560525 26756 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:02.554199 26796 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:02.573670 26850 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.563820 26863 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.554513 26764 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:20:02.564414 26820 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:02.567261 26852 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.565924 26894 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.571164 26756 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.600515 26663 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:02.575325 26883 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.473s	user 0.002s	sys 0.019s
I20260709 12:20:02.626549 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:02.626817 26781 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.627482 21038 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:02.627806 26890 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:20:02.589715 26853 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.590654 26873 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.576529 26771 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.602829 26892 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.637154 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:02.621215 26746 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.623665 26756 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:02.621519 26852 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:02.648694 21038 raft_consensus.cc:2368] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:02.647940 26746 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.654536 26746 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:02.603345 26784 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.656955 26853 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.659865 26897 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.593011 26796 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.624663 26820 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.662652 21043 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:02.662524 26853 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.662456 21039 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:02.621933 26894 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.669281 20144 leader_election.cc:400] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:02.670037 26781 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:02.670334 26824 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.673169 20144 leader_election.cc:403] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:02.694898 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1603) took 1175 ms. Trace:
I20260709 12:20:02.699275 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.699597 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:02.700234 20322 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:20:02.649019 26892 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.701210 26645 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:02.701745 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.701862 26645 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.702419 20323 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:02.703037 26892 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:02.701200 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.703905 21038 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:02.704866 26853 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.707415 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.708930 20328 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:02.696249 21041 rpcz_store.cc:276] 0709 12:20:01.499825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.499950 (+   125us) service_pool.cc:224] Handling call
0709 12:20:01.500291 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.794599 (+294308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.794636 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.795171 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.984454 (+189283us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:01.984500 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.327125 (+342625us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400462154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:02.327184 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.508858 (+181674us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:02.674550 (+165692us) raft_consensus.cc:1685] finished
0709 12:20:02.674578 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.674736 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67570,"raft.queue_time_us":67998,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"spinlock_wait_cycles":522971776,"thread_start_us":188879,"threads_started":1,"wal-append.queue_time_us":266695}
I20260709 12:20:02.711045 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.711784 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.712404 20327 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:02.713644 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:02.708415 20321 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:20:02.719527 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.720285 20323 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:02.719373 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:02.721747 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:02.724686 21041 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:02.726143 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:02.670819 26795 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.673794 26794 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.732345 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:02.679682 26771 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.695513 26791 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.723826 26781 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:20:02.671937 26867 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 12:20:02.744763 26877 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.715s	user 0.009s	sys 0.016s
I20260709 12:20:02.732403 26853 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:02.670892 26897 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:02.735844 26764 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:02.740772 26895 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:02.707574 26824 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.763007 26853 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.786300 26764 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.787144 26724 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:02.814580 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52744.7us
I20260709 12:20:02.737993 26795 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.741569 26794 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.747717 26771 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:02.761229 26863 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:20:02.838824 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.798332 26645 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:02.788235 26895 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.812783 26853 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.855707 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1166) took 1622 ms. Trace:
I20260709 12:20:02.814529 26764 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:02.762538 26791 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.862538 20172 rpcz_store.cc:276] 0709 12:20:01.233586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.234062 (+   476us) service_pool.cc:224] Handling call
0709 12:20:02.854278 (+1620216us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540031a6d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:02.855623 (+  1345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504517888}
I20260709 12:20:02.864622 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3721) took 1592 ms. Trace:
I20260709 12:20:02.799156 26850 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:20:02.866770 20174 rpcz_store.cc:276] 0709 12:20:01.272422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.318833 (+ 46411us) service_pool.cc:224] Handling call
0709 12:20:01.358283 (+ 39450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.720680 (+362397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.720733 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.721452 (+   719us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.836481 (+115029us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:01.836516 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.836585 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.672444 (+835859us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:02.857059 (+184615us) raft_consensus.cc:1685] finished
0709 12:20:02.857100 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.864539 (+  7439us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14325,"raft.queue_time_us":83283,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":44528,"spinlock_wait_cycles":6999936,"thread_start_us":402851,"threads_started":2,"wal-append.queue_time_us":228210}
I20260709 12:20:02.873149 20324 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:02.819247 26746 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.877436 26905 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.878015 26820 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:02.878334 26904 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.878935 26904 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:02.880031 26898 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:20:02.880600 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1167) took 1646 ms. Trace:
I20260709 12:20:02.880995 20178 rpcz_store.cc:276] 0709 12:20:01.233889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.235081 (+  1192us) service_pool.cc:224] Handling call
0709 12:20:02.880386 (+1645305us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b540016ab54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:02.880538 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102728064}
I20260709 12:20:02.881549 26904 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.882090 26904 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.882540 26904 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.884765 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:02.885574 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:02.887903 26867 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.888605 26867 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:02.890511 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.891850 26908 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.892412 26908 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.894568 26908 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:02.894886 26885 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:02.895303 26885 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.895637 26885 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:02.821015 26839 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.901815 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:02.818964 26724 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.903643 20247 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:02.905726 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.861503 26895 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:03.028307 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:03.226389 26729 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:02.950114 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:03.024932 26906 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:02.905470 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.904336 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:02.907775 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:03.234844 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:03.261319 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:02.864912 26784 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:03.234800 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:03.235988 26729 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:03.093786 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:02.891341 26867 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:03.278692 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:02.979475 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:03.289453 20252 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:02.909592 26650 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.993438 26680 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.419770 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:03.395323 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 303111us
I20260709 12:20:03.049297 26903 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:02.963778 26854 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.231756 26894 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:03.435956 20254 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:20:03.023252 26874 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.936s	user 0.011s	sys 0.015s
I20260709 12:20:03.060433 26908 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:02.937732 26730 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:03.154428 26591 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:03.422170 26863 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.998613 26907 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:03.431340 26886 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:03.461766 26910 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:03.264796 26839 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.463043 26906 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:02.878087 26905 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:02.944677 26746 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:03.500953 21041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.029s
I20260709 12:20:03.551625 26858 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:03.552614 26917 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:03.430960 26784 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.452757 26650 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:03.462299 26680 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.481757 26854 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.480535 26903 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:03.889520 21041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.007s	sys 0.035s
W20260709 12:20:03.610055 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 319130us
I20260709 12:20:03.820792 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2913) took 2596 ms. Trace:
W20260709 12:20:03.775027 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1179) took 1621 ms (client timeout 2008 ms). Trace:
I20260709 12:20:03.873332 20251 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
W20260709 12:20:03.892249 20179 rpcz_store.cc:269] 0709 12:20:02.153343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.154789 (+  1446us) service_pool.cc:224] Handling call
0709 12:20:03.774726 (+1619937us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002c4f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:03.774921 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748605312}
W20260709 12:20:03.895277 20146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.000s	sys 0.065s
W20260709 12:20:03.895744 20146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.000s	sys 0.065s
I20260709 12:20:03.535072 26908 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.900863 26916 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:03.901538 26916 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:03.902196 26908 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:03.902773 26908 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:03.635900 26787 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.002s	sys 0.027s
W20260709 12:20:03.903867 26787 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.005s	sys 0.040s
W20260709 12:20:03.903919 26880 log.cc:927] Time spent T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: Append to log took a long time: real 1.691s	user 0.020s	sys 0.059s
I20260709 12:20:03.896063 26904 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:03.905049 26904 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.905534 26904 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.897993 26917 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.908131 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:03.908663 26911 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
W20260709 12:20:03.921942 20295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.013s	sys 0.011s
I20260709 12:20:03.891822 20248 rpcz_store.cc:276] 0709 12:20:01.224350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.226051 (+  1701us) service_pool.cc:224] Handling call
0709 12:20:01.226346 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.241647 (+ 15301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.241680 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.242146 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.721457 (+479311us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:01.721502 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.775606 (+2054104us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54002fce54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:03.775689 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:03.775768 (+    79us) raft_consensus.cc:1685] finished
0709 12:20:03.775787 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.820672 (+ 44885us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6243,"spinlock_wait_cycles":34289024,"thread_start_us":478917,"threads_started":1,"wal-append.queue_time_us":611333,"wal-append.run_cpu_time_us":3311,"wal-append.run_wall_time_us":1179011}
I20260709 12:20:03.862042 26859 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:03.923264 20295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.013s	sys 0.011s
I20260709 12:20:03.928339 20175 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:03.922894 26858 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.903229 26908 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.768237 26771 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:03.540983 26730 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.966508 26795 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:03.967986 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2264) took 1269 ms. Trace:
I20260709 12:20:04.052809 20324 rpcz_store.cc:276] 0709 12:20:02.698267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.701363 (+  3096us) service_pool.cc:224] Handling call
0709 12:20:02.701696 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.873686 (+171990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.967538 (+1093852us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400125cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:03.967861 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376751488}
I20260709 12:20:03.969904 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.054821 20173 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:03.972873 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.056823 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.057411 20178 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
W20260709 12:20:03.974670 20176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1187) took 1791 ms (client timeout 2273 ms). Trace:
W20260709 12:20:04.058405 20176 rpcz_store.cc:269] 0709 12:20:02.183712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.184792 (+  1080us) service_pool.cc:224] Handling call
0709 12:20:03.974404 (+1789612us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002409d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:03.974578 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330704256}
I20260709 12:20:03.976168 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:03.988130 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2132) took 1084 ms. Trace:
I20260709 12:20:03.991093 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3647) took 1239 ms. Trace:
I20260709 12:20:03.996996 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:03.999462 26789 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:04.018106 26824 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.061981 20175 rpcz_store.cc:276] 0709 12:20:02.752042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.093409 (+341367us) service_pool.cc:224] Handling call
0709 12:20:03.990826 (+897417us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400319cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:03.990980 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226004736}
W20260709 12:20:04.073021 20249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.010s	sys 0.038s
W20260709 12:20:04.073530 20249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.010s	sys 0.038s
I20260709 12:20:04.060335 20172 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:04.075474 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1193) took 1336 ms. Trace:
I20260709 12:20:04.075860 20172 rpcz_store.cc:276] 0709 12:20:02.739507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.975827 (+1236320us) service_pool.cc:224] Handling call
0709 12:20:04.075410 (+ 99583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:04.076712 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.055356 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3650) took 1277 ms. Trace:
I20260709 12:20:04.077292 20173 rpcz_store.cc:276] 0709 12:20:02.778445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.969481 (+1191036us) service_pool.cc:224] Handling call
0709 12:20:04.055289 (+ 85808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:04.035734 26794 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:03.959332 26916 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:03.588219 26886 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.591183 26863 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.039907 26650 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.040264 26922 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:03.746021 26906 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.042337 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 954) took 1328 ms. Trace:
I20260709 12:20:04.042554 26746 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.042351 26908 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.078140 26867 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.043108 26913 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.961234 26917 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.044014 26839 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.044215 26784 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:03.543215 26591 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:03.954768 26859 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.046972 26645 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:04.047430 26697 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.063648 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.135118 20176 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:04.135783 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3646) took 1384 ms. Trace:
I20260709 12:20:04.136159 20176 rpcz_store.cc:276] 0709 12:20:02.751744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.059299 (+1307555us) service_pool.cc:224] Handling call
0709 12:20:04.135699 (+ 76400us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:04.066361 26852 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.410s	user 0.012s	sys 0.000s
I20260709 12:20:04.066928 26837 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.043021 26912 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.067965 26791 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:04.068499 20145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.050s	sys 0.075s
W20260709 12:20:04.190308 20145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.051s	sys 0.076s
I20260709 12:20:03.741688 26909 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.978s
I20260709 12:20:04.206554 26917 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.207347 26917 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.209916 26917 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.060894 20254 rpcz_store.cc:276] 0709 12:20:02.903283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.903409 (+   126us) service_pool.cc:224] Handling call
0709 12:20:02.903702 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.475316 (+571614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.987810 (+512494us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54000d8754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:03.988047 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222850944}
I20260709 12:20:04.076635 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:04.037993 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.080500 26729 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:04.048628 26904 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.082034 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3648) took 1329 ms. Trace:
W20260709 12:20:04.083530 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.025s	sys 0.042s
W20260709 12:20:04.236028 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.025s	sys 0.043s
I20260709 12:20:04.235846 20172 rpcz_store.cc:276] 0709 12:20:02.752352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.076479 (+1324127us) service_pool.cc:224] Handling call
0709 12:20:04.081972 (+  5493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11136}
I20260709 12:20:03.553447 26907 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.237317 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.238157 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3643) took 1487 ms. Trace:
I20260709 12:20:04.238479 20172 rpcz_store.cc:276] 0709 12:20:02.750774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.236967 (+1486193us) service_pool.cc:224] Handling call
0709 12:20:04.238078 (+  1111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:04.239042 26907 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:03.615231 26910 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:04.239646 26904 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.240273 26904 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.241453 26910 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:04.242058 20255 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:04.242476 26904 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.242978 26904 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:04.075736 20143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.031s	sys 0.022s
W20260709 12:20:04.243816 20143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.031s	sys 0.022s
I20260709 12:20:04.086078 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.231724 26771 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.112110 21043 rpcz_store.cc:276] 0709 12:20:02.713967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.714110 (+   143us) service_pool.cc:224] Handling call
0709 12:20:02.719358 (+  5248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.719783 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.719825 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:02.720332 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:20:02.995925 (+275593us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:02.995987 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.996089 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.042074 (+1045985us) raft_consensus.cc:1685] finished
0709 12:20:04.042104 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.042265 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4033,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5953,"thread_start_us":195583,"threads_started":1,"wal-append.queue_time_us":1300641}
I20260709 12:20:04.122706 26925 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.245909 26771 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.042739 26926 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.245031 26906 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.247881 26926 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.243438 26904 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.250706 26926 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.125188 26903 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.125705 26858 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:04.115144 26650 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.083753 26724 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.089571 26923 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.131644 26913 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.231266 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3645) took 1479 ms. Trace:
I20260709 12:20:04.262006 20175 rpcz_store.cc:276] 0709 12:20:02.751422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.076373 (+1324951us) service_pool.cc:224] Handling call
0709 12:20:04.231174 (+154801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:04.231353 26680 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.245039 20173 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:04.246767 26925 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.124265 26863 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.129179 26746 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.252302 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:04.256309 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.029s	sys 0.047s
W20260709 12:20:04.274523 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.251s	user 0.030s	sys 0.047s
I20260709 12:20:04.129920 26867 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.258522 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:04.251187 26904 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.263370 26926 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.264511 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1196) took 1380 ms. Trace:
I20260709 12:20:04.286023 20173 rpcz_store.cc:276] 0709 12:20:02.884388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.077959 (+1193571us) service_pool.cc:224] Handling call
0709 12:20:04.264415 (+186456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:04.286440 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1195) took 1545 ms. Trace:
I20260709 12:20:04.302452 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:04.303395 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
W20260709 12:20:04.261472 26764 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.386s	user 0.010s	sys 0.003s
I20260709 12:20:04.308841 25656 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.116277 26922 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.309506 25656 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.309790 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:04.262955 26885 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.367s	user 0.006s	sys 0.007s
I20260709 12:20:04.254814 26917 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:04.252031 26837 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.318269 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 3726) took 1420 ms. Trace:
I20260709 12:20:04.256204 26851 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:04.186697 26645 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:04.263162 26781 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.502s	user 0.014s	sys 0.000s
I20260709 12:20:04.259742 26910 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:04.262058 26858 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.260236 26907 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.196985 26697 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.260077 26909 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:04.262955 26724 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.185721 26852 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.255970 26650 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.212118 26912 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.264264 26923 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.319990 21039 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
W20260709 12:20:04.437718 20253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.007s	sys 0.021s
W20260709 12:20:04.755295 20253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.011s	sys 0.029s
I20260709 12:20:04.755745 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.300980 20176 rpcz_store.cc:276] 0709 12:20:02.740633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.136946 (+1396313us) service_pool.cc:224] Handling call
0709 12:20:04.286353 (+149407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:04.607721 26591 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.757292 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.757972 21039 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:04.758116 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1191) took 2020 ms. Trace:
I20260709 12:20:04.609616 26730 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.758908 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.759781 26837 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.761332 26697 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:04.354279 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.762228 26837 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.652748 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:04.611786 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 368436us
I20260709 12:20:04.764669 26645 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:04.610731 26895 consensus_meta.cc:287] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.376s	user 0.012s	sys 0.000s
I20260709 12:20:04.765585 26895 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.766700 20174 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:04.367075 26885 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.462291 26905 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:04.429809 26902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.009s	sys 0.013s
W20260709 12:20:04.769362 26902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.009s	sys 0.021s
I20260709 12:20:04.769601 26932 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.770016 26724 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.405980 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1495) took 1519 ms. Trace:
I20260709 12:20:04.770427 26932 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.771101 21041 rpcz_store.cc:276] 0709 12:20:02.886734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.899690 (+ 12956us) service_pool.cc:224] Handling call
0709 12:20:02.899986 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.900216 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:03.890104 (+989888us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.405590 (+515486us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.405654 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:04.405717 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.405788 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.405921 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29503,"prepare.queue_time_us":1105290,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":29641,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":51693,"thread_start_us":1390806,"threads_started":2}
I20260709 12:20:04.772317 26858 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.773412 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:04.405398 26796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.354s	user 0.002s	sys 0.021s
I20260709 12:20:04.382609 26757 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.775326 26757 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.308779 26746 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.777649 26757 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.778256 26907 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.336654 26904 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:20:04.354645 26756 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.698s	user 0.011s	sys 0.003s
I20260709 12:20:04.779425 26851 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.763192 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.765583 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.780056 26917 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.704730 26771 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.438405 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.783443 26920 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:04.703758 26854 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.319492 26764 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:04.730859 26928 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:04.354841 26853 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.480s	user 0.013s	sys 0.000s
I20260709 12:20:04.769933 26885 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:04.780818 26781 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:04.804003 26923 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.770479 26909 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.781147 20172 rpcz_store.cc:276] 0709 12:20:02.898073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.239151 (+1341078us) service_pool.cc:224] Handling call
0709 12:20:04.318193 (+ 79042us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:04.572086 20293 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.001s	sys 0.012s
I20260709 12:20:04.781121 20171 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:04.796614 20221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.012s	sys 0.006s
I20260709 12:20:04.850494 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:04.587136 26871 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:04.336267 26926 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:04.858085 26789 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.005s
I20260709 12:20:04.846294 26910 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:04.774892 26796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.724s	user 0.004s	sys 0.027s
I20260709 12:20:04.835253 26946 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:05.074733 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1188) took 2873 ms. Trace:
I20260709 12:20:04.758697 20176 rpcz_store.cc:276] 0709 12:20:02.738132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.757057 (+2018925us) service_pool.cc:224] Handling call
0709 12:20:04.757509 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.757779 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.757808 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:04.757855 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:04.757887 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.757954 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.758058 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:05.190637 20221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.013s	sys 0.010s
W20260709 12:20:05.181361 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:05.191491 20293 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.005s	sys 0.017s
I20260709 12:20:05.197158 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:05.203240 25656 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:05.249933 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1192) took 2511 ms. Trace:
I20260709 12:20:05.250443 20172 rpcz_store.cc:276] 0709 12:20:02.738454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.202288 (+2463834us) service_pool.cc:224] Handling call
0709 12:20:05.249497 (+ 47209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.249655 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.249676 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.249714 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:05.249753 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.249799 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.249877 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:05.253170 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56118.7us
I20260709 12:20:05.263063 20326 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:05.269430 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:05.239980 20180 rpcz_store.cc:276] 0709 12:20:02.201126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.641471 (+440345us) service_pool.cc:224] Handling call
0709 12:20:02.650237 (+  8766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.650573 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.650615 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:02.660441 (+  9826us) log.cc:844] Serialized 26 byte log entry
0709 12:20:02.737846 (+ 77405us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:02.742250 (+  4404us) log.cc:844] Serialized 14 byte log entry
0709 12:20:04.781763 (+2039513us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18003ceaa0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:20:05.037440 (+255677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.037579 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.037648 (+    69us) raft_consensus.cc:1685] finished
0709 12:20:05.074416 (+ 36768us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.074635 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604,"prepare.queue_time_us":9341,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":46185,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":22370,"spinlock_wait_cycles":24506112,"thread_start_us":326814,"threads_started":2,"wal-append.queue_time_us":61801,"wal-append.run_cpu_time_us":2662,"wal-append.run_wall_time_us":1093132}
I20260709 12:20:05.270129 20330 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:05.278301 26781 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:05.279000 26850 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:05.279057 26781 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.279878 26850 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.280633 26946 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:05.281424 26946 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.283052 26917 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.285022 26932 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.284960 26765 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:05.285959 26765 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:05.287597 26932 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:05.288578 26932 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:04.896709 26922 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:05.200791 26928 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.253234 20329 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:04.897413 26867 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:04.933588 26925 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.198881 26931 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:05.039808 26921 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:05.208078 26756 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:05.323212 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:05.540128 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1178) took 3387 ms. Trace:
I20260709 12:20:05.545401 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:05.393074 20324 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:05.558029 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:05.544785 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:05.565815 20325 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:05.560119 20177 rpcz_store.cc:276] 0709 12:20:02.153125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.183539 (+ 30414us) service_pool.cc:224] Handling call
0709 12:20:02.183863 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.184209 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.184240 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:02.201588 (+ 17348us) log.cc:844] Serialized 26 byte log entry
0709 12:20:03.994261 (+1792673us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b180049f120. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:20:04.405887 (+411626us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:04.924088 (+518201us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.279204 (+355116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.279295 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.391555 (+112260us) raft_consensus.cc:1685] finished
0709 12:20:05.539837 (+148282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.540042 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354810,"raft.queue_time_us":355280,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10473,"spinlock_wait_cycles":42444416,"thread_start_us":842703,"threads_started":2,"wal-append.queue_time_us":2975600}
I20260709 12:20:05.207548 26912 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.220185 26904 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:05.385417 26942 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:20:05.209874 26837 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:05.596305 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.059794 20323 raft_consensus.cc:2410] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:20:05.268152 26650 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:05.390096 26937 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:20:05.305279 26808 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.323515 26789 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:05.552140 26746 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.386341 26858 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:06.061556 26837 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:05.382562 26852 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.387164 26926 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.217221 26853 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.386653 26895 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.552626 26724 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.556169 26897 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.388274 26764 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.221310 26873 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.401s
I20260709 12:20:05.385965 26909 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.252470 26920 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.086486 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.087188 20324 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:05.266971 26871 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:05.610425 26931 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.088264 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:05.637502 26771 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:05.925817 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.000s	sys 0.000s
I20260709 12:20:05.845055 26930 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:05.778779 26765 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.846866 26932 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.779824 26886 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:05.889277 26936 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.611s	user 0.004s	sys 0.000s
I20260709 12:20:05.897507 26946 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:05.912458 26955 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:05.740305 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3642) took 2989 ms. Trace:
I20260709 12:20:06.094590 20180 rpcz_store.cc:276] 0709 12:20:02.750466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.592252 (+2841786us) service_pool.cc:224] Handling call
0709 12:20:05.679469 (+ 87217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.739783 (+ 60314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.739818 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.739868 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:05.739915 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.740085 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.740234 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:05.626046 26933 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:05.847460 26956 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.857903 26917 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:06.111853 26917 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.113958 26917 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.858183 26796 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:06.114694 26796 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.849128 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:06.116411 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 267379us
I20260709 12:20:05.621723 26784 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:05.637557 26787 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.120157 26787 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.121994 26787 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:05.638717 26921 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:05.926390 26957 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.124555 26957 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.119277 26933 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:05.960152 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3640) took 3210 ms. Trace:
I20260709 12:20:06.111341 26956 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.126668 20172 rpcz_store.cc:276] 0709 12:20:02.749458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.252404 (+2502946us) service_pool.cc:224] Handling call
0709 12:20:05.560026 (+307622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:05.810768 (+250742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.810800 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:05.829991 (+ 19191us) log.cc:844] Serialized 26 byte log entry
0709 12:20:05.939835 (+109844us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:05.940606 (+   771us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.941159 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.941377 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.959842 (+ 18465us) raft_consensus.cc:1685] finished
0709 12:20:05.959870 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.960066 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265110,"prepare.queue_time_us":187,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":52,"raft.queue_time_us":261988,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":19810,"thread_start_us":76279,"threads_started":1,"wal-append.queue_time_us":74843}
I20260709 12:20:06.129387 26956 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:05.919975 26756 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:06.018054 26950 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:20:06.026650 26781 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.093293 26771 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.030722 26928 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.032079 26907 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:06.033115 26951 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
W20260709 12:20:06.034004 26939 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:20:06.040648 26904 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.132108 26771 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.133773 26957 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:05.638993 21034 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:20:06.065806 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:06.072395 20328 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.002s	sys 0.010s
W20260709 12:20:06.134756 20328 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.002s	sys 0.010s
I20260709 12:20:06.134828 20323 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:20:06.073380 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.008s	sys 0.007s
I20260709 12:20:06.075038 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2139) took 3066 ms. Trace:
W20260709 12:20:06.135639 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.009s	sys 0.007s
I20260709 12:20:06.065011 26808 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.135890 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.078079 26837 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:06.080858 20329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2263) took 3374 ms (client timeout 1587 ms). Trace:
I20260709 12:20:06.136521 20323 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:20:06.136723 20329 rpcz_store.cc:269] 0709 12:20:02.697955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.699298 (+  1343us) service_pool.cc:224] Handling call
0709 12:20:06.071817 (+3372519us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54002b6454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:06.071978 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5798949760}
I20260709 12:20:06.137409 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.082314 26840 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:06.066978 26789 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.084444 26853 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.088130 20179 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:06.089865 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.000s	sys 0.005s
I20260709 12:20:06.101419 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.139441 20324 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:06.143906 20219 connection.cc:256] RPC call timeout handler was delayed by -1.0379368429998976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:20:06.145574 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 934435us
I20260709 12:20:06.148126 26957 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:06.137980 20323 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:20:06.101760 20295 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.710s (SENT) [suppressed 8 similar messages]
I20260709 12:20:06.092308 26930 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.155026 26781 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:06.156148 26952 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.330s	user 0.008s	sys 0.001s
I20260709 12:20:06.156831 26930 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.102909 26871 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:06.103343 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.158576 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.158946 20324 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:06.159737 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.160334 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:06.106323 26931 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.107641 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:06.161319 20178 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3649) took 3408 ms (client timeout 2119 ms). Trace:
W20260709 12:20:06.161703 20178 rpcz_store.cc:269] 0709 12:20:02.752738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.058001 (+1305263us) service_pool.cc:224] Handling call
0709 12:20:06.107447 (+2049446us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:20:06.161240 (+ 53793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34996992}
I20260709 12:20:06.162710 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.163269 20178 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
W20260709 12:20:06.108768 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3644) took 3357 ms (client timeout 1941 ms). Trace:
W20260709 12:20:06.163746 20171 rpcz_store.cc:269] 0709 12:20:02.751077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.996600 (+1245523us) service_pool.cc:224] Handling call
0709 12:20:06.108498 (+2111898us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002c4554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:06.108648 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650237312}
I20260709 12:20:06.164801 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.165016 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.105507 26920 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.096524 26910 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.123718 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1745) took 3048 ms. Trace:
I20260709 12:20:06.122680 26784 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.129310 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.180426 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:05.882906 26788 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:20:06.030220 26851 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.137956 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.138494 26789 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:06.160403 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 955) took 3259 ms. Trace:
I20260709 12:20:06.168320 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.185672 21038 rpcz_store.cc:276] 0709 12:20:02.901102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.950540 (+ 49438us) service_pool.cc:224] Handling call
0709 12:20:03.278829 (+328289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.754546 (+1475717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.754580 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.760263 (+  5683us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.888280 (+128017us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:04.888345 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.110037 (+1221692us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400406fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:06.110076 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.155483 (+ 45407us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:06.160156 (+  4673us) raft_consensus.cc:1685] finished
0709 12:20:06.160177 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.160317 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57870,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":1526712192,"thread_start_us":500182,"threads_started":2,"wal-append.queue_time_us":809544}
W20260709 12:20:06.118176 20221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.009s	sys 0.048s
W20260709 12:20:06.173830 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72096.2us
I20260709 12:20:06.176349 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:06.187624 20221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.009s	sys 0.048s
I20260709 12:20:06.165578 20326 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:20:06.178094 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.133981 26796 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.123317 26917 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:06.179139 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.135725 20253 rpcz_store.cc:276] 0709 12:20:03.009106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.009313 (+   207us) service_pool.cc:224] Handling call
0709 12:20:03.052960 (+ 43647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.276070 (+223110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.276120 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.284698 (+  8578us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.755853 (+1471155us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:04.755903 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.755993 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.074786 (+1318793us) raft_consensus.cc:1685] finished
0709 12:20:06.074812 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.074965 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":714012,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":46189,"thread_start_us":1497571,"threads_started":2,"wal-append.queue_time_us":1530238}
I20260709 12:20:06.180804 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.178617 20249 rpcz_store.cc:276] 0709 12:20:03.075467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.474665 (+399198us) service_pool.cc:224] Handling call
0709 12:20:03.482385 (+  7720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.845511 (+1363126us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b18000cd240. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaef0bfb 00007f5ddaefb64b
0709 12:20:04.845729 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.845771 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.882656 (+ 36885us) log.cc:844] Serialized 26 byte log entry
0709 12:20:05.195418 (+312762us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:05.195532 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.195700 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.118363 (+922663us) raft_consensus.cc:1685] finished
0709 12:20:06.118387 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.123634 (+  5247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25036,"raft.queue_time_us":478787,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":24006,"spinlock_wait_cycles":95556864,"thread_start_us":820223,"threads_started":2,"wal-append.queue_time_us":626708}
I20260709 12:20:06.192027 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.181322 21039 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 12:20:06.181898 20255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 2136) took 3273 ms (client timeout 2101 ms). Trace:
I20260709 12:20:06.180621 20172 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:06.183677 20329 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 12:20:06.192791 20255 rpcz_store.cc:269] 0709 12:20:02.905112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.905221 (+   109us) service_pool.cc:224] Handling call
0709 12:20:06.177904 (+3272683us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54001978d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:06.178010 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197948672}
I20260709 12:20:06.183548 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.189301 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:06.196029 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1508) took 1409 ms. Trace:
I20260709 12:20:06.189779 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.197383 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.198200 20326 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:20:06.199337 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:06.202901 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8343571759999122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:20:06.203491 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7803571760000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 12:20:06.196501 21039 rpcz_store.cc:276] 0709 12:20:04.786853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.180157 (+1393304us) service_pool.cc:224] Handling call
0709 12:20:06.195951 (+ 15794us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:06.205334 26935 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.921s	user 0.008s	sys 0.020s
I20260709 12:20:06.206157 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.207592 26784 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.212281 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.215341 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:06.216583 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48331.3us
I20260709 12:20:06.218014 20295 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.218848 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.207612 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.219679 20254 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:20:06.213141 20172 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:06.226842 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.227350 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.227649 20254 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:06.217324 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.229480 20249 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:06.233263 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.184089 26933 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.234489 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.237494 20253 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:06.237695 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.178548 26928 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:20:06.236805 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.238354 20323 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
W20260709 12:20:06.238545 20144 connection.cc:256] RPC call timeout handler was delayed by -1.63375922299997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 12:20:06.191490 26917 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.240007 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:06.240624 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6292592229999627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 12:20:06.231099 26940 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.242707 26946 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:06.248610 26940 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:06.248708 26946 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.249169 26940 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.249235 26946 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:06.243587 26956 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:06.242172 26928 consensus_queue.cc:1243] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:06.251762 26956 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:06.234934 26904 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:06.252224 26956 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.252545 26904 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:06.252900 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:06.253027 26904 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:06.254168 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.252235 26917 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:06.255636 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.252988 26928 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:06.256292 20172 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:06.256467 26928 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.256945 26928 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:06.257180 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.257761 20172 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:06.258535 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.259222 20172 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:06.260129 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.263962 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.254380 26910 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.265388 26910 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.265810 26910 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.259112 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.270038 26912 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:06.270448 26912 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:06.270829 26912 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:06.272053 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.273861 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.274168 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.274478 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:06.287963 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 3729) took 3389 ms (client timeout 1710 ms). Trace:
W20260709 12:20:06.288416 20179 rpcz_store.cc:269] 0709 12:20:02.898924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.907673 (+1008749us) service_pool.cc:224] Handling call
0709 12:20:06.287736 (+2380063us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54002364d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:06.287883 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5010438400}
I20260709 12:20:06.275709 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:06.232753 26958 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:06.279903 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.289143 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.280431 26788 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:06.290520 26922 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:06.290257 26788 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.290920 26922 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.291332 26922 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:06.291932 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:06.293134 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.293880 20251 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:06.294664 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.295809 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:06.281469 20250 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:06.297322 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.282523 26850 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.282284 26789 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.283334 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.304618 20330 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:06.309042 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.309717 20251 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:06.263199 26917 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:06.284145 20174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1194) took 3544 ms (client timeout 1632 ms). Trace:
I20260709 12:20:06.285359 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.286827 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3639) took 3537 ms. Trace:
I20260709 12:20:06.299021 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:06.313799 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:06.313869 20174 rpcz_store.cc:269] 0709 12:20:02.740335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.978392 (+238057us) service_pool.cc:224] Handling call
0709 12:20:06.283943 (+3305551us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540031b5d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:06.284064 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3520619392}
I20260709 12:20:06.301127 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.302358 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:06.314148 20176 rpcz_store.cc:276] 0709 12:20:02.749011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.240395 (+2491384us) service_pool.cc:224] Handling call
0709 12:20:05.284706 (+ 44311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.379475 (+ 94769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.379525 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.379628 (+   103us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:05.379690 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.286570 (+906880us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b540031b0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:06.286625 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.286764 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217085312}
I20260709 12:20:06.317952 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.318426 26789 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.319065 26789 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:06.319595 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.320063 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.321012 20174 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:06.321574 20325 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:06.311738 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 127036us
I20260709 12:20:06.312718 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.313800 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.314890 20327 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:06.298034 26958 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:06.320019 26940 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.304325 26933 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:20:06.321514 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.393129 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3727) took 3494 ms. Trace:
I20260709 12:20:06.396922 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.402410 20174 rpcz_store.cc:276] 0709 12:20:02.898382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.392217 (+3493835us) service_pool.cc:224] Handling call
0709 12:20:06.392628 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.392832 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.392856 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.392894 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:06.392933 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.392988 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.393075 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.319084 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.405205 20256 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:06.396955 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75992.2us
I20260709 12:20:06.405752 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3728) took 3507 ms. Trace:
I20260709 12:20:06.406109 20174 rpcz_store.cc:276] 0709 12:20:02.898656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.404661 (+3506005us) service_pool.cc:224] Handling call
0709 12:20:06.405113 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.405377 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.405419 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.405477 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:06.405520 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.405568 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.405692 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.393038 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 947) took 3831 ms. Trace:
I20260709 12:20:06.406832 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.409761 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3730) took 3510 ms. Trace:
I20260709 12:20:06.410610 20174 rpcz_store.cc:276] 0709 12:20:02.899188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.408768 (+3509580us) service_pool.cc:224] Handling call
0709 12:20:06.409119 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.409345 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.409382 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.409440 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:06.409486 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.409553 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.409692 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.413458 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3731) took 3514 ms. Trace:
I20260709 12:20:06.407279 21034 rpcz_store.cc:276] 0709 12:20:02.561364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.564694 (+  3330us) service_pool.cc:224] Handling call
0709 12:20:02.565046 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.134665 (+3569619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.392748 (+258083us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b540056c7d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:06.392972 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7068666112}
I20260709 12:20:06.408239 20247 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 9.
I20260709 12:20:06.416589 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.416957 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.355679 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:06.418596 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:06.418702 21007 connection.cc:256] RPC call timeout handler was delayed by -1.5450000230000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
I20260709 12:20:06.428026 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.434301 20172 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:06.319474 26789 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.437983 20329 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 14: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:06.457435 20251 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:06.467751 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.468717 20247 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:20:06.402101 26958 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:06.469844 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 180784us
I20260709 12:20:06.470307 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.472308 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.464751 20174 rpcz_store.cc:276] 0709 12:20:02.899457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.412472 (+3513015us) service_pool.cc:224] Handling call
0709 12:20:06.412818 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.413037 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.413075 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.413136 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:06.413182 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.413251 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.413382 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:06.473836 21007 connection.cc:256] RPC call timeout handler was delayed by -1.3434000230001857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 12:20:06.474339 21007 connection.cc:256] RPC call timeout handler was delayed by -1.1762979069999346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:20:06.474745 21007 connection.cc:256] RPC call timeout handler was delayed by -1.0185000230001151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25110000000000005s for a response
I20260709 12:20:06.475360 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:06.476542 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.418206 26851 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:20:06.430665 26863 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.480489 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.480904 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.481496 20322 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:06.320616 26850 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:06.481178 20327 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:06.485571 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.468986 26789 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:06.488794 20330 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:06.489045 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.492635 20248 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
W20260709 12:20:06.492851 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 84880.3us
I20260709 12:20:06.493741 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.494179 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.494694 20324 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:06.492865 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.496889 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1489) took 1253 ms. Trace:
I20260709 12:20:06.491379 20251 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:06.495028 20327 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 8.
I20260709 12:20:06.499946 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.499683 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:06.500890 20172 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:06.499280 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.501591 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.497278 20328 rpcz_store.cc:276] 0709 12:20:05.243929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.244038 (+   109us) service_pool.cc:224] Handling call
0709 12:20:05.244385 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.244636 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:06.135180 (+890544us) log.cc:844] Serialized 14 byte log entry
0709 12:20:06.496290 (+361110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.496372 (+    82us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:06.496458 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.496710 (+   252us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.496835 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":827971,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"thread_start_us":1149371,"threads_started":3,"wal-append.queue_time_us":344907}
I20260709 12:20:06.486805 26863 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.485512 26756 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:20:06.505981 26956 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:06.506980 20249 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.508081 26956 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.509099 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.508785 26946 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.511987 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.519922 26969 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:06.520650 26969 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.522915 26969 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.519994 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.496685 26787 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:06.523952 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.524819 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.525279 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.525619 21036 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 9.
I20260709 12:20:06.502434 20248 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:06.526587 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:06.527215 21034 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:06.527494 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.529583 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.530236 20248 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:06.531301 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.532500 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1197) took 3632 ms. Trace:
I20260709 12:20:06.532963 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.532884 20172 rpcz_store.cc:276] 0709 12:20:02.900225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.501616 (+3601391us) service_pool.cc:224] Handling call
0709 12:20:06.531985 (+ 30369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.532180 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.532206 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.532250 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:06.532291 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.532347 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.532446 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.533736 21042 raft_consensus.cc:2410] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:20:06.534621 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3732) took 3633 ms. Trace:
I20260709 12:20:06.535017 20172 rpcz_store.cc:276] 0709 12:20:02.900968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.533857 (+3632889us) service_pool.cc:224] Handling call
0709 12:20:06.534149 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.534322 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.534350 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.534391 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:06.534423 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.534474 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.534567 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.537106 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3733) took 3635 ms. Trace:
I20260709 12:20:06.537477 20172 rpcz_store.cc:276] 0709 12:20:02.901244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.536321 (+3635077us) service_pool.cc:224] Handling call
0709 12:20:06.536608 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.536838 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.536860 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.536900 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:06.536929 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.536976 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.537061 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.538563 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:06.539489 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3734) took 3563 ms. Trace:
I20260709 12:20:06.539878 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.540035 20172 rpcz_store.cc:276] 0709 12:20:02.976355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.538573 (+3562218us) service_pool.cc:224] Handling call
0709 12:20:06.538828 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.538996 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.539019 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.539059 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:06.539090 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.539218 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.539330 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.542435 20248 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:06.542685 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.543538 20172 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:06.542763 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:06.544248 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.545634 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1190) took 3921 ms. Trace:
I20260709 12:20:06.546217 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.548305 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3735) took 3548 ms. Trace:
I20260709 12:20:06.548713 20172 rpcz_store.cc:276] 0709 12:20:03.000450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.541401 (+3540951us) service_pool.cc:224] Handling call
0709 12:20:06.543373 (+  1972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.548066 (+  4693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.548248 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.549803 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.549975 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.551538 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.477324 26922 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.546080 20175 rpcz_store.cc:276] 0709 12:20:02.624810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.272335 (+1647525us) service_pool.cc:224] Handling call
0709 12:20:04.272786 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:05.195781 (+922995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.195827 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:05.210015 (+ 14188us) log.cc:844] Serialized 26 byte log entry
0709 12:20:06.104713 (+894698us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800385d80. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:20:06.410755 (+306042us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:06.430138 (+ 19383us) log.cc:844] Serialized 14 byte log entry
0709 12:20:06.430490 (+   352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.430616 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:06.534414 (+103798us) raft_consensus.cc:1685] finished
0709 12:20:06.545349 (+ 10935us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.545554 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217547,"prepare.queue_time_us":19009,"prepare.run_wall_time_us":27143,"raft.queue_time_us":978373,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":263003,"spinlock_wait_cycles":48446080,"thread_start_us":305837,"threads_started":1,"wal-append.queue_time_us":954252}
I20260709 12:20:06.595214 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.554679 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3737) took 3459 ms. Trace:
W20260709 12:20:06.623245 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 319551us
I20260709 12:20:06.599752 26913 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.555507 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.712473 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.628405 26946 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.714708 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.553841 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.715507 20328 raft_consensus.cc:2376] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18. Re-sending same reply.
I20260709 12:20:06.561559 21034 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:06.552172 26886 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.716403 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.712286 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:06.582479 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109098us
I20260709 12:20:06.599929 26904 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:06.696674 26963 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:20:06.717239 26886 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:06.557497 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:06.721612 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.555193 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.718502 20330 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:06.713063 20172 rpcz_store.cc:276] 0709 12:20:03.095477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.549309 (+3453832us) service_pool.cc:224] Handling call
0709 12:20:06.554052 (+  4743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.554279 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.554328 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.554388 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:06.554433 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.554501 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.554616 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.731859 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1496) took 1203 ms. Trace:
I20260709 12:20:06.734814 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.753340 20248 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 8.
I20260709 12:20:06.555636 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.574340 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.717860 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3738) took 3496 ms. Trace:
I20260709 12:20:06.756268 20175 rpcz_store.cc:276] 0709 12:20:03.221620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.716968 (+3495348us) service_pool.cc:224] Handling call
0709 12:20:06.717309 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.717518 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.717547 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.717596 (+    49us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:20:06.717645 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.717701 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.717802 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.753011 21035 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:06.582259 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.755982 20325 rpcz_store.cc:276] 0709 12:20:05.528195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.592436 (+ 64241us) service_pool.cc:224] Handling call
0709 12:20:05.648789 (+ 56353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.403816 (+755027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.731518 (+327702us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b540015e0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:06.731776 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507740544}
I20260709 12:20:06.724200 26886 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.765141 26972 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:06.765528 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.765625 26972 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:06.734436 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3741) took 1450 ms. Trace:
I20260709 12:20:06.735955 20219 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:06.767176 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:06.737177 26904 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:06.766418 20325 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 22: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:06.766806 20173 rpcz_store.cc:276] 0709 12:20:05.284014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.733621 (+1449607us) service_pool.cc:224] Handling call
0709 12:20:06.733927 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.734115 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.734138 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.734179 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:06.734215 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.734266 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.734373 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:06.767946 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 210547us
I20260709 12:20:06.727039 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3740) took 1458 ms. Trace:
I20260709 12:20:06.725579 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.767997 20171 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:06.624881 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:06.581965 21008 connection.cc:256] RPC call timeout handler was delayed by -2.4482719079999242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 12:20:06.617872 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.813932 20174 rpcz_store.cc:276] 0709 12:20:05.269072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.726218 (+1457146us) service_pool.cc:224] Handling call
0709 12:20:06.726526 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.726716 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.726749 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:06.726797 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:06.726830 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.726883 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:06.726983 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:06.777621 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.815719 20328 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.777333 21042 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:06.814532 20251 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:06.815829 21034 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
W20260709 12:20:06.643203 26966 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 12:20:06.727455 26859 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.812839 21038 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:20:06.829090 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 93206us
I20260709 12:20:06.905766 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:06.829202 21008 connection.cc:256] RPC call timeout handler was delayed by -2.4261956470002133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
W20260709 12:20:06.906774 21008 connection.cc:256] RPC call timeout handler was delayed by -2.1836719079999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:20:06.907215 21008 connection.cc:256] RPC call timeout handler was delayed by -1.7576560480001717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 12:20:06.907600 21008 connection.cc:256] RPC call timeout handler was delayed by -1.6121680979999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25110000000000005s for a response
I20260709 12:20:06.772565 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:06.910682 20172 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:06.832165 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:06.697132 26970 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:20:06.766538 26756 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:06.711185 26789 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.834821 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.837399 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.813454 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:06.922258 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 108873us
I20260709 12:20:06.677166 26917 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.840590 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.842968 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.926030 20325 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:06.714771 26928 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.577250 26858 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:06.577347 26851 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.264s
I20260709 12:20:06.929682 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.809943 26933 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.850131 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.931250 20251 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:06.856086 26808 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:06.856572 20328 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:06.857089 26921 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:06.861532 26912 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.002s
I20260709 12:20:06.867592 20171 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
W20260709 12:20:06.870507 20220 connection.cc:256] RPC call timeout handler was delayed by -2.3511611269998411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 12:20:06.940376 20220 connection.cc:256] RPC call timeout handler was delayed by -2.1909611270000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 12:20:06.920502 26956 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:06.872961 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.865483 26958 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:06.872995 26910 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260709 12:20:06.885123 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.888967 26923 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.766234 26972 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:06.890413 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.930835 26858 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:06.893596 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.894852 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.897331 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.897699 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.971984 20323 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:06.973204 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.898800 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.903956 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.974643 21035 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 24.
W20260709 12:20:06.682287 26967 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:20:06.915808 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:06.996346 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 80627us
I20260709 12:20:06.909502 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:06.997396 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 87981.9us
I20260709 12:20:06.998060 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:06.998665 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:06.919763 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.855417 26788 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:06.845307 26940 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.953969 26917 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:06.873078 26945 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.944298 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.945559 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.018105 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.018500 20248 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:06.946148 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:06.947857 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.950067 20256 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:06.949854 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.952920 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.891729 26863 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:06.963585 20325 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:06.966140 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:06.999969 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:07.001421 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 245985us
I20260709 12:20:07.004364 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:06.933705 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:06.947808 26809 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:07.010371 20321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2282) took 1474 ms (client timeout 1731 ms). Trace:
I20260709 12:20:07.010890 20253 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:07.031499 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:07.014325 20323 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:07.021946 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75860.2us
I20260709 12:20:07.034637 20325 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:07.036235 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:07.037175 21035 raft_consensus.cc:2393] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:07.040150 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.041313 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.018133 20250 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:07.041877 21040 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 24.
I20260709 12:20:07.019053 20252 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:07.043123 26957 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:07.032356 26809 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:07.044625 26809 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:06.998063 26858 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:07.030287 20251 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:07.031224 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:07.033038 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.053409 20249 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:20:07.032598 20321 rpcz_store.cc:269] 0709 12:20:05.525971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.560242 (+ 34271us) service_pool.cc:224] Handling call
0709 12:20:06.159971 (+599729us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b5800150698. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:20:06.898645 (+738674us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5800150698. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3e9c 00007f5dd7dd3a5b 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:20:07.000333 (+101688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23872128}
I20260709 12:20:07.055111 20321 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:07.056034 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3600) took 1040 ms. Trace:
I20260709 12:20:07.056464 20323 rpcz_store.cc:276] 0709 12:20:06.015309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.013715 (+998406us) service_pool.cc:224] Handling call
0709 12:20:07.014063 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.055781 (+ 41718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.055974 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:07.058033 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:07.058818 26913 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:07.059657 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:07.060575 26837 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:07.060966 26837 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:07.061340 26837 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:07.003873 26956 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:07.063922 26956 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:07.064301 26957 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:07.009627 26871 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:07.064793 26957 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:07.064888 26871 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:07.065276 26957 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:07.065493 26871 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.072999 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1498) took 1012 ms. Trace:
I20260709 12:20:06.941263 26756 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:06.953789 26781 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:20:06.947014 26912 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:07.073541 20330 rpcz_store.cc:276] 0709 12:20:06.061085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.032187 (+971102us) service_pool.cc:224] Handling call
0709 12:20:07.072342 (+ 40155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.072588 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.072626 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.072684 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:07.072737 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.072807 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.072928 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:07.021008 26675 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.091132 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.089386 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.032009 26788 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.017541 26917 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:07.110697 26886 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.111259 26917 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.112989 26917 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.114176 26886 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.028344 26945 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.967760 26910 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:07.116262 26945 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:07.117681 20324 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:07.064415 26956 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:07.103773 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.119040 26912 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:07.120708 26910 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.121275 26756 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:07.124377 26789 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:07.104574 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:06.995217 26923 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.096870 20247 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:07.117753 20255 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:07.095062 26675 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:07.128126 26675 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.128403 26923 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:07.109930 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.127065 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.134944 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:07.143232 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.147630 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.149461 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3755) took 1120 ms. Trace:
I20260709 12:20:07.152722 20247 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:07.150738 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 334374us
W20260709 12:20:07.025298 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 480304us
I20260709 12:20:07.152019 20174 rpcz_store.cc:276] 0709 12:20:06.028901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.827413 (+798512us) service_pool.cc:224] Handling call
0709 12:20:06.827814 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.828048 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:06.915235 (+ 87187us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.149111 (+233876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.149180 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.149234 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.149301 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.149407 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75440,"prepare.queue_time_us":120661,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":818,"thread_start_us":232177,"threads_started":1}
I20260709 12:20:07.184427 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.186620 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.156850 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.163455 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.189860 21038 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:07.190841 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.189661 20248 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:07.152568 26907 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:07.220279 20322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.010s	sys 0.023s
W20260709 12:20:07.220786 20322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.010s	sys 0.023s
I20260709 12:20:07.249961 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.150728 26922 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:07.149020 26953 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.014s
I20260709 12:20:07.212162 20073 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 20, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 20 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:07.264520 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.270395 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.209905 26928 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:07.273135 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:07.265792 26953 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.008s	sys 0.023s
I20260709 12:20:07.196419 26958 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.291391 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.152869 26850 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.280539 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2144) took 1049 ms. Trace:
I20260709 12:20:07.297889 20254 rpcz_store.cc:276] 0709 12:20:06.231063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.231380 (+   317us) service_pool.cc:224] Handling call
0709 12:20:06.231745 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.232116 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.232144 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.232654 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:20:06.889064 (+656410us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18001fb0a0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:20:07.149302 (+260238us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:07.149363 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.151410 (+  2047us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.280218 (+128808us) raft_consensus.cc:1685] finished
0709 12:20:07.280244 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.280473 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3192,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5196,"spinlock_wait_cycles":8645888,"thread_start_us":259976,"threads_started":1,"wal-append.queue_time_us":1036050}
I20260709 12:20:07.280793 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.282160 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.301294 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 2926) took 1049 ms. Trace:
I20260709 12:20:07.301807 20255 rpcz_store.cc:276] 0709 12:20:06.259690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.259857 (+   167us) service_pool.cc:224] Handling call
0709 12:20:07.301087 (+1041230us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54003e9254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:07.301230 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970261760}
W20260709 12:20:07.295006 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 295850us
I20260709 12:20:07.295544 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.303045 21034 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:20:07.303098 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.295742 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.297318 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.304713 20247 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:07.320207 20323 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:07.321650 20255 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 14: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:07.323112 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.324434 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.324662 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:07.327323 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:07.329303 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 250553us
I20260709 12:20:07.333813 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:07.334398 20249 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:07.333329 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.336539 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.336854 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.337863 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.338225 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.338088 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.337517 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 2152) took 1062 ms. Trace:
I20260709 12:20:07.335933 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.340468 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.343466 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.344763 20172 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:07.340260 20248 rpcz_store.cc:276] 0709 12:20:06.275298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.331429 (+1056131us) service_pool.cc:224] Handling call
0709 12:20:07.337461 (+  6032us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:07.346509 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 261084us
I20260709 12:20:07.347882 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.373132 26788 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:07.374277 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1753) took 1095 ms. Trace:
I20260709 12:20:07.386868 20254 rpcz_store.cc:276] 0709 12:20:06.278717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.342506 (+1063789us) service_pool.cc:224] Handling call
0709 12:20:07.373680 (+ 31174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.373894 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.373920 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.373970 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:07.374016 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.374086 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.374215 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:07.375329 20251 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:07.376348 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:07.378044 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.378432 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.390368 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.391074 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.379689 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.380592 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.380669 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.382138 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.392587 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2933) took 1086 ms. Trace:
I20260709 12:20:07.397195 20250 rpcz_store.cc:276] 0709 12:20:06.306347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.342404 (+1036057us) service_pool.cc:224] Handling call
0709 12:20:07.391926 (+ 49522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.392159 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.392198 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.392260 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:07.392310 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.392384 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.392512 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:07.408939 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.403028 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:07.416715 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.421361 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.341660 26871 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.425280 26871 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:07.401321 26788 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.442121 26788 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:07.442325 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3596) took 1431 ms. Trace:
I20260709 12:20:07.445312 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:07.444892 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.448544 20247 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:07.442909 20322 rpcz_store.cc:276] 0709 12:20:06.010695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.509965 (+499270us) service_pool.cc:224] Handling call
0709 12:20:06.510265 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.551492 (+ 41227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.551542 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.552129 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.221249 (+669120us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:07.221314 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.221420 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.442062 (+220642us) raft_consensus.cc:1685] finished
0709 12:20:07.442089 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.442257 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31874,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10365,"thread_start_us":604491,"threads_started":2,"wal-append.queue_time_us":821087}
I20260709 12:20:07.451470 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2934) took 1074 ms. Trace:
I20260709 12:20:07.444834 26789 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:07.459844 26789 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:07.460292 26789 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:07.459193 26871 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:07.467801 26871 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.457484 20248 rpcz_store.cc:276] 0709 12:20:06.377533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.419130 (+1041597us) service_pool.cc:224] Handling call
0709 12:20:07.450866 (+ 31736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.451107 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.451146 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.451195 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:07.451225 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.451280 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.451400 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:07.468391 26871 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.464774 26957 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.470463 20249 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:07.467576 26675 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:07.470506 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67595.6us
I20260709 12:20:07.472713 26675 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:07.466292 26945 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.475029 20254 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:20:07.476423 20173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.023s	sys 0.039s
W20260709 12:20:07.476836 20173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.023s	sys 0.040s
I20260709 12:20:07.477993 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1760) took 1059 ms. Trace:
I20260709 12:20:07.478770 20256 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:07.478907 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:07.495433 20180 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:20:07.497483 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3754) took 1468 ms. Trace:
I20260709 12:20:07.499994 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:07.503159 20322 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 21: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:07.503026 20249 rpcz_store.cc:276] 0709 12:20:06.419110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.330251 (+911141us) service_pool.cc:224] Handling call
0709 12:20:07.477928 (+147677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:07.504316 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.509773 20322 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:07.511178 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.498356 20173 rpcz_store.cc:276] 0709 12:20:06.028585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.824318 (+795733us) service_pool.cc:224] Handling call
0709 12:20:06.824659 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.824902 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:06.839965 (+ 15063us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.496970 (+657005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.497057 (+    87us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:07.497132 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.497300 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.497420 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95734,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"thread_start_us":636931,"threads_started":1}
I20260709 12:20:07.524634 20173 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:07.525065 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:07.526463 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.527371 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.535709 26923 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:07.536247 26923 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:07.536747 26923 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:07.542034 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:07.531284 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 337666us
I20260709 12:20:07.547318 26863 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:07.548133 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:07.549139 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:07.556481 20172 raft_consensus.cc:1217] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[11.8-14.10]   Dedup: 11.8->[12.9-14.10]
I20260709 12:20:07.557273 20172 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: [11.8-14.10]
I20260709 12:20:07.445143 26922 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:20:07.463330 26972 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:07.610064 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2940) took 1097 ms. Trace:
I20260709 12:20:07.610756 20251 rpcz_store.cc:276] 0709 12:20:06.512277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.389126 (+876849us) service_pool.cc:224] Handling call
0709 12:20:07.389462 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.389730 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:07.588908 (+199178us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.609511 (+ 20603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.609613 (+   102us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:07.609697 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.609798 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.609978 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2281,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"thread_start_us":198268,"threads_started":2}
I20260709 12:20:07.551221 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.621632 20252 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:20:07.626127 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1752) took 1347 ms. Trace:
I20260709 12:20:07.626683 20255 rpcz_store.cc:276] 0709 12:20:06.278508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.340896 (+1062388us) service_pool.cc:224] Handling call
0709 12:20:07.624361 (+283465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.624631 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.624671 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.624738 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:07.624786 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.624868 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.625864 (+   996us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003cafd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:07.626044 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651080448}
W20260709 12:20:07.631982 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81808.7us
I20260709 12:20:07.632982 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:07.554898 26858 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.003s
I20260709 12:20:07.647553 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:07.635124 26917 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.003s
I20260709 12:20:07.649451 20329 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:07.679421 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 354796us
I20260709 12:20:07.648698 26788 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:07.686993 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:07.648320 26957 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:07.689592 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3610) took 1623 ms. Trace:
I20260709 12:20:07.693745 20324 rpcz_store.cc:276] 0709 12:20:06.068921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.033788 (+964867us) service_pool.cc:224] Handling call
0709 12:20:07.094780 (+ 60992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.118235 (+ 23455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.689285 (+571050us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54001a2054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:07.689511 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52189056}
I20260709 12:20:07.673049 26940 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:07.673673 26971 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:07.704335 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:07.699486 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 66611us
I20260709 12:20:07.648141 26858 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.694005 26917 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.714237 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.717634 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2299) took 1143 ms. Trace:
I20260709 12:20:07.722257 20329 rpcz_store.cc:276] 0709 12:20:06.573875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.884795 (+310920us) service_pool.cc:224] Handling call
0709 12:20:07.717393 (+832598us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400328054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:07.717560 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598780672}
I20260709 12:20:07.718386 20328 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:07.727869 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.727109 26945 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:07.730672 26986 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:20:07.736250 27009 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:20:07.739394 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2303) took 1014 ms. Trace:
I20260709 12:20:07.740873 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2286) took 1503 ms. Trace:
I20260709 12:20:07.739918 20325 rpcz_store.cc:276] 0709 12:20:06.725020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.300614 (+575594us) service_pool.cc:224] Handling call
0709 12:20:07.332289 (+ 31675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.336121 (+  3832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.336155 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.342401 (+  6246us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.615269 (+272868us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:07.615375 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.615527 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.739117 (+123590us) raft_consensus.cc:1685] finished
0709 12:20:07.739141 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.739296 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3424,"raft.queue_time_us":4090,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":42941,"thread_start_us":197310,"threads_started":1,"wal-append.queue_time_us":276963}
I20260709 12:20:07.741952 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3597) took 1731 ms. Trace:
I20260709 12:20:07.741289 20330 rpcz_store.cc:276] 0709 12:20:06.237263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.101144 (+863881us) service_pool.cc:224] Handling call
0709 12:20:07.105947 (+  4803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.106284 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.106322 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.106971 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.518914 (+411943us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:07.518956 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.519369 (+   413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.740632 (+221263us) raft_consensus.cc:1685] finished
0709 12:20:07.740657 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.740810 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":370262,"threads_started":1,"wal-append.queue_time_us":547575}
I20260709 12:20:07.742534 20327 rpcz_store.cc:276] 0709 12:20:06.011017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.512989 (+501972us) service_pool.cc:224] Handling call
0709 12:20:06.513319 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:06.912278 (+398959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.912309 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:06.921952 (+  9643us) log.cc:844] Serialized 52 byte log entry
0709 12:20:07.290905 (+368953us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:07.290967 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.291076 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.741711 (+450635us) raft_consensus.cc:1685] finished
0709 12:20:07.741733 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.741888 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37084,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"thread_start_us":724429,"threads_started":2,"wal-append.queue_time_us":653676}
I20260709 12:20:07.749301 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 2923) took 1501 ms. Trace:
W20260709 12:20:07.750138 26837 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.001s
I20260709 12:20:07.751803 26953 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.749845 20253 rpcz_store.cc:276] 0709 12:20:06.247810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.248606 (+   796us) service_pool.cc:224] Handling call
0709 12:20:06.248952 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.033438 (+784486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.748972 (+715534us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400373a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:07.749214 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735358848}
I20260709 12:20:07.754211 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:07.754858 27012 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.787303 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.705132 26971 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:07.797178 21041 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
W20260709 12:20:07.798024 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43878.7us
I20260709 12:20:07.805326 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.810441 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.811764 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.813243 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.814953 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.815284 21042 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:07.811124 26971 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.819861 26781 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.820748 26781 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:07.821375 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2306) took 1095 ms. Trace:
I20260709 12:20:07.822131 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.798419 26837 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:07.825546 26837 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.826565 20248 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:07.827816 27012 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:07.828603 26972 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:07.821818 20323 rpcz_store.cc:276] 0709 12:20:06.725998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.330795 (+604797us) service_pool.cc:224] Handling call
0709 12:20:07.331120 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.335321 (+  4201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:07.335353 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:07.335875 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.618416 (+282541us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:07.618528 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.618659 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.821138 (+202479us) raft_consensus.cc:1685] finished
0709 12:20:07.821162 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.821313 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19521,"raft.queue_time_us":5193,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":52177,"thread_start_us":186212,"threads_started":1,"wal-append.queue_time_us":340904}
I20260709 12:20:07.835637 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2165) took 1398 ms. Trace:
I20260709 12:20:07.836202 20254 rpcz_store.cc:276] 0709 12:20:06.436755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.387892 (+951137us) service_pool.cc:224] Handling call
0709 12:20:07.388320 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.475447 (+ 87127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.835269 (+359822us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b54000d9b54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:07.835532 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198826368}
I20260709 12:20:07.837744 26940 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:07.839097 26940 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:07.839581 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.840883 27012 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.842331 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.843176 27012 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.843418 26917 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:07.844815 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3615) took 1611 ms. Trace:
I20260709 12:20:07.845227 20328 rpcz_store.cc:276] 0709 12:20:06.233843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.086797 (+852954us) service_pool.cc:224] Handling call
0709 12:20:07.718136 (+631339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.724030 (+  5894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.844586 (+120556us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400328050. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:07.844747 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450665856}
I20260709 12:20:07.846168 26971 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.809738 26788 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:07.848114 26788 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:07.848503 26971 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:07.848619 26788 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.845235 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:07.852151 27012 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:07.852888 26907 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:07.853389 26907 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.853809 27012 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:07.854228 27012 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:07.854593 27012 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:07.860002 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.547326 26871 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.863085 26871 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.863787 26917 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:07.865679 26809 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.820s	user 0.015s	sys 0.000s
I20260709 12:20:07.866617 26809 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:07.799122 26983 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 12:20:07.870621 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:07.877868 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:07.880782 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.884207 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:07.884214 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.885262 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.885625 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:07.886334 20251 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:07.887954 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.884045 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.890141 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:07.891358 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.892438 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.900465 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3629) took 1642 ms. Trace:
I20260709 12:20:07.904793 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.906042 20252 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:07.906656 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 357599us
I20260709 12:20:07.909070 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.911006 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.914902 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.915567 20171 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.918346 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:07.875422 26999 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:20:07.920291 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.900887 20321 rpcz_store.cc:276] 0709 12:20:06.257813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.101760 (+843947us) service_pool.cc:224] Handling call
0709 12:20:07.102160 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.102502 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:07.445933 (+343431us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.900027 (+454094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.900098 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:07.900167 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.900262 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.900397 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":693404,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"thread_start_us":750766,"threads_started":2}
I20260709 12:20:07.849802 26953 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:07.929670 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:07.931720 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:07.932351 20253 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:07.934909 20171 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:07.938064 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.939018 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.945767 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.903152 26863 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:07.965984 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.967821 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.968469 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 957) took 3180 ms. Trace:
I20260709 12:20:07.969549 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.907357 26912 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.971858 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.972597 26923 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.950734 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.973472 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:07.973855 20175 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:07.949048 27014 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:20:07.974246 20324 raft_consensus.cc:2376] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19. Re-sending same reply.
I20260709 12:20:07.968888 21043 rpcz_store.cc:276] 0709 12:20:04.787919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.834562 (+2046643us) service_pool.cc:224] Handling call
0709 12:20:06.856843 (+ 22281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:06.857273 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:06.857306 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:06.857804 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:20:07.252083 (+394279us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:07.252130 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.252204 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.743077 (+490873us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:07.968190 (+225113us) raft_consensus.cc:1685] finished
0709 12:20:07.968214 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.968405 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18028,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"spinlock_wait_cycles":5320448,"thread_start_us":393891,"threads_started":1,"wal-append.queue_time_us":671958}
I20260709 12:20:07.976053 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.976873 20322 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:07.966974 26863 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.952049 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:07.964665 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:07.967850 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:07.957752 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:07.958045 26789 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:07.963837 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:07.964730 26809 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.964764 26858 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:07.950311 20321 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:07.988242 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:07.989156 20323 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 14: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:07.998428 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:07.999775 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.000097 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.001183 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:08.002069 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.002411 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:08.003053 20250 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:20:08.003223 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.003885 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.004360 20073 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.005720 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.005962 20073 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.006850 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.007937 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.008129 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.008873 21040 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16. Re-sending same reply.
I20260709 12:20:08.007963 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.010891 21039 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:08.011451 21037 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.011852 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.014097 26923 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.016405 20177 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:07.975371 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:07.993929 20330 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:07.957415 26956 consensus_meta.cc:287] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.000s
I20260709 12:20:08.018702 26956 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:07.998271 27007 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.021194 26956 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.023270 26789 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:07.971905 26850 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:08.023877 26850 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.024210 20328 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 9: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:08.024349 21007 connection.cc:256] RPC call timeout handler was delayed by -1.7854504889999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 12:20:08.026535 26809 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:08.026958 26809 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:08.027324 26809 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:08.029575 20249 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:08.031665 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.032697 20328 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:08.061089 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.062032 20329 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.068370 20328 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
W20260709 12:20:08.071451 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 213362us
I20260709 12:20:08.074115 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3598) took 2062 ms. Trace:
I20260709 12:20:08.076333 20326 rpcz_store.cc:276] 0709 12:20:06.011334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.012297 (+1000963us) service_pool.cc:224] Handling call
0709 12:20:07.012775 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.013090 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:20:07.332328 (+319238us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.745420 (+413092us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18003f6700. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:20:07.833428 (+ 88008us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b18003f6700. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5ddedcc58f 00007f5dd7e0b571 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd
0709 12:20:08.073495 (+240067us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b18003f6700. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287
0709 12:20:08.073635 (+   140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:08.073718 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:08.073799 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.073890 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.074039 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113817,"prepare.queue_time_us":681684,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":77006,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9031,"spinlock_wait_cycles":36424576,"thread_start_us":596744,"threads_started":3,"wal-append.queue_time_us":491447}
I20260709 12:20:08.079273 20329 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:08.007040 26788 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.033679 27012 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:08.084813 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59685.5us
I20260709 12:20:08.087143 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.081663 26953 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:08.095499 26788 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.102792 26907 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.104429 27012 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.106011 26979 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:08.099263 27007 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.107268 26979 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:08.108714 26907 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:08.108325 26979 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.108948 26850 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.109649 26979 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.111060 26850 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:08.112313 26953 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.152323 20180 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:08.150642 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 264871us
I20260709 12:20:08.158639 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1754) took 1879 ms. Trace:
W20260709 12:20:08.160595 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 87512.3us
I20260709 12:20:08.160717 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:08.180609 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2175) took 1105 ms. Trace:
I20260709 12:20:08.181159 20248 rpcz_store.cc:276] 0709 12:20:07.075294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.468881 (+393587us) service_pool.cc:224] Handling call
0709 12:20:07.469232 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:07.827122 (+357890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.179877 (+352755us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54003caad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:08.180404 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820996480}
I20260709 12:20:08.191900 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2174) took 1150 ms. Trace:
I20260709 12:20:08.192565 20256 rpcz_store.cc:276] 0709 12:20:07.041179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.411102 (+369923us) service_pool.cc:224] Handling call
0709 12:20:07.477710 (+ 66608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.479191 (+  1481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.163746 (+684555us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b54002fd850. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:08.191613 (+ 27867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152267520}
I20260709 12:20:08.159337 20247 rpcz_store.cc:276] 0709 12:20:06.278946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.346587 (+1067641us) service_pool.cc:224] Handling call
0709 12:20:07.418278 (+ 71691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.449163 (+ 30885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.157887 (+708724us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b540024f9d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:08.158245 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64425728}
I20260709 12:20:08.210436 21007 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:08.217979 26781 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:08.229038 26975 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:07.559432 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.236086 26975 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:08.236773 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:08.238313 26907 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:08.238768 26907 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:08.239228 26907 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.236774 26975 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:08.246526 26975 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.232096 26781 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:08.265866 26975 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.266129 26781 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.252810 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:08.268795 26940 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:08.269402 26940 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:08.275339 27013 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.276433 26781 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.276307 27013 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.281406 27013 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.242942 20073 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 18, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 18 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.285944 20073 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 15 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.264256 26871 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:08.271090 26940 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:08.263321 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 53133.7us
I20260709 12:20:08.231177 27029 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.294715 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.296790 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.255577 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:08.304695 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 144537us
I20260709 12:20:08.336313 20174 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:08.340718 26809 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.343736 26809 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.327940 26871 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:08.345321 26871 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.354801 26958 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:08.360669 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:08.372007 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 473445us
W20260709 12:20:08.384693 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.384696 20072 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 313) took 22092 ms (client timeout 15000 ms). Trace:
I20260709 12:20:08.389035 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:08.390688 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:08.376435 27029 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:08.391938 26940 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:08.392292 27013 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:08.395473 27013 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.396030 27013 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:08.396133 26940 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:08.396881 26940 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.401325 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:08.402667 26808 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:08.403100 26808 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.403469 26808 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:08.404145 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48917.6us
I20260709 12:20:08.394080 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:08.412809 26997 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:08.413225 26997 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:08.413625 26997 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.417565 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:08.421638 27008 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:08.424158 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 168746us
I20260709 12:20:08.407348 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:08.388304 20072 rpcz_store.cc:269] 0709 12:19:46.291930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.310575 (+ 18645us) service_pool.cc:224] Handling call
0709 12:20:08.384351 (+22073776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:59.675776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:59.676496 (+   720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:59.676560 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:19:59.676578 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:59.677880 (+  1302us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:59.677983 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:59.678010 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:19:59.766639 (+ 88629us) tablet.cc:701] Row locks acquired
0709 12:19:59.785353 (+ 18714us) write_op.cc:260] PREPARE: finished
0709 12:19:59.821043 (+ 35690us) write_op.cc:270] Start()
0709 12:19:59.868724 (+ 47681us) write_op.cc:276] Timestamp: P: 1783599599810242 usec, L: 0
0709 12:19:59.869360 (+   636us) op_driver.cc:348] REPLICATION: starting
0709 12:19:59.876398 (+  7038us) log.cc:844] Serialized 5589 byte log entry
0709 12:20:00.454286 (+577888us) op_driver.cc:464] REPLICATION: finished
0709 12:20:00.559903 (+105617us) write_op.cc:301] APPLY: starting
0709 12:20:00.560014 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:01.159490 (+599476us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:01.223731 (+ 64241us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:01.870327 (+646596us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:01.870843 (+   516us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:20:01.870901 (+    58us) write_op.cc:312] APPLY: finished
0709 12:20:01.871389 (+   488us) log.cc:844] Serialized 129 byte log entry
0709 12:20:02.003005 (+131616us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:02.033541 (+ 30536us) write_op.cc:454] Released schema lock
0709 12:20:02.040799 (+  7258us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:02.106306 (+ 65507us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:02.106339 (+    33us) write_op.cc:454] Released schema lock
0709 12:20:03.429834 (+1323495us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
Metrics: {"mutex_wait_us":404382,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":88604,"apply.run_cpu_time_us":107753,"apply.run_wall_time_us":1548362,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":157759,"prepare.run_cpu_time_us":14816,"prepare.run_wall_time_us":332598,"raft.queue_time_us":206170,"raft.run_cpu_time_us":7339,"raft.run_wall_time_us":114443,"replication_time_us":560002,"spinlock_wait_cycles":2494848,"thread_start_us":327437,"threads_started":5,"wal-append.queue_time_us":432815,"wal-append.run_cpu_time_us":121178,"wal-append.run_wall_time_us":4020108}]]}
I20260709 12:20:08.425067 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.425922 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:08.430570 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66743.9us
I20260709 12:20:08.432780 26675 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:08.433351 27013 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.434449 26907 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.435859 27013 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.437016 26907 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.439738 27007 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.431667 26808 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.443329 26675 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.381770 20073 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.446274 27007 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:08.454232 27007 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:08.457341 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 50229.1us
I20260709 12:20:08.458962 20219 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.461369 20073 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.465458 26808 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.471896 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.470731 20073 catalog_manager.cc:5697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 8 to 14, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.474677 20180 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:08.468644 27013 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.480417 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.482301 20073 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.490239 21036 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:08.493636 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.495653 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.484115 26675 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.497198 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.498036 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.498739 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.500391 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.500972 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.501480 26907 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:08.500391 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.502779 20172 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:08.503002 20179 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:08.484524 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:08.504105 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.505223 26840 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.505658 26840 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:08.505841 20171 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 24. Current term is 25. Ops: []
I20260709 12:20:08.506054 26840 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.508576 27018 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:08.509856 26990 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:08.510106 26979 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 24.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:20:08.510370 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.511397 20177 raft_consensus.cc:2410] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:20:08.486059 26958 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:08.512153 26969 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:20:08.487964 26837 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.512692 26969 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:08.512849 27018 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:08.513346 27018 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.513180 26837 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.488313 26956 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:08.514819 26956 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:08.514457 26969 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.515256 26956 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:08.515882 26969 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:08.516584 26956 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.517647 26837 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.518105 26956 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.488514 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.521757 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:08.521936 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48306.8us
I20260709 12:20:08.522890 20294 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.512250 26998 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:08.523381 26979 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.523727 26998 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.525017 26998 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.526607 26998 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.525133 20073 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 13, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 13 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.527822 27008 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.529093 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.533329 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:08.534185 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:08.535310 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.535755 27018 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.538017 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:08.485114 26940 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.549985 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.550163 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.551054 20177 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:08.502833 26907 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:08.553403 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.553509 26907 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.554725 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.556058 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.557205 26990 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.557425 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.558926 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.560060 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.560437 26858 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:08.561040 20177 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:08.561683 20172 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.564042 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.564926 20178 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:08.566115 26886 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:08.566423 20177 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:08.566023 26997 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.566620 26886 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:08.567819 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.569284 27007 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.569877 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:08.571290 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.572481 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.573935 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.575899 26886 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.577807 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.579710 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:08.586705 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:08.556180 27018 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:08.638231 20180 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:08.643250 20171 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:08.644595 26886 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.646687 20174 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:08.646307 20177 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:08.647400 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:08.548336 20073 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 11 to 14, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.649538 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.650682 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:08.654245 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.008s (SENT)
I20260709 12:20:08.655534 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:08.655489 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:08.657423 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.662899 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:08.663838 26969 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:08.664357 26969 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:08.665282 26958 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:08.656927 26940 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.684406 21036 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:08.685950 20179 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:08.679016 20073 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 15, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 15 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.649578 27007 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.695811 21041 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
W20260709 12:20:08.714425 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67208.5us
W20260709 12:20:08.718912 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 160498us
I20260709 12:20:08.698261 26997 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.696815 26808 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:08.721508 20073 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:08.695961 26837 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:20:08.727170 26808 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:08.736464 27008 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.736896 26808 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.737409 27008 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:08.737615 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.738489 26997 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:20:08.739395 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.739737 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.740305 26907 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:08.744608 20294 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.748049 27008 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:08.748111 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.750442 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.751502 26997 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.760509 26675 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.760842 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.764071 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:08.765630 26998 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:08.766237 26998 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.767364 26998 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.685031 26871 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.776913 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.779300 21036 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:08.779613 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:08.796677 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:08.797871 26675 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:08.798888 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:08.799728 26997 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:08.800321 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.801067 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:08.801385 27018 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:08.799753 26675 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:20:08.802562 27018 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.803078 26675 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:08.803404 26871 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:08.803575 26675 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.803695 27018 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.779469 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.805016 26675 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.806202 27013 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:08.806680 27013 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:08.806895 26675 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.810024 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:08.810869 20322 raft_consensus.cc:2368] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21.
I20260709 12:20:08.810238 21034 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:08.805074 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:08.707722 26840 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.725271 26969 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.823302 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.841552 21042 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:08.844120 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:08.878996 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:08.886332 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 220614us
I20260709 12:20:08.843778 26997 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.904965 21035 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:08.902601 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.895671 27007 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.913440 27049 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:08.913954 27049 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:08.915107 27049 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.915724 27040 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:20:08.916252 20328 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:08.916432 27049 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.916801 27040 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:08.917186 27040 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:08.916294 20322 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:08.918143 27040 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:08.919919 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 270645us
I20260709 12:20:08.921360 26953 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:08.924484 26907 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.925056 26907 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.928432 27047 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.931406 27014 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:08.932196 27014 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.933911 26990 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.821775 27013 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.934880 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:08.935070 27013 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.935760 20247 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:08.936096 26953 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.938421 26953 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.927764 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:08.939256 20179 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:08.940145 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.940681 26837 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:08.941111 26837 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:08.941226 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:08.941532 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.942396 26940 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:08.920864 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:08.951148 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 113717us
I20260709 12:20:08.956920 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:08.957966 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:08.958344 26789 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:20:08.942170 26837 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:08.960304 26837 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.962656 26997 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.964154 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:08.959139 26958 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:08.964897 26958 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:08.964951 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:08.965394 27007 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.965869 20247 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:08.966022 26958 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:08.958657 20256 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:20:08.972345 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 51605.1us
I20260709 12:20:08.973397 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.974373 26956 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.974602 27050 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.967484 26958 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:08.976316 26975 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.976438 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.977319 27007 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.977614 27046 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:08.942799 26940 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:08.979439 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:08.979856 26940 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.980638 26946 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:08.981918 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:08.982729 26946 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:08.982867 21042 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 25.
I20260709 12:20:08.983194 26946 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:08.952032 26907 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:08.988440 26946 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:08.991667 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50558.4us
I20260709 12:20:08.983907 26840 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:08.996587 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:08.997133 20247 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:08.997568 20256 raft_consensus.cc:2410] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:20:08.997174 27014 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:09.003342 20256 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:08.944345 27040 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.004181 20248 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:08.985008 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.010490 26808 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.010967 26958 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:09.012128 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.013041 26808 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:09.013447 26958 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:08.965801 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:20:09.037196 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 129411us
W20260709 12:20:09.044915 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 79219.8us
I20260709 12:20:09.045981 26675 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:09.046319 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.047621 27014 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:09.048066 27014 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:09.048489 27014 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.049000 27007 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:09.049491 27007 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:09.049881 27007 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:09.050516 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.051703 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:09.052028 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 155884us
I20260709 12:20:09.052723 26886 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:09.053596 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.054518 27018 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.055433 27018 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:09.056515 26886 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:09.056882 26886 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.059340 27007 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.053666 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.060674 26975 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:09.067710 20322 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:09.074787 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:09.068379 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:09.067112 27043 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:09.084674 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:09.102756 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:09.113216 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59691.1us
I20260709 12:20:09.116195 21007 leader_election.cc:400] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21.
I20260709 12:20:09.116771 21007 leader_election.cc:403] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:20:09.118098 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:09.122857 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.123787 20248 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 10: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:09.104645 26907 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:20:09.102162 26858 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:20:09.122310 26871 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:09.192512 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 102010us
I20260709 12:20:09.113026 26940 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:09.195426 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 90463.1us
W20260709 12:20:09.225920 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.184202 27047 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:09.237924 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.241380 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:09.247725 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 170812us
I20260709 12:20:09.190227 26998 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:09.191805 26953 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:09.261078 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.291435 20328 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:09.293709 20248 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:20:09.298642 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.306051 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64779.1us
W20260709 12:20:09.307176 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 222640us
I20260709 12:20:09.302727 27029 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.292295 27047 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:09.271385 26953 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.288053 27018 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 12:20:09.325760 27055 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:20:09.323962 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 80777.9us
W20260709 12:20:09.326483 27053 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:20:09.340674 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:09.325994 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 196738us
I20260709 12:20:09.336532 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:09.315949 27007 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:09.345564 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.347234 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:09.351639 27047 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:09.352135 27047 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:09.352662 20328 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:09.355018 20328 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:09.352535 27047 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:09.327220 27045 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:20:09.360028 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.324841 27044 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:09.374270 26953 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:09.374843 27014 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:09.361203 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.376133 20326 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:09.376995 27014 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:09.377907 27059 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:09.362360 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.362779 27066 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:09.383873 27061 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:09.363672 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.384348 20329 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:09.384431 27061 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:09.384990 27061 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.363780 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.385555 27047 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.386593 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.365443 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.365813 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.367547 20325 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:09.368719 26940 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:09.369791 20294 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.328348 26990 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 12:20:09.411412 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 99912.3us
I20260709 12:20:09.356940 26946 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.409309 26940 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:09.404297 26837 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.421591 20328 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
W20260709 12:20:09.425696 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 97426.4us
I20260709 12:20:09.411617 27044 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:09.429878 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 84396.8us
I20260709 12:20:09.429469 27066 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:09.432447 27066 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.433370 27066 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.434893 27066 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.435922 27056 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:09.436412 27047 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:09.437463 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 67796.7us
W20260709 12:20:09.435945 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49506.3us
I20260709 12:20:09.441236 20247 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:09.447180 27014 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:09.447921 27014 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.440179 26858 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:20:09.475268 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.480794 26781 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:09.481451 26781 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.483784 26781 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:09.486618 26953 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:09.498088 27063 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:09.499382 26946 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:09.500159 26886 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.500911 27063 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:09.501307 27063 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:09.502202 27063 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.504887 27014 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:09.505719 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:09.507632 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:09.508242 20174 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:09.509052 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:09.509667 26998 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21.
I20260709 12:20:09.509984 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:09.511196 27073 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:09.511298 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:09.512092 20173 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:09.511888 27073 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.513047 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:09.514096 27073 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:09.516112 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.517500 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 55079us
I20260709 12:20:09.518117 20180 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:09.519542 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:09.519682 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:09.520259 20177 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.521797 20174 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:09.522980 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.523962 26953 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:09.524354 27013 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:09.525224 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.529899 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:09.530121 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:09.530736 20328 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 21: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:09.536288 20324 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 25.
I20260709 12:20:09.503434 27063 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:09.543942 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68126.6us
I20260709 12:20:09.469347 26858 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.547058 26946 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:09.543557 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:09.549834 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.553231 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.554610 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:09.471398 26837 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:20:09.557927 20327 raft_consensus.cc:1240] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:09.559969 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:09.560530 21034 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:09.560801 27040 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.557s	user 0.002s	sys 0.011s
I20260709 12:20:09.561239 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:09.562007 26837 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:09.562434 26837 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:09.563319 26837 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.564824 26837 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.566375 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:09.566828 21041 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:09.567472 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:09.567720 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:09.567952 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.568305 20251 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:09.568531 20325 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:09.574084 20177 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:09.575348 21042 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:09.577612 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.569823 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:09.580420 20248 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:09.582468 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.584844 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.585198 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:09.584878 20247 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:09.588711 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:09.589443 20255 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.591686 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:09.582659 26979 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:20:09.587445 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:09.592839 27061 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.593245 20252 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:09.574882 26958 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:20:09.595086 27061 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:09.595346 20251 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:09.547690 26946 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:09.580060 27013 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:20:09.597616 26946 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.547541 26858 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.600633 26858 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:09.608358 27007 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:09.608862 27007 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:09.609743 27007 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.611075 27007 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.612207 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.612627 20255 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:09.612915 27046 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:09.613298 27046 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:09.613581 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:09.613794 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.614493 27076 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:09.614193 27046 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.615965 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.617152 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.617835 26675 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:09.617946 27064 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:09.618280 26675 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.619294 26675 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:09.623940 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 77727.7us
W20260709 12:20:09.630692 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.635218 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.631878 20177 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:09.635660 20176 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:09.646044 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.653890 27044 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:09.654893 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59100.6us
I20260709 12:20:09.655273 26958 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:09.655722 26958 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:09.655823 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.656603 26958 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.657981 26958 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:09.660392 26956 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.660262 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:09.661494 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.665375 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:09.667515 27043 consensus_queue.cc:1059] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:09.668483 27043 consensus_queue.cc:1243] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:09.669005 27044 raft_consensus.cc:3055] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:09.669373 27044 raft_consensus.cc:740] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:09.670235 20249 raft_consensus.cc:2393] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:09.670475 27044 consensus_queue.cc:260] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.669308 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:09.672295 20256 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:09.673237 27044 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.676806 26886 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:09.680411 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 98050us
I20260709 12:20:09.681295 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.683760 26956 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:09.690375 27070 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.691130 27070 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:09.691426 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.693099 26858 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:09.694278 20327 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:09.720489 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59080.9us
I20260709 12:20:09.694913 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:09.721793 26858 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:09.722472 26858 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.697813 20324 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:09.696132 20325 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:09.723753 26997 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:09.698623 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:09.700284 20322 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:09.701885 26675 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:09.726101 26886 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:09.727422 26886 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:09.727806 26886 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.728001 26837 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:09.683403 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.728914 26886 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.729600 27043 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:09.729946 26886 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:09.730659 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47332.4us
I20260709 12:20:09.701406 27058 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:09.733940 27058 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:09.734335 27058 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:09.735370 27058 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.737013 27058 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.615515 27046 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:09.706547 27008 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.749090 27008 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.751297 27008 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:09.756891 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:09.757598 20176 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:09.759127 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:09.760043 27008 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:09.760407 27008 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.760749 27008 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:09.761440 26675 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:09.762769 26871 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:09.763131 26871 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.764074 26871 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.728936 26837 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:20:09.771100 26871 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.777220 27056 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:09.709971 27070 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:09.778159 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46654.9us
I20260709 12:20:09.778283 26886 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:09.778945 26886 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:09.780824 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.713876 26953 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.780148 26886 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:09.722950 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:09.702250 26971 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:09.724972 26858 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:09.788913 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 66043.1us
I20260709 12:20:09.789707 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.708514 20329 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:09.777424 20171 raft_consensus.cc:2410] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 12:20:09.716146 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 94851.2us
I20260709 12:20:09.703663 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:09.709442 21036 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:09.785934 26886 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.723342 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.837544 20249 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:09.838621 20252 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:09.840267 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59519.6us
I20260709 12:20:09.848935 20255 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:09.856673 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 191545us
I20260709 12:20:09.855278 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:09.836701 27061 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:09.838486 26858 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.865693 20251 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:09.872345 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 82703.3us
W20260709 12:20:09.893630 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 171953us
I20260709 12:20:09.834800 27066 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:20:09.894721 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.860670 26789 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.921489 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:09.866039 27043 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:09.854230 27014 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:09.933605 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 65027.9us
I20260709 12:20:09.895824 27047 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.935978 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.932013 26971 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:09.895583 27070 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:20:09.949617 27061 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.954644 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.959741 27029 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:09.960686 27060 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:09.940968 26953 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.964084 26953 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.966187 26953 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:09.860486 26871 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:20:09.967810 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:09.972709 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:09.934109 27066 consensus_queue.cc:1243] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:20:09.985250 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.976763 27073 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:09.985507 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 142917us
I20260709 12:20:09.981006 26781 raft_consensus.cc:2764] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:20:09.944169 27014 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:09.979000 26958 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:09.990768 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:09.993884 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:09.995383 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.006834 21039 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:09.982357 27013 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:10.009661 26975 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:10.009783 27014 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.010818 27061 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:10.016077 27089 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:10.034791 20249 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:10.019815 20255 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:20:10.037104 21036 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:20:10.020342 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 50818.8us
W20260709 12:20:10.030006 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 94128.9us
I20260709 12:20:10.023706 26975 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.043358 27056 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:10.044416 27044 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:10.045680 27044 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:10.046097 27044 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:10.050529 26975 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:10.053952 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:10.028985 27061 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.056355 26997 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:10.078922 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.081489 27061 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.082584 27061 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:10.082332 27060 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:10.070446 26971 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:10.085103 26971 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.087936 26858 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.092378 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.093194 20172 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:10.089521 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.090934 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:10.091663 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.095925 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
W20260709 12:20:10.091117 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.092744 26858 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.098692 26858 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.100267 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.101342 20171 raft_consensus.cc:2410] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:20:10.069761 26975 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.105693 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:10.106521 26971 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.107647 20174 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:10.072108 27014 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:10.108561 26789 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:10.120496 20255 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:10.121098 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:10.111146 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.111652 26956 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:10.112236 20177 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:10.112547 26675 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:10.110289 20171 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:10.127167 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:10.113464 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 43660.5us
I20260709 12:20:10.114013 27063 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.129415 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:10.115757 20180 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:20:10.118963 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:10.125656 20172 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:10.062347 26953 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:20:10.139032 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.078866 27064 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:10.136816 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.140741 20255 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:20:10.137868 26971 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:10.126948 26675 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:10.147805 26858 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:10.147254 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:10.147818 21039 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:10.142886 20330 raft_consensus.cc:1217] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Deduplicated request from leader. Original: 17.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 12:20:10.143038 20256 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:20:10.133997 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.151438 20330 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:10.151892 20247 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:20:10.143884 20177 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:10.144098 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:10.147243 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.124934 26956 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:10.127055 26997 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:10.155092 20249 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:10.156985 20255 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:10.163009 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.163677 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.165592 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.166544 20179 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:10.123721 27008 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.143643 27064 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:10.140400 27063 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.157477 27029 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.174117 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:10.175921 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.175994 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:10.176463 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.164861 26953 consensus_queue.cc:1243] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:20:10.186561 20171 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:10.176903 27060 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:10.148536 26675 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.185536 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:10.199772 27089 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:10.206957 20172 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:10.208882 20251 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:10.210664 26781 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:10.211035 26781 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.211997 26781 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.213220 26781 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:10.222863 26956 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.226151 26956 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:10.177711 26997 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.226420 26675 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.228472 26997 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:10.229964 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.187628 26871 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.239118 26871 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.186299 27029 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.244549 20174 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:10.244712 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.245010 20174 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.245303 27029 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.245507 20330 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:10.187520 27067 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:10.245950 20174 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:10.246587 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81093.5us
I20260709 12:20:10.247210 20174 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.247440 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.248174 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:10.255368 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 100264us
I20260709 12:20:10.255198 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:10.257318 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.259254 26997 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:10.261116 27063 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.255252 27067 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:10.164901 26971 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.265965 26971 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:10.257350 20325 raft_consensus.cc:606] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.267127 20325 raft_consensus.cc:614] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:10.268059 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.269491 26886 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:10.271840 27064 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.273799 27074 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:10.274724 27074 consensus_queue.cc:1243] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:10.275664 26886 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:10.276767 27064 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:10.278434 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.189520 26953 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.290310 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.291456 26808 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.292444 26808 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:10.293033 26808 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.294234 26808 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.248180 20247 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:10.297293 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:10.298592 27067 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:10.299038 27067 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.299436 27067 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.301273 27008 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:10.288729 20249 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:10.291261 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.306598 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:10.308037 27070 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.308743 27070 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.316028 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:10.317036 20325 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.318348 27074 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.319100 27074 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.318348 27067 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.325321 26789 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:10.328297 26789 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.329252 26789 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.326910 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:10.333297 20171 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:10.325435 26886 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:10.334669 26886 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.322702 21036 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:10.342106 20174 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:20:10.344884 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:10.349033 20174 pending_rounds.cc:85] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 12
I20260709 12:20:10.349323 20174 pending_rounds.cc:107] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:20:10.349509 21039 raft_consensus.cc:2410] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:20:10.349607 20174 raft_consensus.cc:2889] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:10.346160 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:10.350451 27007 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
W20260709 12:20:10.353823 27092 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:20:10.358692 21035 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:10.371220 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.378989 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:10.380045 20248 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:10.385905 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 188476us
W20260709 12:20:10.386946 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 196454us
I20260709 12:20:10.387789 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:10.388638 21035 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:10.242817 26871 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.389585 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:10.394717 20180 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:10.384408 27063 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:20:10.389495 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:10.367646 27070 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.391462 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.388486 20251 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:10.392891 20325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:10.393493 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.392796 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.396245 21037 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:10.400892 20174 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:10.380833 27029 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:20:10.397277 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:10.368183 27060 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:10.408526 20325 raft_consensus.cc:606] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.410605 20325 raft_consensus.cc:614] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:10.377658 27014 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.415728 20180 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:10.415081 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:10.404373 27044 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.417761 20330 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:10.420327 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:10.417352 20329 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:10.429075 26858 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:10.429697 26971 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:10.430927 26971 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.430299 26781 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:10.431758 26781 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:10.432191 26781 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.432355 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de68043269e84d00b62b03a362170cc8"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:10.432750 27074 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.413982 27095 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:10.436393 27095 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:10.436129 26971 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.415706 27063 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:10.437359 27063 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.439179 26886 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.436805 27095 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.441191 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.443290 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.444090 20329 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:10.446394 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:10.447036 20325 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.412396 27060 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:10.447918 27060 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.450392 20328 raft_consensus.cc:606] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.450811 20328 raft_consensus.cc:614] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:10.452054 27098 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.438485 27063 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.452634 27098 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:10.454686 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.455420 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.456073 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:10.435277 27067 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.459232 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.461632 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:10.463135 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71764.8us
I20260709 12:20:10.420125 27007 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:10.453743 27063 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.479080 26940 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.479329 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:10.480528 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.480875 27014 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.481639 27013 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:10.482162 26781 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.475219 27070 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:10.466897 26975 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:10.485965 27061 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:10.486419 27096 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:20:10.490383 20325 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:20:10.493607 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.509788 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.493099 27073 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:10.462644 26858 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:20:10.519078 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 105741us
I20260709 12:20:10.471043 26956 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:20:10.530326 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 69236.2us
I20260709 12:20:10.537138 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:10.534446 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.510679 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.561173 20327 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:10.528460 27070 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:10.521822 26969 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:10.562393 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.572130 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.472559 26789 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:20:10.574563 26871 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:10.551649 27094 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:20:10.577255 20330 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:10.578014 20251 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:10.580417 21042 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:10.580873 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.571429 27070 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.568732 26858 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.592100 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:10.534849 26940 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.575026 26956 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:10.607852 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.608711 20251 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:10.579146 26871 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.603660 20255 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:10.613066 20249 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:10.609769 20247 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:10.613446 20326 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:10.575250 27061 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.602233 20324 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:10.615940 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.616856 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:10.640362 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.645502 20329 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:10.647526 20251 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:10.576547 27095 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.596997 26858 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:10.656318 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 194759us
I20260709 12:20:10.661437 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.661512 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.662436 20330 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:20:10.661693 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:10.663357 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:10.663770 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:10.664067 21036 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:10.664577 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:10.663355 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.665987 27058 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:10.666572 27058 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.667933 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:10.667755 27058 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.668753 20322 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:20:10.670635 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.616595 26871 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.655365 27047 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.691917 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.705295 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:10.706159 20256 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:10.712735 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.704981 27007 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.724735 27007 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:20:10.737087 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 63869.7us
W20260709 12:20:10.742463 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.742290 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 71763.8us
I20260709 12:20:10.743460 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:10.706821 27046 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:10.753600 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:20:10.755580 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66066.8us
W20260709 12:20:10.756472 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 151864us
W20260709 12:20:10.756783 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.756498 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.739934 27044 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.736663 27098 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.739468 27067 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.770468 27108 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.770768 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.750710 27008 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:10.721381 27047 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.741261 27066 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:20:10.757315 26886 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:10.771106 27112 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.776096 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:10.768362 26781 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:10.789798 21008 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.795006 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:10.720310 26956 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.770538 20326 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:10.790289 27108 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.790578 27044 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.790688 27115 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:10.802093 20252 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:10.755597 26969 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:20:10.746109 27061 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.819892 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:10.820492 27113 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 12:20:10.821699 27106 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:20:10.822429 27107 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:20:10.801761 20248 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:10.776595 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:10.860419 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 84437.8us
I20260709 12:20:10.860868 20254 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:10.839859 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.802904 27066 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:10.860774 20294 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.847844 20253 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:10.862270 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.774998 27046 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:10.845373 27064 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.001s
I20260709 12:20:10.867517 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:10.867830 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:10.843781 27098 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:10.839756 27115 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:10.776319 27029 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:20:10.788101 27067 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.847227 26975 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.848693 26781 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:10.798708 26886 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.802842 27112 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.894433 27095 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.863840 27056 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.924121 27109 raft_consensus.cc:2764] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:20:10.863654 26940 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:10.924978 26940 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.909561 21041 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:20:10.865989 27008 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:10.926476 27126 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:10.927224 27008 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.928210 26975 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:10.903513 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 147096us
I20260709 12:20:10.897001 27089 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.922178 27114 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:10.924618 27056 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.925479 26940 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.864590 27066 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:10.926227 21041 pending_rounds.cc:85] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 13
I20260709 12:20:10.932957 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:10.908456 27064 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:10.902271 27115 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.946838 21041 pending_rounds.cc:107] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:20:10.949254 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:10.960048 21041 raft_consensus.cc:2889] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:10.964558 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 103856us
I20260709 12:20:10.967386 20256 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:10.916548 26781 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.970611 27126 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.996532 26953 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:20:10.996961 26953 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:10.997857 26953 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:10.999725 27013 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:11.000129 27013 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:11.001005 27013 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.002590 27013 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.983212 26789 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:10.962076 27089 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:10.999396 26953 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:11.036984 27104 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:20:11.037307 27047 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:10.988505 27044 raft_consensus.cc:2764] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:20:10.984752 27121 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.012684 27128 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:11.030699 27118 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.063416 27127 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.063848 27117 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:11.054630 27130 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.064507 27124 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:11.191912 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.192658 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.193773 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.194866 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 355064us
I20260709 12:20:11.195632 20328 raft_consensus.cc:606] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:11.196964 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 329183us
W20260709 12:20:11.213169 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 345421us
W20260709 12:20:11.233680 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 284495us
I20260709 12:20:11.252631 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:11.186834 27073 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.255421 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:11.266573 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.279403 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:11.262562 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.281035 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:11.280279 21034 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:11.239310 27047 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.283062 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.238870 27128 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:11.288825 20176 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:20:11.284439 20173 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:11.283958 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:11.288371 20179 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:20:11.291878 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.288172 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.244328 27008 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.292768 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:11.293692 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:11.290477 20176 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:20:11.298224 20176 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:20:11.298565 20176 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:11.291831 20179 pending_rounds.cc:85] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 12
I20260709 12:20:11.299294 20179 pending_rounds.cc:107] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 15.13
W20260709 12:20:11.282653 26675 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.056s	user 0.007s	sys 0.010s
I20260709 12:20:11.291822 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.291265 27007 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:11.296000 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:11.300165 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.308544 20174 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:11.300662 20172 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:11.300805 20178 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:11.298743 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:11.310405 20171 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.284562 27014 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:11.301208 20179 raft_consensus.cc:2889] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:11.294426 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:11.316805 20180 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:11.288600 27029 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:11.316797 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:11.307035 27060 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.006s
I20260709 12:20:11.290524 27064 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:11.291787 27044 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:11.261404 27073 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.294834 27047 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.254360 27127 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.248145 27121 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.365211 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.288091 27096 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:11.387087 20180 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:11.341223 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:11.372609 27123 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:20:11.394495 20171 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:20:11.396142 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55031.4us
I20260709 12:20:11.298708 27124 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:11.319716 27067 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.326236 26940 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.361284 27134 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.357709 27146 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.402410 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.448973 20252 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:11.313401 27046 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.373427 26781 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.366482 27110 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.422833 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.364574 27130 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.359318 27135 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:11.425041 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.248332 27118 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.440840 27067 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.440505 21036 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:11.307261 27008 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.462836 27064 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.320379 27029 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.509591 27029 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:11.513988 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.514698 20322 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:11.514942 27147 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.442886 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:11.419867 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.388787 26886 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.448613 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:11.388870 27060 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.522332 27060 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.522115 27029 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.423883 27044 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.523608 20173 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:11.523521 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:11.524710 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.525189 27067 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.527751 27029 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.491166 27130 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.530515 27130 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.532274 20253 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:11.320123 27117 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.161s
I20260709 12:20:11.461566 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:11.462704 27136 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:20:11.476002 27132 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.476503 27070 consensus_meta.cc:287] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.859s	user 0.013s	sys 0.001s
I20260709 12:20:11.420014 27014 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:11.328756 26675 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.124s
I20260709 12:20:11.328677 27074 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.505642 20256 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:11.515571 27147 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.450752 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:11.535401 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44739.4us
I20260709 12:20:11.537150 20248 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:11.477746 27046 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:11.555840 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.559693 20254 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:11.500494 26975 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.557847 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.561694 27007 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:11.436645 27124 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.540196 27056 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.447057 27143 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260709 12:20:11.581296 27154 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.581833 27154 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.583783 27149 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:11.584333 27149 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.584993 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:11.585623 21043 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:11.586683 27149 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.565351 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:11.613754 20253 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:11.554895 26858 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.003s
I20260709 12:20:11.575510 20325 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:11.576493 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.619256 20330 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:11.580049 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.558130 27070 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.587476 27144 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.588732 26886 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:11.445968 27128 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:11.590217 27138 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:20:11.557727 27132 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:11.591775 27133 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:20:11.549495 27130 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:20:11.592803 26871 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.906s	user 0.006s	sys 0.006s
I20260709 12:20:11.568908 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:11.597043 27112 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.571947 27046 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.604249 27008 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.499771 27110 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.455817 27134 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.606498 26975 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.626802 20251 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:11.578989 27007 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:11.559643 27074 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.600355 27155 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.629667 26886 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.628230 27142 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:11.463888 27146 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:11.658735 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 96607.9us
W20260709 12:20:11.661639 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 183895us
I20260709 12:20:11.625563 26858 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.652864 27147 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.635192 27058 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:20:11.673130 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:11.690892 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 298542us
I20260709 12:20:11.691346 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.635042 27144 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.690828 20326 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:11.693696 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.673575 26886 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.675984 20180 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:11.709069 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:11.695202 27148 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:20:11.709704 20254 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:11.711453 27070 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.712639 27070 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.713135 27070 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.716131 27163 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.716666 27163 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.717132 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.717772 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:11.718791 27163 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:11.724527 27139 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:20:11.724984 27115 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.004s
I20260709 12:20:11.725438 27115 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.690459 27127 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.662099 26969 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:11.779266 27163 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:11.694072 21038 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:11.780171 27163 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.700443 20330 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:20:11.698184 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.701779 21043 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:11.672812 27112 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.702702 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:11.783483 27163 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.783433 27112 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.784229 27163 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.786170 27112 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.786756 27162 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.787417 27162 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.788384 27108 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.788604 20253 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:11.703953 21039 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 22: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:11.705237 21037 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:11.693956 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.672994 27142 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.792429 20178 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:11.793560 27073 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.654476 26871 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.704883 20176 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:11.670872 27157 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:11.686340 27154 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.838584 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:11.686116 27155 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.697741 27156 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:11.738381 27165 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.695809 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.846457 20325 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 25.
I20260709 12:20:11.745703 27115 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.748611 27070 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.752869 27132 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.753302 27067 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.754274 27124 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.756094 27146 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.760716 27046 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.762120 26975 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.762691 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57336 (request call id 110) took 1283 ms. Trace:
I20260709 12:20:11.763688 26858 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.764468 27044 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.767540 27074 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.769049 27110 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.702677 27056 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:11.770704 27134 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.877128 27141 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:11.877537 27126 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.889s	user 0.009s	sys 0.003s
I20260709 12:20:11.878073 27126 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:11.877804 27141 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.774644 27128 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.882018 27056 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.776132 27121 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.732553 27161 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.884436 27056 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.884238 27161 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.886198 26871 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.886598 27161 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.778112 27144 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.733513 27007 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.779461 26969 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:11.887789 26969 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:11.692354 20173 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:11.792474 27142 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:11.893412 26886 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:11.705349 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 285556us
I20260709 12:20:11.702855 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.814785 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:11.817386 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.899972 20255 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:11.900508 20256 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:11.668699 27047 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.818491 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.822801 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:11.823737 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.824671 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:11.825307 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.902654 20253 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:11.828095 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.836515 27172 raft_consensus.cc:2764] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 12:20:11.908615 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 84033.8us
I20260709 12:20:11.837787 20247 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:20:11.901567 20254 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:11.909395 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:11.902079 21041 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:20:11.825534 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:11.910993 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 85542.7us
I20260709 12:20:11.841101 21034 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
I20260709 12:20:11.841346 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.845526 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:11.913700 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72393.8us
I20260709 12:20:11.914907 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.786175 27151 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.798604 27163 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.850845 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.850970 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.843120 27162 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.840631 27157 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.839139 27112 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:11.842481 27014 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:11.935410 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.823266 27135 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:11.823590 27108 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.858292 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.936698 20327 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:11.857951 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.937732 20322 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:11.847684 27156 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.866832 20328 rpcz_store.cc:276] 0709 12:20:10.478950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.479151 (+   201us) service_pool.cc:224] Handling call
0709 12:20:11.762509 (+1283358us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54000cec54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef2853 00007f5ddfec060a 00007f5dd94467d4 00007f5dd9446762 00007f5dd9446691 00007f5dd944660c 00007f5dd94458c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:11.762601 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585980672}
I20260709 12:20:11.844883 27127 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:20:11.846376 27066 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.837013 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:11.839231 20324 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:11.848243 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 145615us
I20260709 12:20:11.917673 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.961058 27172 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.942531 27112 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:11.961275 20176 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:11.962405 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:11.910248 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:11.925064 20171 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:11.925942 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:11.866926 27070 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:11.859813 27155 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.925097 20178 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:11.923990 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:11.931226 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.931388 20248 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:11.931972 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.869413 27046 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.936079 20175 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:11.934489 26808 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:11.969218 26808 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.969491 27146 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:11.969699 26808 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:11.969971 27146 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.970441 27146 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:11.934172 27130 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:11.946528 27164 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:11.971872 27130 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.972045 27060 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:11.972376 27130 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:11.951988 26975 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:11.972635 27060 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.929593 27074 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:11.853418 27165 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.961364 27089 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.919955 27141 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:11.921219 26858 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:11.964370 27176 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:11.973217 26975 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:11.961767 27172 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.934696 27151 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.044886 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.045082 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.045905 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:20:11.928241 26871 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.974774 20324 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:11.976519 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:11.967131 20176 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.964223 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:11.967926 20173 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 10.
I20260709 12:20:12.014703 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:11.963104 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.966116 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 55940us
I20260709 12:20:12.053694 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.053960 21034 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.055449 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.056025 20324 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.056727 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.058328 21034 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:12.059463 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.040829 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.061828 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.062115 20172 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:12.042514 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.966490 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.044037 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.036018 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.064216 21043 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:12.062534 21036 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:12.049114 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.060226 27165 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:11.969115 27070 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:11.943958 26953 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.956477 27163 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.040746 27126 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:20:12.061363 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.062402 21037 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:12.065233 20329 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:12.064086 21041 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:12.050554 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.065830 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:11.979270 27143 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:12.064400 20175 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.091712 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:11.954562 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.092471 21036 raft_consensus.cc:2368] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
W20260709 12:20:12.092749 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 138291us
I20260709 12:20:11.944818 27156 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:12.073674 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.072852 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.072961 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.073788 27014 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.060580 27135 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.080240 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.081408 20324 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:11.974208 27029 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.084858 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.009958 26886 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.111181 27112 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.111863 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.112605 20321 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.112843 27132 raft_consensus.cc:993] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:12.113368 27132 raft_consensus.cc:1081] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:12.009699 26858 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.088917 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:11.960539 27157 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:11.964843 27162 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.052027 26871 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.094522 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.094543 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.041083 27074 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.095201 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.060259 27172 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.067297 27141 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.944358 27108 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.101799 26997 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.102644 27070 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.088716 26953 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.103892 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.104466 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.105778 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.106675 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.176425 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.106779 27134 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.108976 27063 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:12.109561 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.009195 27046 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.074549 27089 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.116103 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 271376us
I20260709 12:20:12.117523 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:11.964768 27047 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.073845 26969 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.092082 27143 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.096200 27056 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:20:12.122275 27132 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:12.122532 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.088220 27164 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:12.123337 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.198551 21036 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.124207 27115 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:12.123716 20294 leader_election.cc:400] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:20:12.116570 27127 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.132700 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:12.204295 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 71688.9us
I20260709 12:20:12.133612 27061 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:12.135824 27096 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.061491 27176 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.141428 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.143379 27151 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.143608 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.144002 26871 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.150828 20178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:12.156035 26975 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.158202 27060 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.158748 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.229983 20171 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:12.116125 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:12.120544 21041 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:20:12.230965 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 114901us
I20260709 12:20:12.231696 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:12.232529 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:12.232666 26956 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:12.233075 26956 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.112344 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.167834 20176 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.234222 21040 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:12.176436 20326 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:12.121758 26858 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:12.187695 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 93216.4us
I20260709 12:20:12.238849 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.189571 27134 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.177094 27141 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.245841 21042 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:12.245585 26808 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.249208 27046 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.250308 21039 raft_consensus.cc:2393] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:12.248842 27146 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.190824 20325 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:12.191151 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.201655 20294 leader_election.cc:403] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:20:12.253533 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 129995us
I20260709 12:20:12.189036 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:12.200815 27047 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.188020 27179 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.265367 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:12.117110 27029 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.120957 27014 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.205056 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:12.271683 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66713.7us
W20260709 12:20:12.273680 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84769.9us
I20260709 12:20:12.274298 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:12.275785 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.278992 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:12.199239 27184 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:12.196816 27089 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.206534 27061 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:12.179029 26997 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.218940 27176 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.219282 27115 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:12.308805 27115 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.309059 27029 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.309188 27115 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.310335 27029 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.310403 20321 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:12.311067 27029 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.311751 27124 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:12.219837 27096 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.217036 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.313306 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.290683 27184 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.314339 27184 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.314463 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.286521 27046 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:12.315254 20321 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:12.316049 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.316139 20173 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:12.316989 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.317951 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.318895 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.220861 21038 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:12.320302 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.224444 20178 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:12.319463 20321 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:20:12.321395 20178 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.224946 20328 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:12.160416 27162 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.195731 27143 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.233388 26956 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.250779 27127 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.202188 20177 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:12.259261 20324 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:12.276528 21037 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:12.292204 21034 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 26: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.289460 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.267975 27178 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.299345 27135 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:12.303699 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.290558 27149 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:12.277034 27179 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.304386 27089 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.305107 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:12.306404 26997 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.310671 26969 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.321102 20172 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
W20260709 12:20:12.362569 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 57532.8us
I20260709 12:20:12.227360 20323 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:12.318303 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.269860 27128 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:20:12.275943 26975 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.330972 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.269666 27155 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:12.361690 20329 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:12.332365 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:12.291929 26808 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.286154 27157 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:12.296641 27151 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:12.276376 27142 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.349202 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.353462 27117 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:12.352916 20175 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:20:12.271202 27172 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:12.356685 27063 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:12.357476 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68052.2us
I20260709 12:20:12.367192 27073 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:12.364148 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.364293 20173 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.287371 27007 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.067s
I20260709 12:20:12.371515 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.285815 27121 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:12.372628 27089 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:12.376511 20174 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:12.379014 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:12.307502 27177 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
W20260709 12:20:12.380828 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86294.3us
I20260709 12:20:12.436368 27128 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.446318 27128 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:12.385541 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.448450 27128 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:12.380268 27056 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:12.449647 27056 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.451853 27074 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.452483 27074 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:12.452841 27074 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.453227 27074 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.453028 20178 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.455510 20178 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.456748 27179 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.457068 20175 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:20:12.359169 21037 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:12.335780 27156 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.460359 27146 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.461441 27156 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.335958 27176 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:20:12.462321 27061 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.463117 21043 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.439445 20179 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:12.372438 26997 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:12.373997 27029 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.375061 27060 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:12.374734 20321 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:12.353089 27130 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.441854 20323 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:12.370154 27155 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:12.467939 20327 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:12.470626 21036 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:12.478087 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.481293 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.482390 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:12.511229 20176 raft_consensus.cc:2393] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:12.443670 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78867.7us
I20260709 12:20:12.470326 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:12.512444 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:12.477869 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:12.465986 20325 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
I20260709 12:20:12.366179 27178 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.383515 27172 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.358373 27135 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.498030 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:12.514945 20171 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.509948 20175 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:12.463958 26886 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.514243 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:12.517351 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.349815 27164 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.498109 27174 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:12.519932 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.441816 26969 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.441040 27121 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.508201 26997 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.463533 27061 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.439200 27073 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.536711 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.542385 27165 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:12.551681 20171 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:12.553479 20327 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:20:12.514997 27096 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.561609 26871 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.564182 20180 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:12.566171 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.497364 27108 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.510934 27155 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:12.383697 27117 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.554437 27135 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:12.586494 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49873.8us
I20260709 12:20:12.524766 27146 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:12.535468 27172 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.539229 27156 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:20:12.593546 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 208104us
I20260709 12:20:12.614602 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:12.604575 27184 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.576928 27121 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.615725 27165 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:12.616957 26997 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.616734 27165 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.606789 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.619153 26858 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.619923 20248 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 22.
I20260709 12:20:12.609899 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.620952 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.621212 20251 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:12.613284 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.579766 26969 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.622540 20172 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:12.622664 20321 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:12.623853 26969 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.612015 26956 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.624405 26969 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:12.625093 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.626161 26969 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:12.626669 26969 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:12.628043 27144 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.608747 27063 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.628532 27144 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.627499 27117 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.605868 27146 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.632278 27146 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.634509 27144 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.636730 27142 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.636956 27155 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.637539 27047 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.638221 27047 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:12.638437 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.638620 27047 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.639086 27047 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.642138 27162 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.621345 26858 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.625954 26956 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.637550 27127 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.645087 27184 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.579262 27056 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.569983 27174 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.651887 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:12.582173 27073 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:12.652612 20251 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.661338 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.661979 20254 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
W20260709 12:20:12.662328 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47832.9us
I20260709 12:20:12.647387 27155 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.648550 27156 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:12.664602 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.674813 20248 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
W20260709 12:20:12.656930 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 142299us
I20260709 12:20:12.675500 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.676486 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.678128 20248 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:12.673712 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.576782 26886 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.676514 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.683262 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.682314 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.684141 21039 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:12.685009 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.653375 27174 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.685860 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.686595 21042 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:12.686709 21008 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.688180 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:12.689206 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.689558 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:12.648998 27191 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:12.693315 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.693921 20248 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:12.695802 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:12.696377 20176 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.696615 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:12.697203 21040 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.698196 21034 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:12.700228 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:12.696223 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.667596 27135 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.708983 20248 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:20:12.673007 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 159904us
I20260709 12:20:12.693807 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.711891 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.672130 27108 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:12.681905 27164 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.716276 20179 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:20:12.681840 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 183897us
I20260709 12:20:12.716045 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.717303 20248 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:20:12.718186 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.718814 20324 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:12.718814 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:12.718889 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:12.722259 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.722335 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.723922 20251 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.725840 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.728124 20248 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:20:12.731417 27014 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.705580 27142 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:12.695523 27191 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.695597 26858 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:12.743022 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:12.743171 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:12.707814 27145 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:12.676770 27121 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.745990 21042 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.659574 26969 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.758098 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.728901 27183 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:12.746896 20176 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.713960 27089 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:12.750804 21034 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 25. Current term is 26. Ops: [25.21-25.21]
W20260709 12:20:12.762130 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 47505.1us
I20260709 12:20:12.768826 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.769821 20220 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:12.749913 27142 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.748632 26858 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.705946 27172 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.761672 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:12.818781 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 57212.6us
I20260709 12:20:12.749253 27191 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:12.821830 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 63820.8us
I20260709 12:20:12.773018 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.775424 27162 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.747529 20251 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:12.779856 26956 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:12.780292 27187 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:20:12.739279 27164 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.826546 27063 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:12.781558 27074 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.839974 27063 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.756035 27110 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:20:12.840389 27063 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:12.840945 27162 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.841581 27074 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.783367 27149 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:12.787075 27141 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.788232 27118 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:12.799224 27200 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:20:12.843209 27162 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.763357 27056 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:12.807780 27201 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:12.808434 21040 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:12.812026 27178 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.763211 27153 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.816284 26871 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.753844 27007 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:12.817302 20322 raft_consensus.cc:2368] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16.
I20260709 12:20:12.749616 27145 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:12.819612 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:12.717554 27135 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.762796 27183 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.754954 27198 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:12.753633 27108 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:12.761514 27165 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:12.826997 20250 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 9.
I20260709 12:20:12.767882 27155 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:12.748363 27193 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 12:20:12.823331 27142 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:12.759430 27156 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.822705 26858 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:12.835819 26956 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:12.844795 27130 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.846434 27121 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.827766 27180 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:12.923518 27180 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.925802 27180 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.761624 27143 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.895052 27108 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.927919 27143 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.928723 20330 raft_consensus.cc:2368] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20.
I20260709 12:20:12.929719 27135 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:12.932794 27115 consensus_meta.cc:287] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.003s
I20260709 12:20:12.933255 27115 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:12.934427 20326 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:12.802067 26953 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.834968 27047 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.849720 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53128 (request call id 998) took 1406 ms. Trace:
W20260709 12:20:12.855511 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 136782us
I20260709 12:20:12.865216 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.848302 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:12.940831 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75696.1us
I20260709 12:20:12.941008 20174 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.941517 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:12.847491 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 589055us
I20260709 12:20:12.771312 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:12.868795 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 143763us
I20260709 12:20:12.943877 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:12.944134 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:12.816175 27089 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.824622 27199 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:12.874272 27061 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:20:12.891076 27198 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.985145 27198 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:12.889369 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 69860.1us
I20260709 12:20:12.890559 27196 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:12.993844 26858 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.995183 21039 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:12.996595 26886 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.997990 26858 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.001925 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:13.002718 27146 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.003813 27180 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:12.850530 27134 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:12.864409 27201 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.004786 27201 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:13.005302 27146 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:12.907482 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.938023 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:13.007396 20176 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.007786 27180 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.008250 27180 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:12.853775 27172 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:12.922746 27157 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.004s
I20260709 12:20:12.945050 20248 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:12.945582 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.946836 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:12.947058 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.025502 20321 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:12.949141 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.939900 21035 rpcz_store.cc:276] 0709 12:20:11.443062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.443410 (+   348us) service_pool.cc:224] Handling call
0709 12:20:12.848849 (+1405439us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5800195098. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfed1fc0 00007f5ddfebc929 00007f5ddfebc3d2 00007f5dd9433bd4
0709 12:20:12.849082 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.849300 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.849347 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.849397 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:12.849461 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.849520 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.849630 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54528896}
I20260709 12:20:13.026479 20252 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.887497 27145 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.953188 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:13.038265 20178 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.954856 20323 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:12.959470 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:12.959859 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:12.960201 27197 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
I20260709 12:20:12.960589 20250 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:12.961287 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:12.950945 26956 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:12.892132 27183 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:13.073559 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:12.963759 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:13.075285 20325 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:12.964538 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:13.076589 20324 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:12.967940 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.970376 27047 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.970495 27209 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:12.971016 27199 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.971161 26871 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:12.972681 20254 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:12.896642 27155 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:12.975503 26975 consensus_meta.cc:287] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 12:20:12.972064 27073 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.978991 27165 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:12.940236 27164 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:12.980882 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:12.981971 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:12.880833 27046 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.008s
I20260709 12:20:12.986199 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:12.986547 27163 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.003270 26886 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:13.127887 26886 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.127985 27046 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:13.128381 26886 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.130529 27163 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.090945 27209 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.134042 27209 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.003885 26953 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:13.006562 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:13.074226 27157 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:12.834093 27174 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:12.944540 20251 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:13.003439 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:13.039481 20253 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:13.009863 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 68430us
I20260709 12:20:12.968312 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1255) took 1054 ms. Trace:
I20260709 12:20:13.074575 20247 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:13.594532 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.595266 20247 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:13.596276 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.086746 20249 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:13.046041 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.619285 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.620501 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.621207 20252 raft_consensus.cc:2368] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:20:13.621964 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.068150 20255 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:13.159142 20248 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:13.202948 20254 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:13.624893 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.625353 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.625566 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.245030 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:13.211248 20176 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:13.627023 27184 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:20:13.086714 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.629055 20252 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:13.630028 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:13.630100 27129 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:20:13.096544 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45378.1us
I20260709 12:20:13.137454 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:13.043237 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:13.121698 20329 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:13.641184 27121 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:13.229758 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2335) took 1176 ms (client timeout 1514 ms). Trace:
I20260709 12:20:13.175539 20321 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 26.
W20260709 12:20:13.645782 20330 rpcz_store.cc:269] 0709 12:20:12.066165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.073399 (+  7234us) service_pool.cc:224] Handling call
0709 12:20:13.229441 (+1156042us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54000cf154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:13.229643 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908501760}
I20260709 12:20:13.194703 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2338) took 1112 ms. Trace:
I20260709 12:20:13.648264 20322 rpcz_store.cc:276] 0709 12:20:12.082843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.216722 (+133879us) service_pool.cc:224] Handling call
0709 12:20:13.194490 (+977768us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540000ffd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:13.194636 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157496576}
I20260709 12:20:13.166457 20324 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:13.143918 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 140537us
I20260709 12:20:13.651650 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:13.652487 26858 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:13.652932 26858 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:13.653347 26858 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:13.124284 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.093904 26871 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.657724 26871 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:13.208691 26886 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.661834 26886 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.090354 26940 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:13.143285 26953 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.668767 26940 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.669288 26953 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.671018 26940 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.188242 27066 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:13.678002 20295 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:13.117856 27058 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.686343 27058 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.142947 27063 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.689656 27063 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.199944 27073 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.254805 27061 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.009362 27007 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:13.694361 27061 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.694888 27007 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.694968 26953 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.696648 27061 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.085604 27126 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:12.935457 27115 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.354105 20251 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:13.701328 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.798s (SENT) [suppressed 77 similar messages]
I20260709 12:20:13.701771 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.702409 20251 raft_consensus.cc:3060] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.704541 27007 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.155055 27142 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.211885 27145 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.708899 26871 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.710065 27145 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:12.885583 27153 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.091280 27155 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:13.711746 26858 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.712905 27153 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.713857 27067 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.202517 27163 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.714937 27142 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.193414 27174 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.290102 27144 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:13.716681 26953 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.716877 27144 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.718828 20176 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:13.718984 27144 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.188582 27180 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.721670 27180 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.212085 27183 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.191340 27196 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.200392 27198 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.726900 27198 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.085192 27199 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.218212 27201 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.159399 27209 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:12.839411 27191 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:13.324692 27207 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.430s	user 0.004s	sys 0.000s
W20260709 12:20:13.431962 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.433934 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 427438us
I20260709 12:20:13.436985 27157 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:13.443260 20253 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:13.473438 27096 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:13.502039 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:13.502020 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:13.525300 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3863) took 1080 ms. Trace:
I20260709 12:20:13.561569 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.562913 20180 rpcz_store.cc:276] 0709 12:20:11.913925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.062181 (+148256us) service_pool.cc:224] Handling call
0709 12:20:12.968057 (+905876us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400002154. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:12.968208 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023545728}
I20260709 12:20:13.600175 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:13.600937 27046 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.603286 20077 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 14 to 16, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 16 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:13.613771 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:13.617432 20073 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 311) took 17046 ms (client timeout 15000 ms). Trace:
I20260709 12:20:13.625699 20255 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:13.626417 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 381469us
I20260709 12:20:13.259728 20178 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:13.627487 27184 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:13.633281 27130 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:13.634490 20254 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:13.638011 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:13.643252 20327 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:13.647289 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3667) took 1166 ms. Trace:
I20260709 12:20:13.653277 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:13.098438 21036 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:13.666733 20252 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:13.142947 26956 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.682096 20177 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:13.682896 20172 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:13.685655 26940 raft_consensus.cc:2804] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:13.692010 27058 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.700417 27126 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.714398 27067 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.243208 27164 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:13.725142 20250 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:13.730340 27201 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.802999 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.713819 26858 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.826902 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.711102 26871 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.821489 27096 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.830108 27058 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:13.831715 26940 raft_consensus.cc:697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:13.831065 27058 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.832504 27058 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.802040 27180 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.834618 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:13.836035 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.836301 21041 raft_consensus.cc:2410] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:20:13.836630 20254 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.838649 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.803814 27046 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.805708 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:13.755014 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68781.9us
I20260709 12:20:13.807927 20325 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:13.808562 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:13.841722 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 188492us
I20260709 12:20:13.841763 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.809202 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:13.802089 20073 rpcz_store.cc:269] 0709 12:19:56.570947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.571111 (+   164us) service_pool.cc:224] Handling call
0709 12:19:57.000026 (+428915us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5de0cb6e9c 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:20:13.617344 (+16617318us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:09.336688 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:09.369825 (+ 33137us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:09.369885 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:20:09.369906 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:09.371198 (+  1292us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:09.371311 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:09.371342 (+    31us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:20:09.524299 (+152957us) tablet.cc:701] Row locks acquired
0709 12:20:09.524355 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:20:09.524548 (+   193us) write_op.cc:270] Start()
0709 12:20:09.524737 (+   189us) write_op.cc:276] Timestamp: P: 1783599609524466 usec, L: 0
0709 12:20:09.524759 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:20:09.525478 (+   719us) log.cc:844] Serialized 5144 byte log entry
0709 12:20:09.937181 (+411703us) op_driver.cc:464] REPLICATION: finished
0709 12:20:10.018608 (+ 81427us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5dde92eef0
0709 12:20:10.302276 (+283668us) write_op.cc:301] APPLY: starting
0709 12:20:10.302401 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:10.442370 (+139969us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:10.442411 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:10.670948 (+228537us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:10.785868 (+114920us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:20:10.791690 (+  5822us) write_op.cc:312] APPLY: finished
0709 12:20:10.922824 (+131134us) log.cc:844] Serialized 121 byte log entry
0709 12:20:10.923060 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:10.923245 (+   185us) write_op.cc:454] Released schema lock
0709 12:20:10.923343 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:10.923895 (+   552us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:10.923925 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1207054,"reported_tablets":35,"spinlock_wait_cycles":779492608,"child_traces":[["op",{"apply.queue_time_us":254026,"apply.run_cpu_time_us":24627,"apply.run_wall_time_us":621611,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58545,"num_ops":13,"prepare.queue_time_us":377284,"prepare.run_cpu_time_us":18346,"prepare.run_wall_time_us":265556,"raft.queue_time_us":262908,"raft.run_cpu_time_us":108699,"raft.run_wall_time_us":222944,"replication_time_us":412238,"spinlock_wait_cycles":13095808,"thread_start_us":776158,"threads_started":4,"wal-append.queue_time_us":145543,"wal-append.run_cpu_time_us":12737,"wal-append.run_wall_time_us":2259502}]]}
I20260709 12:20:13.844856 20248 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:13.846402 20219 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:13.847875 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.810679 27157 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.811686 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.812604 27067 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.798696 27183 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.813647 27209 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:13.854418 27046 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.853678 27163 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:20:13.854635 26940 consensus_queue.cc:237] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.835297 27180 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.816640 21008 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:13.817134 27184 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:13.817351 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 179394us
I20260709 12:20:13.862113 20294 leader_election.cc:400] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16.
I20260709 12:20:13.817834 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.863283 27115 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:13.863960 26956 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.817746 20329 rpcz_store.cc:276] 0709 12:20:12.480934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.481021 (+    87us) service_pool.cc:224] Handling call
0709 12:20:13.647117 (+1166096us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400087ad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:13.647224 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405344128}
I20260709 12:20:13.731803 20247 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19.
I20260709 12:20:13.856419 27157 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:13.864894 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48340.3us
I20260709 12:20:13.866278 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.777624 27155 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.866683 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.867467 21043 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:13.867898 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.868275 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.868520 27155 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.797525 27199 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.819793 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:13.820474 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:13.870033 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:13.870148 21035 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:20:13.870765 27199 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.871677 20247 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:13.873245 27180 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.873519 20247 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:13.855970 27174 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:13.874146 27174 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:13.874536 27174 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.874940 20247 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:13.820999 27191 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:13.821480 21034 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:13.850006 27196 raft_consensus.cc:2764] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:20:13.821697 20328 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.854672 27209 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:13.876709 20250 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:13.877662 20247 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:13.822163 27130 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.823706 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.880321 21039 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:13.764398 27007 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.803962 27126 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.730195 20251 raft_consensus.cc:2468] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:13.840023 21037 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:13.840139 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.806134 20173 rpcz_store.cc:276] 0709 12:20:12.444892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.445466 (+   574us) service_pool.cc:224] Handling call
0709 12:20:12.458030 (+ 12564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.511805 (+ 53775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.511849 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.512362 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.657007 (+144645us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:20:12.657051 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.657124 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.959587 (+302463us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:13.524870 (+565283us) raft_consensus.cc:1685] finished
0709 12:20:13.524897 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.525193 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53323,"raft.queue_time_us":53521,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13826,"spinlock_wait_cycles":4151168,"thread_start_us":135298,"threads_started":1,"wal-append.queue_time_us":146611}
I20260709 12:20:13.810243 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:13.848675 21036 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:13.845784 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:13.851547 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.891434 20251 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:13.893138 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.849550 26871 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:13.853592 27096 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:13.814365 20077 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:13.858160 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.858134 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.909080 20255 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:13.857013 27163 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:13.868985 21043 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:13.863407 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:13.868454 21042 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.858860 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:13.887859 20328 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:20:13.889657 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.899361 20248 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.898381 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:13.892696 20249 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:13.901022 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55301.5us
I20260709 12:20:13.902113 27126 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:13.903023 20295 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:13.890439 26858 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:13.892050 27130 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:13.947217 26858 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:13.910687 27067 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:13.948264 26858 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:13.945726 20077 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 11 to 14, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:13.952034 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 88718.9us
I20260709 12:20:13.953547 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:13.948881 27067 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.955215 26940 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:13.955268 27067 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.956750 27129 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:13.958725 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55791.1us
I20260709 12:20:13.958828 27115 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:13.959416 27115 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:13.960336 27115 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:13.962606 27121 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:13.848438 20144 connection.cc:256] RPC call timeout handler was delayed by -1.0274476299998696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 12:20:13.971372 27190 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:13.972353 21039 raft_consensus.cc:2368] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:13.972550 20172 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:13.972671 21041 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.980067 20294 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:13.967370 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:13.981325 20176 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:13.968235 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:13.984027 20255 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:13.907626 26871 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.897240 27191 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
W20260709 12:20:13.971107 20144 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.514s (SENT)
I20260709 12:20:13.967859 27163 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:13.985519 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1576) took 1028 ms. Trace:
I20260709 12:20:13.985528 20219 leader_election.cc:400] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:14.013227 20219 leader_election.cc:403] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:20:13.986867 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:13.987135 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:13.987825 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.013056 20328 rpcz_store.cc:276] 0709 12:20:12.957462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.501482 (+544020us) service_pool.cc:224] Handling call
0709 12:20:13.985449 (+483967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117120}
I20260709 12:20:14.015169 20173 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
I20260709 12:20:14.018862 20254 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:20:13.973393 20252 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.964257 27196 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:20:14.014118 20177 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:14.020283 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.022367 21007 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:14.002007 20176 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:14.026417 20248 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:20:13.974071 27190 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:13.989120 27199 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:13.992678 27130 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.994968 26871 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:14.028793 27121 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:14.037390 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 66330.9us
I20260709 12:20:14.038980 27199 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:14.056679 27199 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.058125 26940 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:14.036768 27007 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:14.050846 27190 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:14.053830 20144 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.555s (SENT)
I20260709 12:20:14.071815 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.043753 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:14.033937 27155 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:14.027894 27198 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:20:14.060298 21042 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:14.007633 27209 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.095830 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.081394 20255 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:14.079370 20327 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:14.082607 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.099897 20324 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:14.082898 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.084012 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.104416 20330 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.085280 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.094843 20252 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:14.116993 20248 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.092943 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:14.122905 20254 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.114261 20330 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:14.059198 27151 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:14.130414 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 76606.7us
W20260709 12:20:14.148018 20144 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.637s (SENT)
I20260709 12:20:14.148437 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:14.150000 27157 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.150522 27007 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.151506 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.152019 20253 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.131891 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.134130 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.135267 20328 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:20:14.136005 20077 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:14.139146 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.153451 20321 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.154637 20176 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:20:14.154090 20077 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 10, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 10 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:14.157290 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.158003 20177 raft_consensus.cc:2393] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.083552 27163 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:14.158871 27163 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:14.047497 27058 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:14.159771 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.160781 20321 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:14.160969 27067 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.161389 27058 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:14.163051 27067 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.163856 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.164726 20176 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:20:14.164921 27201 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:14.165341 27201 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:14.165700 20177 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.168828 27201 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.169553 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:14.170042 27201 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.170454 21042 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:14.139966 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:14.140715 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.171669 20255 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.129612 27046 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:14.171676 27190 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:14.140844 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.141479 27209 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.120111 27096 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:14.054127 27130 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.142524 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.175298 20248 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.144224 27129 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.086495 27145 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:14.151954 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.165655 21041 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
W20260709 12:20:14.187463 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.169720 27157 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:14.188479 20172 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.139904 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.061055 27115 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:20:14.177258 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:14.132542 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:14.190825 20250 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:14.177232 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 195903us
I20260709 12:20:14.178206 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.178565 20322 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:14.180006 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.192520 20171 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.198099 20176 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.190518 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.187744 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.201778 20174 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.189509 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:14.202570 20247 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.204983 20174 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:14.205129 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.205765 20172 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.210434 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.212092 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.212780 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.212965 20176 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:14.213410 20178 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.217016 20171 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:14.218954 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:14.220346 20324 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:14.220317 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.221724 20326 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.221555 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.220293 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.220558 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.227177 20177 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:14.228576 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.229056 20329 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:14.246863 20325 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:14.226307 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.172295 27046 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:14.187280 27196 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:14.244014 20294 leader_election.cc:400] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19.
I20260709 12:20:14.249045 20294 leader_election.cc:403] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:20:14.234174 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.216975 27145 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:14.211043 27153 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:14.249733 20322 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.256110 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.257110 20326 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:14.259553 20172 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:14.260452 20178 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:14.244782 27007 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:14.259021 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.265081 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:14.262795 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 125519us
I20260709 12:20:14.247224 27058 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:14.279902 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:14.272605 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:14.283587 27058 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.280356 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.286505 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.287853 20329 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.293195 27067 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:14.294063 27067 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:14.296833 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.302556 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:14.304792 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.244254 27184 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:14.319406 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.326098 20322 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:14.308480 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:14.276960 27183 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:14.271052 27180 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:20:14.270159 26940 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:20:14.278863 27144 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 12:20:14.361007 20178 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:14.363775 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.261389 27199 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:14.300871 27058 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:14.307127 27151 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:14.264734 27096 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.083s
I20260709 12:20:14.327602 27066 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:20:14.353649 27046 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.327275 27198 raft_consensus.cc:2764] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:20:14.314234 27007 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:14.263365 27196 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.307600 27130 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:14.365170 20326 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:14.340620 20329 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:14.307662 27209 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:14.345978 27067 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:14.362092 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800360400 after lost signal to thread 18964
I20260709 12:20:14.359753 26940 consensus_queue.cc:1243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:20:14.394539 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800360ae0 after lost signal to thread 20112
I20260709 12:20:14.369982 26886 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:20:14.420241 27164 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:20:14.423174 27196 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:14.424302 27224 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:20:14.427520 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800167fa0 after lost signal to thread 20204
I20260709 12:20:14.424119 27066 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:14.442549 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 136191us
W20260709 12:20:14.390154 27174 consensus_meta.cc:287] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.515s	user 0.015s	sys 0.000s
W20260709 12:20:14.443857 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800167f80 after lost signal to thread 20205
I20260709 12:20:14.411252 27199 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.437405 20327 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:14.438791 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:14.445609 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 173195us
I20260709 12:20:14.442873 27007 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:14.424379 27067 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:14.445354 27126 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:20:14.424825 27225 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19.
I20260709 12:20:14.456199 27174 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:14.359094 27145 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:14.463199 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800167740 after lost signal to thread 20280
I20260709 12:20:14.476148 27121 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:20:14.478608 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 139421us
W20260709 12:20:14.485518 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800167720 after lost signal to thread 20281
W20260709 12:20:14.476809 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 207971us
I20260709 12:20:14.486850 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:14.487728 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:14.488035 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:14.488773 21043 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:14.488837 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800401600 after lost signal to thread 20354
I20260709 12:20:14.489631 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:14.490695 20277 debug-util.cc:398] Leaking SignalData structure 0x7b0800384c00 after lost signal to thread 21072
I20260709 12:20:14.491282 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:14.491917 20247 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:14.493526 20248 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 12:20:14.481043 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:14.512455 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73770.5us
W20260709 12:20:14.555780 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 74835us
W20260709 12:20:14.505824 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 243234us
I20260709 12:20:14.522369 20253 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:14.481820 26886 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:14.525962 27226 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:20:14.495201 27153 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:14.494108 27121 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:14.553175 27190 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:14.528256 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.560078 27130 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:14.533861 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:14.520783 27199 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:14.559105 20251 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:14.561141 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:14.545352 27144 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:14.589018 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.563160 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:14.529147 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.526319 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:14.580675 27230 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:20:14.586653 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.589810 20180 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:14.525833 27067 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.653100 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.667585 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.572868 27046 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:14.605752 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 71981.7us
I20260709 12:20:14.547766 26871 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.564219 26886 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.584830 27153 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.558619 27221 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:20:14.657169 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.634038 20326 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.636405 20250 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:14.589509 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.677603 20172 raft_consensus.cc:2393] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 11: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.677517 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:14.634466 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 71382.5us
W20260709 12:20:14.663908 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 102917us
I20260709 12:20:14.678388 20177 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.665035 20180 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:14.569059 27190 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:14.561774 27240 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.094s
W20260709 12:20:14.669706 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.680065 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.585672 27130 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.688408 27130 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:14.688480 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:14.589092 27144 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:14.689698 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.682971 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.693629 20178 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:14.693778 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.678687 20295 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:14.693773 20329 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:14.686197 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.686328 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.695313 27144 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.691917 27073 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:20:14.697088 27073 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:14.697609 27073 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:14.698566 27073 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:14.566004 27151 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 12:20:14.653540 27184 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.668711 20327 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 22: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:14.652465 27236 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.687706 27198 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:20:14.711778 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.566727 27066 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:14.748761 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45717.9us
I20260709 12:20:14.667665 27238 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:14.752046 20326 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:14.683072 27046 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:14.729874 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 90271.1us
I20260709 12:20:14.755303 20178 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:20:14.568588 27007 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:14.747409 27242 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:14.811802 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:14.811686 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.682819 27199 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:20:14.686977 27115 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:14.820300 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.753458 20327 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.881479 20326 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:14.882555 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.814006 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:14.833823 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 145423us
I20260709 12:20:14.758445 27126 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:14.837131 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:14.884677 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.808245 26871 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.756356 27221 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:20:14.890095 20327 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
W20260709 12:20:14.880570 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.891392 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.838476 21042 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:14.691028 27121 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:14.842784 27163 consensus_meta.cc:287] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.006s
W20260709 12:20:14.891583 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72754.7us
I20260709 12:20:14.819345 27238 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.884855 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:14.891800 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.891649 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:14.900990 20327 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:14.901878 20247 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:14.893894 26871 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:14.883940 27115 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:14.816807 27190 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:14.931617 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.903823 27174 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.934602 27151 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:14.932561 27115 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:14.935406 27241 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:20:14.901634 27238 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:14.932497 20326 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
W20260709 12:20:14.940299 27201 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.005s
I20260709 12:20:14.899919 27246 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:20:14.952782 27151 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:14.896266 27234 consensus_queue.cc:1175] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e929b30888874ed59248f1229cecd3c6" responder_term: 22 status { last_received { term: 22 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 22 index: 15 } }
I20260709 12:20:14.968570 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.930608 27196 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:20:14.952160 27198 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:14.972656 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:14.961094 27126 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:14.956122 27190 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.978109 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.982502 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.983307 20178 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.973126 27046 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:14.986624 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:14.988076 27250 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:20:14.987983 27126 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:14.989331 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:14.990862 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.991395 26886 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:14.992534 27240 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:14.993475 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:14.991487 20174 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:14.995607 20171 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:14.996694 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.997331 20171 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.997987 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:14.998905 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:15.003014 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2228) took 1179 ms. Trace:
I20260709 12:20:15.006659 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:15.012799 20177 raft_consensus.cc:2368] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:14.999536 20171 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:14.994350 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:15.011066 20251 rpcz_store.cc:276] 0709 12:20:13.823721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.900256 (+ 76535us) service_pool.cc:224] Handling call
0709 12:20:13.900536 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.585712 (+685176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.002774 (+417062us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54003e9254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:15.002931 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514131328}
I20260709 12:20:14.978614 27221 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:15.025509 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.026886 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:15.028580 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:15.032838 20252 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:15.032351 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:15.037333 27096 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:15.031477 27184 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:15.040134 20175 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:15.043730 20180 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:15.046164 27151 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.024375 27221 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:15.065160 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 180374us
W20260709 12:20:15.067639 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 169062us
W20260709 12:20:15.067448 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 253564us
I20260709 12:20:14.980011 27198 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.026778 27240 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:15.076581 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.077713 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.078994 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:15.082196 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.063884 27046 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.084954 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.091529 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.086285 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:15.093236 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:15.099545 20251 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:15.097659 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:15.091941 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.085109 20174 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:15.107846 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:15.085333 27073 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:15.120929 27225 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:15.111109 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:15.079880 27145 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:20:15.116473 20251 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:15.118114 20327 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:15.118793 26886 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:15.084919 27257 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:15.095155 27249 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.108373 27058 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
I20260709 12:20:15.125162 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.130873 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.141260 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:15.142611 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:15.133008 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.134982 27155 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:15.105111 27199 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:15.140411 27249 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.136003 27073 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:15.105399 27046 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.107646 27130 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.124109 27174 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:20:15.173611 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.138069 27144 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.140583 27058 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.248320 20253 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 10. Current term is 11. Ops: [9.10-10.11]
I20260709 12:20:15.239039 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1823) took 1095 ms. Trace:
I20260709 12:20:15.200453 20327 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:20:15.201462 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 94583.8us
I20260709 12:20:15.261078 20252 rpcz_store.cc:276] 0709 12:20:14.133528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.140584 (+  7056us) service_pool.cc:224] Handling call
0709 12:20:15.228759 (+1088175us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400196ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:15.228916 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818098560}
I20260709 12:20:15.227065 20251 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:15.272575 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:15.186079 26886 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:15.252005 27261 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:20:15.199529 27180 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:20:15.311390 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 286003us
I20260709 12:20:15.312728 20326 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:15.313210 20172 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:15.313434 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49613.8us
I20260709 12:20:15.227658 27163 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.315552 20325 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:15.199199 27201 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:15.200062 27247 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:15.316975 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.260033 27155 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:15.314977 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:15.142287 27221 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.321666 20179 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:20:15.318418 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 185551us
I20260709 12:20:15.306627 27174 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:15.329161 27046 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:15.322717 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:15.329931 27174 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.332710 27058 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:15.332438 27155 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.333068 27235 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.333320 27157 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:15.333503 27155 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:15.333937 27157 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:15.333899 27235 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:15.324630 21041 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:15.320124 27201 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.325539 27198 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:15.319720 27163 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.336199 27247 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:15.337131 27247 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.337750 27163 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:15.322095 27007 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:20:15.326316 27073 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.306792 26871 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:20:15.328717 27144 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:15.323170 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:15.313815 27180 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:15.340267 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.353317 20329 raft_consensus.cc:2410] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:20:15.320712 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:15.347791 27007 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:15.347880 20321 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:20:15.340389 27276 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:15.323341 27096 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:20:15.320431 27259 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:20:15.320588 27275 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:15.314589 27199 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:15.345863 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:15.353782 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.354591 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:15.366710 20327 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:15.363668 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:15.335043 27157 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.370687 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:15.371534 21041 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:15.335212 27238 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:15.374352 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 51243.8us
I20260709 12:20:15.376103 20294 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:15.361614 27184 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:15.359064 27007 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:15.360512 27251 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.378304 27268 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.385506 27046 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:15.386269 27046 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:15.388070 27180 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.21, Last appended by leader: 21, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.389213 27144 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:15.389467 27184 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:15.389777 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.390442 20321 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:15.390548 27184 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.397188 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:15.397491 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:15.397188 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:15.398910 21042 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:15.400588 21043 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:15.364849 26886 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:15.405326 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:15.405710 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:15.407137 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:15.420161 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.188488 27240 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.422283 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:15.423048 20247 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:20:15.423466 20247 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 10
I20260709 12:20:15.423756 20247 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:20:15.424019 20247 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:15.423990 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:15.426518 20254 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.430255 20253 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 12:20:15.390959 27199 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.389237 27180 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:15.431522 20248 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:20:15.378473 27275 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:15.438971 27046 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:15.479871 20253 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:15.402215 27163 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:15.442775 21034 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 12:20:15.456115 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 101583us
I20260709 12:20:15.482188 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:15.475106 27130 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:15.436446 27115 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.476737 27121 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:15.477012 20328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:15.485638 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3684) took 1237 ms. Trace:
I20260709 12:20:15.487286 20321 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:20:15.424134 27096 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.487747 20324 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:15.489720 20256 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:20:15.494379 20328 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:15.505970 20328 raft_consensus.cc:614] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:15.491272 20254 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:15.490938 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.494657 20325 rpcz_store.cc:276] 0709 12:20:14.247805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.247919 (+   114us) service_pool.cc:224] Handling call
0709 12:20:15.485427 (+1237508us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400328a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:15.485578 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368210816}
W20260709 12:20:15.519774 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.798s (SENT)
I20260709 12:20:15.476773 27275 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:15.490154 27183 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:15.493721 27201 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:15.400522 27251 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:15.546289 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 59243.6us
I20260709 12:20:15.491509 27163 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:15.547111 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:15.552641 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:15.548439 27259 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.008s
I20260709 12:20:15.518765 27096 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.490891 27007 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.526171 26886 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.809573 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:15.694373 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1278) took 1535 ms. Trace:
I20260709 12:20:15.857807 21034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:20:15.579710 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:15.981980 21034 raft_consensus.cc:606] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:15.993023 21034 raft_consensus.cc:614] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:15.579831 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:15.961843 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.855455 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:15.946578 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.892248 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 345151us
I20260709 12:20:15.997694 20179 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:15.994136 20254 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:15.844339 27155 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.007s
I20260709 12:20:15.851920 27115 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:15.887050 27282 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 12:20:16.001271 20255 raft_consensus.cc:2410] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:20:15.981338 20173 rpcz_store.cc:276] 0709 12:20:14.159400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.161915 (+  2515us) service_pool.cc:224] Handling call
0709 12:20:14.223574 (+ 61659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.223984 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.224030 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.246092 (+ 22062us) log.cc:844] Serialized 26 byte log entry
0709 12:20:14.424935 (+178843us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:14.424981 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.425059 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.814518 (+389459us) raft_consensus.cc:1685] finished
0709 12:20:14.814540 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.693968 (+879428us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b5400319cd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:15.694281 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4592,"raft.queue_time_us":5303,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11728,"spinlock_wait_cycles":140927872,"thread_start_us":146528,"threads_started":1,"wal-append.queue_time_us":239231,"wal-append.run_cpu_time_us":6543,"wal-append.run_wall_time_us":1311638}
I20260709 12:20:15.584527 27275 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:15.860510 27250 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:16.005707 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:15.865967 27144 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.663720 27238 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:15.967330 27251 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:15.560562 27249 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:15.568936 27163 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:16.020996 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:16.042397 20254 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:16.071910 21038 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:15.979928 27183 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:16.005496 27291 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:16.127425 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 126480us
I20260709 12:20:16.132012 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:16.133364 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:16.009073 27232 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 12:20:16.012590 27115 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:20:16.138959 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.020661 27246 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:16.137375 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:16.137885 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.147074 20327 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 11: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:16.141937 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:16.009348 27268 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 12:20:16.012398 27096 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.144775 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:16.129369 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.077852 27184 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:16.168479 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:16.159480 20171 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:20:16.151024 20172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.000s	sys 0.016s
I20260709 12:20:16.008925 27234 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.120s
I20260709 12:20:16.152062 27238 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.161907 26886 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:16.167160 27121 consensus_meta.cc:287] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.667s	user 0.005s	sys 0.004s
I20260709 12:20:16.167850 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.174317 20321 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:16.169159 21035 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:16.172302 20251 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:16.127497 27288 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.159754 27180 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.005s
W20260709 12:20:16.183879 27284 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.010s
W20260709 12:20:16.184366 27284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.009s	sys 0.011s
I20260709 12:20:16.092378 27144 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:16.189335 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.178901 20323 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:16.189965 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2346) took 1604 ms. Trace:
I20260709 12:20:16.190376 20324 rpcz_store.cc:276] 0709 12:20:14.577513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.577658 (+   145us) service_pool.cc:224] Handling call
0709 12:20:15.487466 (+909808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.504332 (+ 16866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.181797 (+677465us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400328a50. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:16.181919 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091509504}
W20260709 12:20:16.170413 20172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.016s
I20260709 12:20:16.187855 20180 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:16.129365 27240 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:16.173166 27291 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:16.219707 20322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:16.220459 20322 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
W20260709 12:20:16.193853 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 194454us
I20260709 12:20:16.185336 27246 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:16.169586 27259 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:20:16.224529 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.171461 27289 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:20:16.225324 27199 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.173908 27184 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:16.228363 27281 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:20:16.226553 27240 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.185534 27288 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.233258 27234 consensus_queue.cc:1243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:20:16.245481 27247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.001s	sys 0.021s
I20260709 12:20:16.231199 27199 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.009483 27250 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.238018 27303 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.194772 27183 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.253983 27227 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.275854 27303 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.278920 20173 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:20:16.272522 27247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.001s	sys 0.021s
I20260709 12:20:16.239828 26886 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 12:20:16.309631 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65151.3us
I20260709 12:20:16.313094 21036 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:16.279409 27289 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.314203 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.307497 27157 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.308633 27209 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:16.316884 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:16.319823 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:16.306185 27246 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.318408 27232 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:16.253227 27291 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.344435 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:16.345170 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:16.345317 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.319434 27308 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:20:16.351115 27297 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:20:16.315843 27268 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:20:16.318444 27209 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:16.355867 21042 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 25. Current term is 26. Ops: [25.21-25.21]
I20260709 12:20:16.357287 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:16.367820 21035 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 13: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:16.355836 27308 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:16.308429 27227 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:16.351912 27299 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:20:16.328678 27225 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:16.325693 27234 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:16.326689 27199 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.384296 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:16.370296 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2430453189999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 12:20:16.376294 21034 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:16.344803 27155 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.319857 27157 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.365121 27232 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:16.390070 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:16.390813 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.377048 20249 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:16.378724 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:16.349560 27311 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.317281 27289 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.390941 20251 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:16.380978 27225 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:16.394588 27304 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:20:16.391547 27144 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.394299 27234 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:16.394263 27096 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:16.428767 27303 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:16.401666 27311 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:16.434765 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.405110 27209 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.402704 27225 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:16.394004 27155 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:16.432858 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 79442.2us
I20260709 12:20:16.408170 27288 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:16.451458 20324 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 25. Current term is 26. Ops: [25.21-25.21]
I20260709 12:20:16.452030 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:16.430778 27184 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:16.457358 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.458225 20322 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:20:16.433813 27308 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.440121 27250 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.463202 27308 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.469213 27155 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:16.434372 27096 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.472126 27096 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:16.472545 27306 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:20:16.474397 27289 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:16.489322 20329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2358) took 1803 ms (client timeout 1856 ms). Trace:
W20260709 12:20:16.489828 20329 rpcz_store.cc:269] 0709 12:20:14.686155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.710067 (+ 23912us) service_pool.cc:224] Handling call
0709 12:20:16.489119 (+1779052us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000cec54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:16.489259 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183102720}
I20260709 12:20:16.493630 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:16.497359 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:16.522289 20249 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:16.527034 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:16.532609 20063 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e929b30888874ed59248f1229cecd3c6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:16.534858 27268 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:16.528067 27250 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:16.549326 20324 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:16.496119 27209 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:16.595448 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.572247 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 249352us
I20260709 12:20:16.606285 20250 raft_consensus.cc:1275] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:20:16.605751 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 201509us
W20260709 12:20:16.608857 20144 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Timed out: RequestConsensusVote RPC to 127.18.132.67:46619 timed out after 1.674s (SENT)
I20260709 12:20:16.609733 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:16.612082 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 86012.5us
I20260709 12:20:16.613312 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:16.591971 27308 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:16.620401 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.620909 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9245571799999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 12:20:16.621248 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8516571799998474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 12:20:16.621565 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7921453189999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 12:20:16.621995 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7723453189998963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:20:16.622526 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5223608729997977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 12:20:16.622913 20144 connection.cc:256] RPC call timeout handler was delayed by -1.330445318999864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2701s for a response
I20260709 12:20:16.624540 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.564836 27319 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.625382 20180 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:16.626781 20172 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:16.629801 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.631111 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.631784 20177 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:16.633088 20176 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:16.634057 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.634219 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:16.636551 20326 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:16.636951 20326 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:16.637722 20326 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.638650 20326 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:16.646430 20220 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.532s (SENT)
I20260709 12:20:16.628572 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:16.563632 27066 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:20:16.665992 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:16.666909 20172 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 25 index: 21. Preceding OpId from leader: term: 26 index: 21. (term mismatch)
I20260709 12:20:16.676523 20172 pending_rounds.cc:85] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 20
I20260709 12:20:16.676824 20172 pending_rounds.cc:107] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 25.21
I20260709 12:20:16.677040 20172 raft_consensus.cc:2889] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:16.548642 27234 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.681842 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:16.682989 20328 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:16.696846 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:16.697901 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.701155 20171 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:16.698773 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.702481 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:16.703051 20175 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:16.621971 27153 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.620033 27284 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:16.679934 27096 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:16.617229 27144 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 12:20:16.764550 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 58450.9us
I20260709 12:20:16.680441 27227 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:16.767658 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.786659 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.663915 27308 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.712908 27130 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:16.794193 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:16.796566 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:16.799887 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.811403 20180 raft_consensus.cc:2393] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:16.802585 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 118929us
I20260709 12:20:16.812074 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:16.806505 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:16.808985 20256 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:16.712685 27323 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:16.713392 27157 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.816886 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:16.816039 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:16.819307 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:16.821763 20248 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:16.824681 20248 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:16.825350 20171 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:16.708304 27238 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 12:20:16.766440 27316 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:16.830049 20253 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:16.833403 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.787629 27144 consensus_queue.cc:1243] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:20:16.837491 20247 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:16.837417 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.764446 27251 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:20:16.869266 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.870769 20175 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
W20260709 12:20:16.876870 27322 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:20:16.877964 27308 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:16.801973 27250 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.916149 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.926297 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:16.770874 27153 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.788862 27324 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
W20260709 12:20:16.933950 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 111246us
I20260709 12:20:16.929662 27183 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.836740 27285 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:16.902056 27275 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.929659 27319 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.936638 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.930208 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:16.930799 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:16.956871 20171 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:16.938066 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 226817us
I20260709 12:20:16.939599 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.963084 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.964474 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.965133 20326 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:16.939751 20324 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:16.939916 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.884778 27184 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:16.949306 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.972316 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:16.883984 27199 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.975602 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.976554 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:16.966868 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:16.978778 20324 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:16.980242 20324 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:16.927910 27311 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.932085 27308 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.973516 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 151956us
W20260709 12:20:16.970506 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.552s (SENT)
I20260709 12:20:16.984462 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.833856 27323 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:16.992811 27323 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:16.950193 27333 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.993950 27333 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.997437 27333 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:16.998136 27333 consensus_queue.cc:1048] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:17.003131 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:17.004004 20326 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:16.972397 27284 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:16.951774 27318 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:17.014456 27320 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:20:17.014534 27315 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.015206 27232 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:20:17.015522 27317 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:20:17.015785 27314 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:20:16.982867 27316 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.949323 27250 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.031976 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:16.987331 27066 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.999898 27145 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.975294 27247 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 12:20:17.005592 27308 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.088093 27349 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.089613 27153 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:17.125442 27153 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:17.125982 27153 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.130460 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:17.106388 27066 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.138163 27066 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:17.138799 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:17.140203 20174 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:17.140103 27354 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:17.141486 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:17.143019 27349 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.145291 27349 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:17.145825 27349 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:17.148725 27293 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.915s	user 0.003s	sys 0.000s
I20260709 12:20:16.955602 27183 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.012326 27311 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:16.981330 27319 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:16.971925 27275 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:17.083079 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 98730.8us
W20260709 12:20:17.104408 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 133920us
I20260709 12:20:16.983511 27184 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:17.105547 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 105334us
I20260709 12:20:17.064867 27232 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:17.000348 27130 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:20:16.986876 27199 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:17.115854 27327 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:20:17.116163 27238 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.168108 27311 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.007090 27285 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:20:17.124751 27353 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.155215 20174 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 23: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:17.065704 27155 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:17.174018 20180 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 15: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:17.181073 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.216706 20326 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:17.218581 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:17.106536 27341 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:17.222985 20220 leader_election.cc:336] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.639s (SENT)
I20260709 12:20:17.225623 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:17.230247 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 129899us
I20260709 12:20:17.083602 27318 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.076506 27315 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:17.235335 27335 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 12:20:17.236089 27199 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:17.238675 27232 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.101652 27316 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:17.239907 27238 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:20:17.240322 27164 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:17.241081 20253 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:20:17.356462 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 379953us
I20260709 12:20:17.241528 20175 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:17.397505 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 225474us
I20260709 12:20:17.448460 27164 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:17.241248 20171 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:20:17.538267 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:17.556231 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:17.576514 20174 raft_consensus.cc:2410] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:17.539868 20326 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:17.540666 20256 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17. Re-sending same reply.
I20260709 12:20:17.258338 27311 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:17.447005 27308 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:17.460984 27066 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.559912 27209 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.953s	user 0.013s	sys 0.000s
I20260709 12:20:17.629539 20326 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:17.394382 27153 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:17.391505 27251 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.547439 27155 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:18.165921 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:17.896044 20324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.010s	sys 0.038s
I20260709 12:20:17.592518 27232 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:18.165704 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 942655us
W20260709 12:20:18.188309 20220 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.687s (SENT)
I20260709 12:20:18.188978 20220 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:18.008452 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1843) took 1440 ms. Trace:
I20260709 12:20:18.192401 20252 rpcz_store.cc:276] 0709 12:20:16.567714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.567928 (+   214us) service_pool.cc:224] Handling call
0709 12:20:16.614508 (+ 46580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.614692 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.614707 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.615029 (+   322us) log.cc:844] Serialized 26 byte log entry
0709 12:20:16.688228 (+ 73199us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:16.688282 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.688375 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.008096 (+1319721us) raft_consensus.cc:1685] finished
0709 12:20:18.008133 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.008348 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":15359,"threads_started":1,"wal-append.queue_time_us":310985}
W20260709 12:20:18.195851 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.717s (SENT)
I20260709 12:20:18.166862 20174 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
W20260709 12:20:18.197150 20220 leader_election.cc:336] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.885s (SENT)
I20260709 12:20:18.197297 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3743) took 1399 ms. Trace:
I20260709 12:20:18.197706 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:18.167459 20324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.014s	sys 0.047s
I20260709 12:20:18.166678 20326 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.197810 20174 rpcz_store.cc:276] 0709 12:20:16.798333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.673987 (+875654us) service_pool.cc:224] Handling call
0709 12:20:18.197208 (+523221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:18.207187 20220 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.900s (SENT)
I20260709 12:20:18.207981 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:18.223706 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:17.671303 27339 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.238902 21007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.007s	sys 0.011s
I20260709 12:20:17.673182 27315 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:18.067454 27338 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:18.130054 27348 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:18.239516 21007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.007s	sys 0.011s
I20260709 12:20:18.166424 27184 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:17.623898 27353 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.178965 27275 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:17.791611 27183 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:18.238354 27225 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.786s	user 0.006s	sys 0.006s
I20260709 12:20:18.251838 27153 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:20:18.283033 20221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.006s	sys 0.027s
W20260709 12:20:18.310289 20221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.006s	sys 0.028s
I20260709 12:20:18.288125 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:18.311628 20326 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
W20260709 12:20:18.295404 20247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.017s	sys 0.025s
W20260709 12:20:18.289331 27284 consensus_meta.cc:287] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.268s	user 0.009s	sys 0.005s
I20260709 12:20:15.606392 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:18.196205 27251 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.069607 27250 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:18.278831 27315 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:18.314056 20247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.018s	sys 0.025s
I20260709 12:20:18.312870 20326 pending_rounds.cc:85] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 10
W20260709 12:20:18.315369 21008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.000s	sys 0.015s
I20260709 12:20:18.333029 20326 pending_rounds.cc:107] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:17.671473 27066 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:18.315987 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 2.70945e+06us
I20260709 12:20:17.671366 27164 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.314091 27348 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:18.324128 27234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.003s	sys 0.018s
I20260709 12:20:18.332085 20252 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:18.333171 21008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.000s	sys 0.016s
I20260709 12:20:18.333650 20326 raft_consensus.cc:2889] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:18.291520 27319 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:18.300537 27340 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:18.284914 27338 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:18.359707 27316 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:18.324991 27153 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:18.382272 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 920754us
I20260709 12:20:18.296516 27339 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.384250 27067 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:18.384836 27338 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:18.325886 27284 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:18.382771 27164 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:18.385820 27339 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:18.387080 27318 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:18.389428 27353 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:18.311271 27225 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.390601 20325 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 22. Current term is 23. Ops: []
W20260709 12:20:18.391202 27347 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.041s	user 0.002s	sys 0.009s
I20260709 12:20:18.388108 27155 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:18.391750 27225 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:18.326378 26871 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.019s	sys 0.034s
W20260709 12:20:18.392383 26871 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.019s	sys 0.035s
I20260709 12:20:18.395234 27340 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.396562 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1613) took 1180 ms. Trace:
I20260709 12:20:18.398172 20326 rpcz_store.cc:276] 0709 12:20:17.216039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.216232 (+   193us) service_pool.cc:224] Handling call
0709 12:20:17.216557 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.396282 (+1179725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.396500 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.399161 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:18.402309 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:18.406461 20326 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:18.407001 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1617) took 1179 ms. Trace:
I20260709 12:20:18.405508 27369 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:18.363231 27234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.004s	sys 0.019s
I20260709 12:20:18.384836 27067 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:18.407414 20326 rpcz_store.cc:276] 0709 12:20:17.227173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.401909 (+1174736us) service_pool.cc:224] Handling call
0709 12:20:18.406941 (+  5032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.339918 27250 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:18.405557 27153 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:20:18.417845 27367 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:18.419159 27365 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:18.419644 27365 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:18.414179 27250 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.418876 27067 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.412496 27369 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:18.412271 27348 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:18.360236 27315 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.437793 27369 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:18.458134 27340 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:18.459261 27250 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:18.464099 27360 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:18.464687 27364 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.465237 27364 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.420679 27365 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:18.447844 27229 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:20:18.419193 27367 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.477069 27367 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:18.467473 27364 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:18.480104 27315 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:18.481698 27311 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.004s
W20260709 12:20:18.529090 20248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.001s	sys 0.002s
W20260709 12:20:18.596484 20248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.002s
I20260709 12:20:18.596853 27311 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:18.529131 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 121996us
W20260709 12:20:18.531612 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 324338us
W20260709 12:20:18.599961 20220 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.908s (SENT)
I20260709 12:20:18.601851 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1846) took 1388 ms. Trace:
I20260709 12:20:18.604303 20174 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:18.541368 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1615) took 1323 ms. Trace:
I20260709 12:20:18.602461 20248 rpcz_store.cc:276] 0709 12:20:17.213114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.213265 (+   151us) service_pool.cc:224] Handling call
0709 12:20:17.231613 (+ 18348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.232016 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:17.588188 (+356172us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.597199 (+1009011us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.598349 (+  1150us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.598621 (+   272us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:18.598668 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.598804 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.601395 (+  2591us) raft_consensus.cc:1685] finished
0709 12:20:18.601419 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.601669 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1107860,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5622,"raft.queue_time_us":600,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":452,"thread_start_us":843963,"threads_started":2,"wal-append.queue_time_us":570365}
I20260709 12:20:18.545205 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1603) took 2050 ms. Trace:
I20260709 12:20:18.604925 27066 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:18.549541 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:18.605844 20220 connection.cc:256] RPC call timeout handler was delayed by -1.3914172380000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 12:20:18.606483 20220 connection.cc:256] RPC call timeout handler was delayed by -1.376543583000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 12:20:18.605015 20324 rpcz_store.cc:276] 0709 12:20:17.217250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.217775 (+   525us) service_pool.cc:224] Handling call
0709 12:20:17.218216 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.218642 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.218683 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.219310 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.199054 (+979744us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:18.199096 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.199170 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.540275 (+341105us) raft_consensus.cc:1685] finished
0709 12:20:18.540369 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.540950 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5699,"thread_start_us":889981,"threads_started":1,"wal-append.queue_time_us":1181902}
W20260709 12:20:18.607064 20220 connection.cc:256] RPC call timeout handler was delayed by -1.364943121999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 12:20:18.607589 20220 connection.cc:256] RPC call timeout handler was delayed by -1.2667435830001068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:20:18.605358 20329 rpcz_store.cc:276] 0709 12:20:16.494975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.495245 (+   270us) service_pool.cc:224] Handling call
0709 12:20:16.530799 (+ 35554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.531021 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:18.396613 (+1865592us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003e4100. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf
0709 12:20:18.396803 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.544429 (+147626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:18.544576 (+   147us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:18.544686 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.544799 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.544997 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74899,"prepare.queue_time_us":142819,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":4670208,"thread_start_us":295655,"threads_started":2,"wal-append.queue_time_us":78555}
W20260709 12:20:18.608616 20220 leader_election.cc:336] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.009s (SENT)
I20260709 12:20:18.608534 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:18.609073 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:18.609403 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:18.610215 20329 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:18.612011 27174 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:18.553721 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3919) took 2531 ms. Trace:
I20260709 12:20:18.562041 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:18.564491 21008 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.783s (SENT)
I20260709 12:20:18.567061 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1604) took 2038 ms. Trace:
W20260709 12:20:18.568976 20323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2348) took 3990 ms (client timeout 2142 ms). Trace:
W20260709 12:20:18.571169 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3739) took 1773 ms (client timeout 1885 ms). Trace:
I20260709 12:20:18.475088 27365 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:18.613834 20179 rpcz_store.cc:276] 0709 12:20:16.022012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.025464 (+  3452us) service_pool.cc:224] Handling call
0709 12:20:16.092719 (+ 67255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.273075 (+180356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.273112 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:16.273165 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:16.273206 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.553028 (+2279822us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000a28d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:18.553105 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.553411 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334186752}
W20260709 12:20:18.618528 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 57020.2us
I20260709 12:20:18.614322 20322 rpcz_store.cc:276] 0709 12:20:16.528906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.529053 (+   147us) service_pool.cc:224] Handling call
0709 12:20:16.593771 (+ 64718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.675442 (+ 81671us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:16.675476 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:16.675522 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:16.675553 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.566396 (+1890843us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b54003acfd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:18.566462 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.566793 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187239168}
I20260709 12:20:18.620687 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:18.622066 20179 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:18.483932 27369 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:20:18.614648 20323 rpcz_store.cc:269] 0709 12:20:14.578136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.578259 (+   123us) service_pool.cc:224] Handling call
0709 12:20:18.568387 (+3990128us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540015cf54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:18.568631 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3473825536}
I20260709 12:20:18.633570 27247 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:18.634099 27247 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:18.634140 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85079.4us
I20260709 12:20:18.634644 27247 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:18.634929 27375 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:18.635584 27375 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.638633 27375 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:18.470146 27251 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:18.541776 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1616) took 1317 ms. Trace:
I20260709 12:20:18.640239 20326 rpcz_store.cc:276] 0709 12:20:17.224505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.420689 (+1196184us) service_pool.cc:224] Handling call
0709 12:20:18.421102 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.421382 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.421419 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.421992 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.540816 (+118824us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:18.540989 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.541171 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.541253 (+    82us) raft_consensus.cc:1685] finished
0709 12:20:18.541264 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.541511 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":118022,"threads_started":1,"wal-append.queue_time_us":61811}
I20260709 12:20:18.641227 27311 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:18.614809 20171 rpcz_store.cc:269] 0709 12:20:16.797464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.972057 (+174593us) service_pool.cc:224] Handling call
0709 12:20:18.570593 (+1598536us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400240ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:18.570854 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616590208}
W20260709 12:20:18.624311 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3746) took 1823 ms (client timeout 2069 ms). Trace:
W20260709 12:20:18.622224 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 58086.5us
W20260709 12:20:18.628859 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.629314 27315 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.635499 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:18.584192 27346 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:18.646045 27315 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:18.646698 27346 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:18.643249 20179 rpcz_store.cc:269] 0709 12:20:16.798969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.620095 (+1821126us) service_pool.cc:224] Handling call
0709 12:20:18.622471 (+  2376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.648948 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:18.649102 27315 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:18.645726 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:18.650743 20171 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:18.650861 27364 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:20:18.651330 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3754) took 1850 ms (client timeout 2078 ms). Trace:
I20260709 12:20:18.651484 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:18.651836 20171 rpcz_store.cc:269] 0709 12:20:16.800951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.645259 (+1844308us) service_pool.cc:224] Handling call
0709 12:20:18.651237 (+  5978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.653497 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:18.653633 20322 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:18.651912 27364 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.651897 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.656386 20323 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:20:18.657226 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48745.5us
I20260709 12:20:18.657608 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:18.649782 20179 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:18.632638 27369 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
W20260709 12:20:18.679339 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3747) took 1877 ms (client timeout 2098 ms). Trace:
W20260709 12:20:18.679816 20179 rpcz_store.cc:269] 0709 12:20:16.799168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.648532 (+1849364us) service_pool.cc:224] Handling call
0709 12:20:18.676056 (+ 27524us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:18.681396 20220 connection.cc:256] RPC call timeout handler was delayed by -1.1647716519998994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23420000000000002s for a response
W20260709 12:20:18.681965 20220 connection.cc:256] RPC call timeout handler was delayed by -1.0885435830000461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:20:18.686473 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1614) took 1469 ms. Trace:
I20260709 12:20:18.688031 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1571) took 3268 ms. Trace:
I20260709 12:20:18.688473 21036 rpcz_store.cc:276] 0709 12:20:15.419884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.420141 (+   257us) service_pool.cc:224] Handling call
0709 12:20:15.420550 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.314783 (+894233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.687427 (+2372644us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54004e9dd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:18.687786 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052144000}
I20260709 12:20:18.689165 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2367) took 2237 ms. Trace:
I20260709 12:20:18.692031 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.689662 20327 rpcz_store.cc:276] 0709 12:20:16.451161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.451285 (+   124us) service_pool.cc:224] Handling call
0709 12:20:16.451615 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.456926 (+  5311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.456964 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.460409 (+  3445us) log.cc:844] Serialized 26 byte log entry
0709 12:20:16.613838 (+153429us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:18.543412 (+1929574us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b180040b2e0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5dde8f03c7 00007f5ddaf029a7 00007f5ddaf120bf
0709 12:20:18.557473 (+ 14061us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.688287 (+130814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.688405 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.688509 (+   104us) raft_consensus.cc:1685] finished
0709 12:20:18.688604 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.688942 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8453,"prepare.queue_time_us":155132,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":12671,"raft.queue_time_us":7373,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":67009,"spinlock_wait_cycles":26755456,"thread_start_us":383113,"threads_started":3,"wal-append.queue_time_us":367774,"wal-append.run_cpu_time_us":7308,"wal-append.run_wall_time_us":1407241}
I20260709 12:20:18.693416 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:18.693961 21038 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:20:18.694332 20327 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:18.694764 27364 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:18.700284 20255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 3047) took 3294 ms (client timeout 1536 ms). Trace:
W20260709 12:20:18.700836 20255 rpcz_store.cc:269] 0709 12:20:15.405222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.406836 (+  1614us) service_pool.cc:224] Handling call
0709 12:20:18.699711 (+3292875us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400373a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:18.700011 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339142528}
I20260709 12:20:18.691440 27058 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:18.705655 27058 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:18.706355 27058 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:18.708027 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50731us
I20260709 12:20:18.700416 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3918) took 2687 ms. Trace:
I20260709 12:20:18.711735 20173 rpcz_store.cc:276] 0709 12:20:16.013388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.027215 (+ 13827us) service_pool.cc:224] Handling call
0709 12:20:16.127702 (+100487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:16.308515 (+180813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.699851 (+2391336us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001d24d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:18.700207 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346904448}
I20260709 12:20:18.713495 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:18.714597 20173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3744) took 1916 ms (client timeout 2342 ms). Trace:
I20260709 12:20:18.714951 27191 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:18.715633 27191 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.716109 27191 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:18.681135 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3749) took 1881 ms (client timeout 2157 ms). Trace:
W20260709 12:20:18.726382 20171 rpcz_store.cc:269] 0709 12:20:16.799621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.652817 (+1853196us) service_pool.cc:224] Handling call
0709 12:20:18.681038 (+ 28221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:18.715021 20173 rpcz_store.cc:269] 0709 12:20:16.798535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.712899 (+1914364us) service_pool.cc:224] Handling call
0709 12:20:18.714495 (+  1596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.730661 20173 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:18.732019 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.733871 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.731379 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3753) took 1930 ms. Trace:
I20260709 12:20:18.735023 20173 rpcz_store.cc:276] 0709 12:20:16.800647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.729553 (+1928906us) service_pool.cc:224] Handling call
0709 12:20:18.730109 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.731071 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.731303 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.735635 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.736548 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.737711 21037 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:18.739648 20219 connection.cc:256] RPC call timeout handler was delayed by -1.1606663810000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23420000000000002s for a response
I20260709 12:20:18.686935 20328 rpcz_store.cc:276] 0709 12:20:17.216497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.217160 (+   663us) service_pool.cc:224] Handling call
0709 12:20:17.217506 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.599448 (+381942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.599491 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:17.599551 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:17.599610 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.685925 (+1086315us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54003ad4d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:18.686001 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.686265 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877682944}
I20260709 12:20:18.741479 27163 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.736392 27388 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.064s	user 0.001s	sys 0.002s
I20260709 12:20:18.741912 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:18.744640 27163 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:18.745114 27251 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.742880 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 3063) took 2136 ms. Trace:
W20260709 12:20:18.743062 27121 consensus_queue.cc:1175] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e929b30888874ed59248f1229cecd3c6" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 7 } }
I20260709 12:20:18.742882 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:18.743259 27157 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.740801 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:18.752871 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.748490 20249 rpcz_store.cc:276] 0709 12:20:16.605968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.606094 (+   126us) service_pool.cc:224] Handling call
0709 12:20:16.606404 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.609176 (+  2772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.609216 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.609743 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.622226 (+2012483us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18002d7c60. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dede07 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa980d1 00007f5ddaeb3a0f
0709 12:20:18.670293 (+ 48067us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:18.671096 (+   803us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.687887 (+ 16791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.688013 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.742303 (+ 54290us) raft_consensus.cc:1685] finished
0709 12:20:18.742423 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.742617 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8688,"prepare.queue_time_us":174,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":22956,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":5919,"spinlock_wait_cycles":3029760,"thread_start_us":47632,"threads_started":1,"wal-append.queue_time_us":2061308}
I20260709 12:20:18.754220 20179 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 12:20:18.754812 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3755) took 1953 ms (client timeout 2169 ms). Trace:
I20260709 12:20:18.755524 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:18.756860 27157 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:18.759244 27278 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:18.763767 27277 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:18.764436 27277 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:18.765034 27277 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:18.755363 20179 rpcz_store.cc:269] 0709 12:20:16.801247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.719071 (+1917824us) service_pool.cc:224] Handling call
0709 12:20:18.754709 (+ 35638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:18.781716 27372 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:18.782665 27372 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:18.786481 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.774211 27367 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:18.787940 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:18.788122 27373 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.772316 27157 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:18.746096 27251 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:18.855091 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 79119.3us
I20260709 12:20:18.887674 20324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1618) took 1439 ms. Trace:
W20260709 12:20:18.903379 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.937727 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:18.887259 20173 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:20:19.521011 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.500452 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 759926us
I20260709 12:20:19.521875 21039 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:20:19.491676 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.892927 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.850800 21008 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.830s (SENT)
W20260709 12:20:18.886523 20175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3738) took 2089 ms (client timeout 1717 ms). Trace:
I20260709 12:20:19.523523 20324 rpcz_store.cc:276] 0709 12:20:17.448590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.610488 (+1161898us) service_pool.cc:224] Handling call
0709 12:20:18.611133 (+   645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.656977 (+ 45844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.657022 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.657770 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 12:20:18.673372 (+ 15602us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:18.673433 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.673532 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:18.887406 (+213874us) raft_consensus.cc:1685] finished
0709 12:20:18.887426 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:18.887586 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15653,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":41472,"thread_start_us":15092,"threads_started":1,"wal-append.queue_time_us":13959}
W20260709 12:20:18.822057 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.899087 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1845) took 1687 ms. Trace:
W20260709 12:20:18.845798 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.561s (SENT) [suppressed 38 similar messages]
I20260709 12:20:19.290019 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1609) took 2673 ms. Trace:
I20260709 12:20:19.032119 20247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1844) took 1826 ms. Trace:
W20260709 12:20:19.237880 27375 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.008s
W20260709 12:20:19.446413 27247 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.008s
W20260709 12:20:19.309990 27385 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.580s	user 0.003s	sys 0.000s
W20260709 12:20:19.188817 20180 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3750) took 2388 ms (client timeout 1837 ms). Trace:
W20260709 12:20:19.531347 20175 rpcz_store.cc:269] 0709 12:20:16.797219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.929513 (+132294us) service_pool.cc:224] Handling call
0709 12:20:18.886000 (+1956487us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001d2ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:18.886282 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636327296}
W20260709 12:20:19.546868 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.293200 27309 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 2.896s	user 0.007s	sys 0.022s
I20260709 12:20:18.848420 27303 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:19.036692 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:19.548048 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:19.354483 27330 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 1.075s	user 0.004s	sys 0.001s
I20260709 12:20:19.519322 27367 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:19.553956 20180 rpcz_store.cc:269] 0709 12:20:16.799897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.930545 (+130648us) service_pool.cc:224] Handling call
0709 12:20:19.188199 (+2257654us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001d1ad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:19.188516 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498770176}
I20260709 12:20:18.892850 27268 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.186928 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:19.554889 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.244928 27295 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 2.659s	user 0.007s	sys 0.021s
I20260709 12:20:18.948915 27174 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:18.820515 27163 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.541877 20325 rpcz_store.cc:276] 0709 12:20:16.616205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.616784 (+   579us) service_pool.cc:224] Handling call
0709 12:20:16.654542 (+ 37758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.391048 (+1736506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.284341 (+893293us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540015e0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:19.289791 (+  5450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3992075136}
I20260709 12:20:19.562060 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:19.562417 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.562834 27240 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.535326 20253 rpcz_store.cc:276] 0709 12:20:17.211632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.211805 (+   173us) service_pool.cc:224] Handling call
0709 12:20:17.212088 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.458559 (+246471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.898556 (+1439997us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54001ca054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:18.898902 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65822592}
I20260709 12:20:18.850354 27058 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:18.853705 27191 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.544978 27372 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:19.570644 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 719920us
I20260709 12:20:19.574715 27157 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:19.581914 27268 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:19.582629 27280 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:19.583000 27191 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.582911 27288 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:19.584947 20321 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:19.571041 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3742) took 2767 ms. Trace:
I20260709 12:20:19.583014 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1295) took 2950 ms. Trace:
I20260709 12:20:19.494271 27184 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:19.568074 20326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.005s	sys 0.048s
W20260709 12:20:19.601295 20326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.006s	sys 0.048s
I20260709 12:20:19.604878 27157 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:19.542402 20247 rpcz_store.cc:276] 0709 12:20:17.206006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.206185 (+   179us) service_pool.cc:224] Handling call
0709 12:20:17.206549 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:17.206784 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:17.351410 (+144626us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.030857 (+1679447us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b180035d400. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287
0709 12:20:19.031075 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.031172 (+    97us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:19.031262 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.031393 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.031867 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1105515,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":561324,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":17196,"spinlock_wait_cycles":59911552,"thread_start_us":1086816,"threads_started":3,"wal-append.queue_time_us":975221,"wal-append.run_cpu_time_us":1503,"wal-append.run_wall_time_us":1037534}
I20260709 12:20:19.596611 27280 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:19.558753 27303 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:19.609548 20219 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:19.609292 27303 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:19.609844 27164 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.610652 27263 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:19.610512 27164 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.611632 27285 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:19.611457 27263 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.613039 27164 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.597262 20171 rpcz_store.cc:276] 0709 12:20:16.798111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.749572 (+1951461us) service_pool.cc:224] Handling call
0709 12:20:18.761260 (+ 11688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.562329 (+801069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.565284 (+  2955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.565333 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:19.565379 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.565442 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.565563 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":781444,"raft.queue_time_us":794361,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4313}
I20260709 12:20:19.613812 27349 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:19.613963 27263 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.614293 27349 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.569384 27367 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:18.878737 27066 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.708s
I20260709 12:20:19.611469 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:19.554777 27375 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:19.604908 20250 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 11.
I20260709 12:20:19.585047 27251 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.557963 27247 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.614761 27349 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:19.611174 27163 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:20:19.619321 27157 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.668283 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.667392 20248 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:19.597800 20177 rpcz_store.cc:276] 0709 12:20:16.632362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.635867 (+  3505us) service_pool.cc:224] Handling call
0709 12:20:16.636168 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.696711 (+ 60543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.696747 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.763540 (+ 66793us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.073118 (+309578us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:17.101160 (+ 28042us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.464775 (+2363615us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b180036ab40. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:20:19.553817 (+ 89042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.569083 (+ 15266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.575451 (+  6368us) raft_consensus.cc:1685] finished
0709 12:20:19.582560 (+  7109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.582797 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54233,"prepare.queue_time_us":30271,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2431552,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":81579,"spinlock_wait_cycles":3789568,"thread_start_us":283911,"threads_started":1,"wal-append.queue_time_us":702434,"wal-append.run_cpu_time_us":3107,"wal-append.run_wall_time_us":1328237}
I20260709 12:20:19.623888 27058 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.669945 20325 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:19.615417 27311 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:19.680109 27257 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 12:20:19.684168 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.200s (SENT)
W20260709 12:20:19.687938 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 76655.2us
W20260709 12:20:19.667070 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 2.10823e+06us
W20260709 12:20:19.669503 27234 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.057s	sys 0.082s
I20260709 12:20:19.577553 27373 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.664654 27346 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:19.694619 27277 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.009s
W20260709 12:20:19.698014 27234 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.057s	sys 0.083s
W20260709 12:20:19.696569 27291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.008s	sys 0.012s
I20260709 12:20:19.707291 27157 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.711828 27157 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.712210 20324 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:19.713847 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:19.714960 27284 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:19.715324 27284 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:19.710994 27291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.010s	sys 0.013s
W20260709 12:20:19.707273 27376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.008s	sys 0.046s
I20260709 12:20:19.712211 27157 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.728056 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:19.675165 27184 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:19.715720 27284 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:19.738965 27311 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:19.740792 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73919.7us
I20260709 12:20:19.741469 27311 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.741537 27007 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:19.729003 27376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.008s	sys 0.046s
I20260709 12:20:19.709889 27277 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.757239 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.760133 20328 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 12:20:19.763381 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.762305 27334 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.764588 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.764665 27334 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.765333 20323 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:19.767217 27334 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.774912 20327 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:20:19.795863 20174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3756) took 2994 ms (client timeout 2050 ms). Trace:
I20260709 12:20:19.800782 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.791249 27356 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:19.803005 20174 rpcz_store.cc:269] 0709 12:20:16.801535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.223231 (+1421696us) service_pool.cc:224] Handling call
0709 12:20:19.791485 (+1568254us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54003e6554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:19.795781 (+  4296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871605632}
W20260709 12:20:19.808454 27391 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:19.809365 27356 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.812405 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:19.814673 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:19.815804 27240 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:19.816771 27399 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:19.820235 27373 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.821099 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.804733 20328 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:19.801954 20324 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:19.801165 27247 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.833000 20328 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:19.822127 27375 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:19.840827 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:19.867781 27268 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:19.840677 27312 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:19.924439 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.925531 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3758) took 3113 ms. Trace:
I20260709 12:20:19.830054 27163 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.831733 27311 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:19.869882 27229 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:19.925915 20173 rpcz_store.cc:276] 0709 12:20:16.805206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.738789 (+1933583us) service_pool.cc:224] Handling call
0709 12:20:18.886743 (+147954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.526742 (+639999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.868959 (+342217us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001d2ed0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:19.918891 (+ 49932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338910464}
W20260709 12:20:19.931847 27394 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.007s
I20260709 12:20:19.932153 27344 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.932271 27289 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:19.939312 27289 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:19.939713 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:19.941884 27289 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.932941 27096 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:19.942687 27096 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.944964 27096 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.933190 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1852) took 1028 ms. Trace:
I20260709 12:20:19.947733 20248 rpcz_store.cc:276] 0709 12:20:18.905288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.937209 (+ 31921us) service_pool.cc:224] Handling call
0709 12:20:19.933013 (+995804us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b540004c754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:19.933128 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184555264}
I20260709 12:20:19.937775 27334 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:19.949362 27334 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.950531 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.939203 27398 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.924993 27312 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.932921 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.933519 27277 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:19.959245 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 58939.7us
W20260709 12:20:19.969491 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.12367e+06us
I20260709 12:20:19.932925 27397 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.839183 27291 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 12:20:19.956390 27334 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:19.977051 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1850) took 1080 ms. Trace:
I20260709 12:20:19.974901 27289 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:19.978451 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.970263 27312 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:19.981882 20249 rpcz_store.cc:276] 0709 12:20:18.896681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.896895 (+   214us) service_pool.cc:224] Handling call
0709 12:20:18.897459 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.897968 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:19.510546 (+612578us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.976634 (+466088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:19.976704 (+    70us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:19.976759 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.976848 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.976990 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":621657,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":117,"raft.queue_time_us":4372,"thread_start_us":424263,"threads_started":1}
I20260709 12:20:19.980880 27096 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:19.989121 27313 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.989436 27096 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.989857 27313 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:19.998562 20323 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:19.982717 27163 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:20.020509 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.026707 20329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1619) took 1612 ms. Trace:
I20260709 12:20:19.976835 27229 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:20.037096 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.042508 27250 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.043426 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:20.035297 20220 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.724s (SENT)
I20260709 12:20:20.044996 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:20.046257 27392 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 12:20:20.046840 27130 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:20.047540 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1625) took 1403 ms. Trace:
I20260709 12:20:20.047459 27130 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.048012 20326 rpcz_store.cc:276] 0709 12:20:18.643804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.659623 (+ 15819us) service_pool.cc:224] Handling call
0709 12:20:18.743991 (+ 84368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.744743 (+   752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:18.744780 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:18.745492 (+   712us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.602068 (+856576us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:19.602156 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.602271 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.047284 (+445013us) raft_consensus.cc:1685] finished
0709 12:20:20.047316 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.047474 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3443,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12689,"thread_start_us":855833,"threads_started":1,"wal-append.queue_time_us":1079880}
I20260709 12:20:20.049732 27130 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.050288 27184 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.030128 20329 rpcz_store.cc:276] 0709 12:20:18.414578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.611132 (+196554us) service_pool.cc:224] Handling call
0709 12:20:18.612251 (+  1119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.612838 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:20:18.814569 (+201731us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.011033 (+1196464us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18003e6f20. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa9823a
0709 12:20:20.023308 (+ 12275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:20.023357 (+    49us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:20:20.026344 (+  2987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.026448 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.026628 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":950450,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":12768,"spinlock_wait_cycles":71078400,"thread_start_us":611965,"threads_started":2,"wal-append.queue_time_us":701566}
I20260709 12:20:20.043251 27250 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.054679 27313 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.996675 27344 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.059803 27096 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:19.988155 27247 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 12:20:20.032555 27400 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.123s	user 0.005s	sys 0.001s
I20260709 12:20:20.072835 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:20.073679 27291 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.985579 27398 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.078986 27398 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.079843 27174 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.080250 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50433.4us
I20260709 12:20:20.080446 27174 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:20.018054 27397 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:20.082902 20220 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.837s (SENT)
I20260709 12:20:20.082978 27174 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.085455 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.086103 20171 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:20.088771 27096 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.088722 20180 raft_consensus.cc:1217] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[11.8-16.11]   Dedup: 11.8->[12.9-16.11]
I20260709 12:20:20.089540 20180 pending_rounds.cc:85] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:20:20.089962 20180 pending_rounds.cc:107] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:20:20.089586 27096 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.090273 20180 raft_consensus.cc:2889] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:20.092007 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.092563 21007 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:20.093395 27341 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:20.093672 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:20.094118 27407 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:20.094585 27407 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.094920 27407 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.095561 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.096236 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.097795 27349 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.098579 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.099217 20175 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:20:20.102188 20219 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:20.103859 21039 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:20.105072 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.105731 20329 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:20.105929 27163 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.106690 27163 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:20.107079 27163 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.108105 27303 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.108160 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.109261 20326 raft_consensus.cc:2410] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:20:20.110018 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.111425 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.112715 20250 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 21: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:20.096280 20173 raft_consensus.cc:2376] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18. Re-sending same reply.
I20260709 12:20:20.113159 27229 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.115180 27397 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.117501 27308 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.118157 27308 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:20.120549 27308 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.127604 27398 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:20.106690 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:19.987891 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:20.137181 20324 raft_consensus.cc:606] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:20.107451 27163 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.142938 20321 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.166805 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.129583 27344 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.161716 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.180626 20176 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:20.181344 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1851) took 1284 ms. Trace:
I20260709 12:20:20.183015 20173 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17. Re-sending same reply.
I20260709 12:20:20.191068 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.128516 27356 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.167701 20329 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:20.094164 27341 consensus_queue.cc:1243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:20.198494 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.203619 27096 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:20.204263 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.808s (SENT)
I20260709 12:20:20.204813 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:20.206326 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:20.207355 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.207769 21040 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:20.208361 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:20.209766 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:20.154971 27174 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:20.212391 27174 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:20.212770 27174 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.213162 27174 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.184161 27157 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.216750 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.217366 20329 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 11.
I20260709 12:20:20.217648 27157 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.186609 20255 rpcz_store.cc:276] 0709 12:20:18.897067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.900824 (+  3757us) service_pool.cc:224] Handling call
0709 12:20:18.901280 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.901635 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:20:19.985628 (+1083993us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.180969 (+195341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:20.181027 (+    58us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:20.181085 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.181159 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.181285 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":636506,"prepare.queue_time_us":669784,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":563085,"threads_started":2}
I20260709 12:20:20.218425 27323 consensus_queue.cc:1059] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:20.218938 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.219518 27323 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:20.219799 20173 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:20.219980 27323 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:20.220381 27323 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.206270 27404 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:20.242475 20321 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:20.245141 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.248021 20176 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:20.256594 21043 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:20.251202 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 49627.5us
W20260709 12:20:20.241288 27393 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:20:20.222465 27334 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:20.238402 27251 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:20.275506 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.242044 27349 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.281428 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.283963 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.284849 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.286573 20179 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:20.287596 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.288822 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.290201 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.290937 20172 raft_consensus.cc:2410] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:20.275147 27312 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.291507 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.292172 20179 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
W20260709 12:20:20.292804 20172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3737) took 3498 ms (client timeout 1687 ms). Trace:
I20260709 12:20:20.292984 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.293557 20171 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:20.293671 20179 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.293182 27312 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:20.293248 20172 rpcz_store.cc:269] 0709 12:20:16.794251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.796334 (+  2083us) service_pool.cc:224] Handling call
0709 12:20:20.292573 (+3496239us) spinlock_profiling.cc:243] Waited 3.41 s on lock 0x7b54001d33d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:20.292725 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7842727168}
W20260709 12:20:20.296440 27401 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.355s	user 0.000s	sys 0.002s
I20260709 12:20:20.296446 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.299927 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.300253 20172 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.300740 20174 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:20.301679 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.302253 20174 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:20.302407 20179 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:20.303161 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.304801 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:20.309141 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.327486 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.328179 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.303268 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.329620 20179 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:20.312103 27073 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:20.313445 27367 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.002s
I20260709 12:20:20.314875 27354 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:20.317277 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 113055us
I20260709 12:20:20.318128 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.279191 27283 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:20:20.275759 27066 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:20:20.345572 27367 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.371971 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.373445 20251 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:20:20.373665 27367 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:20.374100 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:20.374481 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 291608us
I20260709 12:20:20.374763 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.375020 20248 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:20:20.375382 20256 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:20.375428 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:20.375946 20254 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:20.376052 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.241462 27344 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:20:20.376905 20256 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:20:20.377333 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:20.378566 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.326901 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:20:20.339094 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1294) took 3688 ms. Trace:
I20260709 12:20:20.339192 27280 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:20.342767 27407 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.402959 27280 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.403273 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.404284 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 27 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.404522 27407 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:20.404611 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.344832 27221 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:20.405226 20329 raft_consensus.cc:2410] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 27 because replica has last-logged OpId of term: 26 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 20.
I20260709 12:20:20.405341 20325 raft_consensus.cc:2376] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18. Re-sending same reply.
I20260709 12:20:20.406461 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.406857 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.407313 20321 raft_consensus.cc:2410] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:20:20.250892 27369 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:20.407469 20329 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:20.407872 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.408288 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.408516 20179 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:20.408883 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.408983 20325 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:20.409693 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:20.410292 20179 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.410382 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.410983 20329 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:20.407750 27369 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:20.412866 27369 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:20.413993 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.414640 21038 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:20.415213 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.415753 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.415915 21042 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:20.416375 21038 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:20.416828 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.417466 27066 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:20.417711 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.417879 27066 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:20.418704 21041 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:20.352711 20174 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:20:20.357136 21043 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:20.361176 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.368517 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:20.349004 27284 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.003s
I20260709 12:20:20.376214 20324 raft_consensus.cc:606] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:20.370925 27250 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.332710 20173 raft_consensus.cc:2376] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15. Re-sending same reply.
W20260709 12:20:20.338620 27395 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.646s	user 0.003s	sys 0.000s
I20260709 12:20:20.274377 27334 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:20.379237 20252 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:20.373560 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:20.382102 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.381994 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:20.375109 20220 connection.cc:256] RPC call timeout handler was delayed by -1.2868467309999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260709 12:20:20.382786 20172 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:20.381196 20178 rpcz_store.cc:276] 0709 12:20:16.632068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.632216 (+   148us) service_pool.cc:224] Handling call
0709 12:20:16.632517 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:16.835598 (+203081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:16.835634 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:16.884810 (+ 49176us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.202517 (+317707us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:17.203335 (+   818us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.746316 (+2542981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.307202 (+560886us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000a6c54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:20.307250 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.307321 (+    71us) raft_consensus.cc:1685] finished
0709 12:20:20.307421 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.320201 (+ 12780us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2296383,"prepare.queue_time_us":208,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":52,"raft.queue_time_us":2356779,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":10344,"spinlock_wait_cycles":431484288,"thread_start_us":440010,"threads_started":2,"wal-append.queue_time_us":1122543,"wal-append.run_cpu_time_us":3332,"wal-append.run_wall_time_us":1117377}
W20260709 12:20:20.390300 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.390125 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:20.391713 20177 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:20.400961 27283 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:20.401439 27354 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.401403 27257 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:20.402258 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.843s (SENT)
I20260709 12:20:20.376830 20248 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:20.414413 27369 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:20.421576 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 88027.4us
I20260709 12:20:20.503887 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:20.375615 20251 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:20.501890 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.422821 20175 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
W20260709 12:20:20.444460 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.444303 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.471800 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.442369 27284 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:20.424042 20324 raft_consensus.cc:614] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:20.440455 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:20.509618 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.510221 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.510634 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.511729 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.512669 20329 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:20:20.443810 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.513476 21040 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
W20260709 12:20:20.516744 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 259882us
I20260709 12:20:20.525523 20178 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:20.526981 20174 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:20:20.503543 20250 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:20.531749 20253 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:20:20.532873 20325 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:20.537475 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.510844 27334 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.533572 20249 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:20.541204 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:20.544523 27198 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:20.503871 27283 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:20.547892 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:20.548422 20326 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:20.548629 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:20.548964 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 339284us
I20260709 12:20:20.575448 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:20.549388 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.532894 27284 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:20.553511 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6576710110000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 12:20:20.556500 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 27 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.559655 27364 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:20.560886 27313 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.561506 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.563331 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.583777 27283 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.585350 27283 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:20.585677 27323 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.588150 20174 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:20.588587 20251 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
W20260709 12:20:20.589180 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.589413 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:20.589886 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.590462 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:20.592121 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:20.593181 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.593870 27349 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:20.594343 27349 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.594732 27349 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.418857 27066 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.596179 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:20.596359 27066 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.597388 27199 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.598718 27157 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:20.599167 27157 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.564180 27174 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.564697 20255 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:20.565796 21041 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
W20260709 12:20:20.576365 20144 connection.cc:256] RPC call timeout handler was delayed by -2.63427101100001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 12:20:20.600757 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6027710109999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:20:20.601327 20144 connection.cc:256] RPC call timeout handler was delayed by -2.0871507079998537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:20:20.601714 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9395507079998424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 12:20:20.601743 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:20.602169 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8423507079999126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 12:20:20.602598 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7208507079999436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:20:20.603005 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7208507079999436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:20:20.603370 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5705507079999279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 12:20:20.578123 20177 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:20.580597 20172 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:20.607116 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.610731 20329 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:20:20.611699 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.612313 20329 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:20.613883 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.614837 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.615033 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:20.616454 20219 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:20.627772 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:20.656656 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.662655 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.599538 27157 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.667066 20252 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 22.
I20260709 12:20:20.668601 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.606653 27325 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:20.679201 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 53628.7us
I20260709 12:20:20.679540 20248 raft_consensus.cc:2410] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 12:20:20.679436 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 277219us
I20260709 12:20:20.588616 27323 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.535591 27257 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.678818 27325 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.697227 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:20.760007 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.959s (SENT)
I20260709 12:20:20.864594 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.751689 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:20.864984 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1716) took 1037 ms. Trace:
I20260709 12:20:20.682641 20179 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
W20260709 12:20:20.709231 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 94966.7us
I20260709 12:20:20.687971 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.686820 20325 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 12:20:20.685629 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.874432 20328 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:20.865558 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:20.716655 20220 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.069s (SENT)
W20260709 12:20:20.776479 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.881975 20327 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:20.882529 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.883054 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.680637 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.685664 21040 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:20:20.871783 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.885259 20329 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:20.899248 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:20.618279 27251 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:20.697906 27199 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:20.907150 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:20.907971 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:20.625705 27313 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.908610 27310 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.916893 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:20.875851 21036 rpcz_store.cc:276] 0709 12:20:19.827815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.827974 (+   159us) service_pool.cc:224] Handling call
0709 12:20:19.836155 (+  8181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.962921 (+126766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.962969 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.985520 (+ 22551us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.244689 (+259169us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:20.665735 (+421046us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.864528 (+198793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.864638 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.864704 (+    66us) raft_consensus.cc:1685] finished
0709 12:20:20.864723 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.864905 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10480,"prepare.queue_time_us":6151,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":45581,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":6489,"spinlock_wait_cycles":721792,"thread_start_us":576406,"threads_started":2,"wal-append.queue_time_us":500676}
I20260709 12:20:20.910290 27199 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.916394 27404 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:20.904994 27250 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.924839 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 178097us
W20260709 12:20:20.909610 27280 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.002s
I20260709 12:20:20.925434 20174 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:20.924602 27404 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.929750 27404 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.929891 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:20.930207 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:20.906759 27251 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.942031 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:20.917619 20321 raft_consensus.cc:606] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:20.942937 20253 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 12:20:20.929919 21008 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.970s (SENT)
I20260709 12:20:20.940349 20251 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:20.947655 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.949949 21008 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:20.917024 27323 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:20.925442 27199 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.948915 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:20.956391 20256 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.953001 20249 pending_rounds.cc:85] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 13
I20260709 12:20:20.959077 20249 pending_rounds.cc:107] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:20:20.959344 20249 raft_consensus.cc:2889] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:20.961786 20077 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 209) took 26319 ms (client timeout 15000 ms). Trace:
I20260709 12:20:20.944942 27251 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:20.954777 27303 consensus_meta.cc:287] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.846s	user 0.006s	sys 0.012s
I20260709 12:20:20.945432 27344 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:20.965198 20294 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.536s (SENT)
I20260709 12:20:20.967944 27325 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:20.968883 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:20.960183 27250 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:20.955885 27310 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:20.976909 20177 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:21.106827 21042 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 12:20:21.045619 27416 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:20:20.997560 27325 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:20.974895 27344 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:21.005586 27163 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.004s
I20260709 12:20:21.005384 20172 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:20:20.965401 27174 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.032419 21040 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 12:20:21.080892 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 151035us
W20260709 12:20:21.045779 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.004856 20252 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:21.150089 20172 pending_rounds.cc:85] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 11
I20260709 12:20:21.106204 27157 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:20.987251 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.031369 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.038956 27425 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:20:21.045849 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.051916 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.157260 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.158052 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 129738us
I20260709 12:20:21.159466 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.160195 27312 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:21.160569 27399 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:21.161155 27399 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:21.161675 27399 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:21.057365 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.162606 21043 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.032227 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.962770 27354 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:20.975657 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 359262us
I20260709 12:20:21.164367 20219 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:20.975831 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 259238us
I20260709 12:20:21.030402 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.038023 27419 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:20:21.165508 20220 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.078s (SENT)
W20260709 12:20:21.115423 27421 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:21.115945 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.165978 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.166783 27426 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:21.166913 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.080369 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.167659 21038 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
W20260709 12:20:21.168040 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.168704 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.164507 27312 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:20:21.169866 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.171005 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:20.974581 27323 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.171752 27417 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.173243 27323 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.019876 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:21.173794 27399 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.158675 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:21.176491 20220 leader_election.cc:336] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.098s (SENT)
I20260709 12:20:21.177006 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:21.176954 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.177872 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.143181 20256 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:20:20.972265 27252 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:21.153400 20172 pending_rounds.cc:107] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:20:21.182070 20172 raft_consensus.cc:2889] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:21.184666 27417 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.158133 27280 raft_consensus.cc:2764] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:20:21.164507 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:21.079918 27221 consensus_meta.cc:287] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 12:20:21.185786 27280 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.186530 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.187501 27280 raft_consensus.cc:2764] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:20:21.167486 27426 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:21.178303 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:21.192494 27426 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:21.194381 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.036966 27250 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:21.040112 27369 consensus_meta.cc:287] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
W20260709 12:20:21.041960 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.178740 21038 raft_consensus.cc:2393] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 21: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:21.180375 27323 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.080013 27349 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:21.149932 27334 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:20:21.203289 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.147944 27313 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.207489 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:21.209685 21043 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:21.213496 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.196996 27257 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:21.222796 20220 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.169s (SENT)
I20260709 12:20:21.231863 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.213030 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.206956 27312 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:21.235656 20330 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 10.
I20260709 12:20:21.153862 27163 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:21.222796 27424 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:20:21.237396 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:21.245906 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.246587 21040 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:21.243350 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.232880 27369 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:21.250800 21040 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:21.250989 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1718) took 1110 ms. Trace:
W20260709 12:20:20.962247 20077 rpcz_store.cc:269] 0709 12:19:54.702315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.703777 (+  1462us) service_pool.cc:224] Handling call
0709 12:20:20.947989 (+26244212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:14.324169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:14.324722 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:14.324763 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:20:14.324779 (+    16us) tablet.cc:662] Decoding operations
0709 12:20:14.325419 (+   640us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:14.325480 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:14.325506 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:20:14.326065 (+   559us) tablet.cc:701] Row locks acquired
0709 12:20:14.326089 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:20:14.326278 (+   189us) write_op.cc:270] Start()
0709 12:20:14.326445 (+   167us) write_op.cc:276] Timestamp: P: 1783599614326193 usec, L: 0
0709 12:20:14.326475 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:20:14.381349 (+ 54874us) log.cc:844] Serialized 2065 byte log entry
0709 12:20:14.993326 (+611977us) op_driver.cc:464] REPLICATION: finished
0709 12:20:15.262708 (+269382us) write_op.cc:301] APPLY: starting
0709 12:20:15.296641 (+ 33933us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:15.329612 (+ 32971us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:15.329718 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:15.388862 (+ 59144us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:15.389122 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:20:15.389164 (+    42us) write_op.cc:312] APPLY: finished
0709 12:20:15.389422 (+   258us) log.cc:844] Serialized 57 byte log entry
0709 12:20:15.389603 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:15.389723 (+   120us) write_op.cc:454] Released schema lock
0709 12:20:15.389778 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:15.390250 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:15.390280 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":644245,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":256884,"apply.run_cpu_time_us":9125,"apply.run_wall_time_us":127539,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":148574,"prepare.run_cpu_time_us":51682,"prepare.run_wall_time_us":239232,"raft.queue_time_us":241404,"raft.run_cpu_time_us":41183,"raft.run_wall_time_us":190116,"replication_time_us":638945,"thread_start_us":407952,"threads_started":4,"wal-append.queue_time_us":259812,"wal-append.run_cpu_time_us":9752,"wal-append.run_wall_time_us":1804745}]]}
I20260709 12:20:21.249997 27399 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.252151 27369 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.258486 27369 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.235710 27312 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.261613 20247 raft_consensus.cc:1240] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:20:21.236692 27323 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:21.230396 27417 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:20:21.264043 20220 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.950s (SENT)
I20260709 12:20:21.264866 27349 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.261451 27399 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:21.215386 27334 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.215237 27174 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:20:21.256804 21039 rpcz_store.cc:276] 0709 12:20:20.136571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.143922 (+  7351us) service_pool.cc:224] Handling call
0709 12:20:20.160601 (+ 16679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.160850 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.160875 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.202930 (+ 42055us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.565095 (+362165us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:20.565134 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.565204 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.246737 (+681533us) raft_consensus.cc:1685] finished
0709 12:20:21.246771 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.246954 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":361687,"threads_started":1,"wal-append.queue_time_us":716860}
W20260709 12:20:21.275122 20250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.020s	sys 0.015s
I20260709 12:20:21.285377 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.288465 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 380561us
I20260709 12:20:21.243830 27313 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:20:21.249886 27404 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:21.288516 20250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.020s	sys 0.015s
I20260709 12:20:21.292064 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.269068 27312 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.293124 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.301683 21038 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:21.301990 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.287919 27364 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.304579 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.298516 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.286334 27303 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:21.306407 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.308056 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.320259 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.320441 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56444.1us
I20260709 12:20:21.265607 27252 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:20:21.324498 21039 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:21.319324 27227 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.326144 27257 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:21.327749 27364 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.328285 27257 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.329067 21037 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:21.330050 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:21.332214 27429 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:20:21.327914 27227 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.303849 27221 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:21.335148 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1311) took 1049 ms. Trace:
W20260709 12:20:21.342186 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.347949 21037 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:21.349608 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.298480 27250 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:20:21.335829 20171 rpcz_store.cc:276] 0709 12:20:20.285631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.512758 (+227127us) service_pool.cc:224] Handling call
0709 12:20:20.574262 (+ 61504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.694461 (+120199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.694501 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.695151 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.971088 (+275937us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:20:21.001981 (+ 30893us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.002238 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.002329 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.334913 (+332584us) raft_consensus.cc:1685] finished
0709 12:20:21.334935 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.335086 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67830,"prepare.queue_time_us":33849,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":70877,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":9579,"thread_start_us":275489,"threads_started":1,"wal-append.queue_time_us":507625}
I20260709 12:20:21.361344 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:21.362996 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.365097 27364 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:21.351183 27174 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:21.348126 27221 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:21.397753 20327 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
W20260709 12:20:21.381664 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.398229 20327 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:21.305229 27199 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:21.407017 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.365170 27404 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:21.400115 27427 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:20:21.373714 27174 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:21.401022 27221 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.396551 27313 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.433092 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3933) took 1347 ms. Trace:
I20260709 12:20:21.403095 27432 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:21.431593 27344 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:21.450237 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 172854us
I20260709 12:20:21.435880 20180 rpcz_store.cc:276] 0709 12:20:20.085347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.087899 (+  2552us) service_pool.cc:224] Handling call
0709 12:20:20.088313 (+   414us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:20:20.091017 (+  2704us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:20.423025 (+332008us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.848433 (+425408us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:20.881411 (+ 32978us) log.cc:844] Serialized 78 byte log entry
0709 12:20:20.881616 (+   205us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:20.881661 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.881767 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.431977 (+550210us) raft_consensus.cc:1685] finished
0709 12:20:21.432002 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.433007 (+  1005us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253973,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":13152,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":14618,"thread_start_us":643053,"threads_started":2,"wal-append.queue_time_us":511072}
W20260709 12:20:21.454852 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 127771us
W20260709 12:20:21.463634 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 90497.1us
I20260709 12:20:21.438984 27432 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:21.446652 27066 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.006s
I20260709 12:20:21.439916 27325 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:21.440930 27404 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:21.475483 27404 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:21.475394 27174 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.476989 27174 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:21.476619 27404 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.478086 27404 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.437659 27250 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:20:21.479765 27433 log.cc:927] Time spent T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:20:21.481379 27250 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:21.481978 27250 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:21.471361 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.470310 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.484542 21035 raft_consensus.cc:2410] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 12:20:21.474095 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 236763us
I20260709 12:20:21.441243 27313 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.487046 27312 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.468189 27432 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.489195 27312 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.469053 27344 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.491875 27434 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:21.492560 27434 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:21.492280 27344 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.493564 27434 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.494554 27344 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.496779 27199 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.469970 27163 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.483999 27157 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.489041 27313 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.483301 27250 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.490119 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1310) took 1204 ms. Trace:
I20260709 12:20:21.505772 27250 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:21.505695 20173 rpcz_store.cc:276] 0709 12:20:20.285331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.500971 (+215640us) service_pool.cc:224] Handling call
0709 12:20:20.535497 (+ 34526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.599971 (+ 64474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.600006 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.612815 (+ 12809us) log.cc:844] Serialized 26 byte log entry
0709 12:20:21.040216 (+427401us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:21.040277 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.040375 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.489928 (+449553us) raft_consensus.cc:1685] finished
0709 12:20:21.489948 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.490059 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90791,"raft.queue_time_us":57630,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11415,"thread_start_us":353685,"threads_started":1,"wal-append.queue_time_us":618847}
W20260709 12:20:21.511924 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.516872 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45537us
I20260709 12:20:21.520787 21007 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:21.521416 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.523689 27354 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:21.525723 27313 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:20:21.527084 27066 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:21.527661 27364 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:21.528231 27252 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:21.523766 27442 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.484221 27334 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.533545 20249 raft_consensus.cc:1217] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 17.13->[19.14-21.15]   Dedup: 21.15->[]
I20260709 12:20:21.537556 20249 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
W20260709 12:20:21.538645 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72447.2us
I20260709 12:20:21.539896 20219 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:21.541955 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.505s (SENT)
I20260709 12:20:21.542623 21008 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.540885 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.545848 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.502727 27369 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:21.546322 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.547622 20249 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:20:21.537238 27283 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.949s	user 0.007s	sys 0.009s
I20260709 12:20:21.546663 27440 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:21.559223 27440 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:21.559724 27440 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:21.548868 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.546754 27312 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:21.541922 27364 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:21.541857 27313 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:21.546973 27066 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:21.555294 27310 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.552461 27372 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:21.573645 27066 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:21.580665 27438 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:21.562716 27325 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.581506 27066 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.582739 27066 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:21.575299 20249 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:21.574780 27364 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.568055 21036 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.569486 27417 raft_consensus.cc:2804] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:21.579895 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:21.579924 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.547068 27442 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.569850 27280 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:21.569952 27313 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.601862 27313 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:21.603068 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1640) took 1054 ms. Trace:
I20260709 12:20:21.603461 20326 rpcz_store.cc:276] 0709 12:20:20.549101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.902885 (+353784us) service_pool.cc:224] Handling call
0709 12:20:20.910896 (+  8011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.058076 (+147180us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:21.140997 (+ 82921us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.467539 (+326542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:21.467647 (+   108us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:21.467769 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.602834 (+135065us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003acfd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:21.602888 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.603007 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10912,"prepare.queue_time_us":43920,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":65774,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":312270592,"thread_start_us":256750,"threads_started":2,"wal-append.queue_time_us":422127}
W20260709 12:20:21.605861 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2368) took 5154 ms (client timeout 1677 ms). Trace:
I20260709 12:20:21.591974 20248 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:21.591771 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:21.592279 20171 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:21.567544 27312 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.594038 27449 raft_consensus.cc:993] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:21.594072 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.594323 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.562510 27227 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:21.614401 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:21.596895 27417 raft_consensus.cc:697] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:21.598886 27442 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.562145 27221 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:21.606299 20330 rpcz_store.cc:269] 0709 12:20:16.451529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.451705 (+   176us) service_pool.cc:224] Handling call
0709 12:20:21.600913 (+5149208us) spinlock_profiling.cc:243] Waited 4.73 s on lock 0x7b5400328554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:21.605753 (+  4840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10887889664}
I20260709 12:20:21.578591 27283 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:21.609413 27438 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:21.612815 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.628772 20249 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:21.609166 27312 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.605783 27369 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.617949 20171 raft_consensus.cc:2368] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20.
I20260709 12:20:21.599824 27280 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.620164 27417 consensus_queue.cc:237] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.617772 27450 raft_consensus.cc:1081] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:21.621243 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.648187 20177 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:21.622217 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.622679 27372 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:21.624109 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53438 (request call id 2269) took 1078 ms. Trace:
W20260709 12:20:21.630956 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.632052 21041 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
W20260709 12:20:21.635928 27251 consensus_meta.cc:287] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:20:21.637279 27354 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:21.637758 27449 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:21.639770 27438 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:21.658902 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 136803us
I20260709 12:20:21.669636 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.647027 27227 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:21.659056 20250 rpcz_store.cc:276] 0709 12:20:20.545445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.578615 (+ 33170us) service_pool.cc:224] Handling call
0709 12:20:20.667050 (+ 88435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.707950 (+ 40900us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:21.292131 (+584181us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.532640 (+240509us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:21.551600 (+ 18960us) log.cc:844] Serialized 26 byte log entry
0709 12:20:21.551766 (+   166us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:21.551800 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.551936 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.623827 (+ 71891us) raft_consensus.cc:1685] finished
0709 12:20:21.623859 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.624035 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":657685,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":117065,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":13330,"thread_start_us":809785,"threads_started":3,"wal-append.queue_time_us":269588}
I20260709 12:20:21.670356 20177 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
W20260709 12:20:21.670293 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 130406us
I20260709 12:20:21.673727 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:21.647382 27280 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:21.663435 27372 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:21.682144 27426 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:21.682704 27426 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.685843 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:21.687115 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 150105us
I20260709 12:20:21.675153 27369 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.686455 20249 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:21.690754 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.671589 27251 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.688817 27434 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:20:21.712563 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.708072 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.704576 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:21.716491 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.676052 27227 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.718897 20173 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:21.680114 27364 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:20:21.722174 20254 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:21.681483 27313 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.677420 27449 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.730218 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.733325 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.732059 27432 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.734663 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.735903 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:21.737071 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.737923 20174 raft_consensus.cc:2410] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:21.738762 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.708531 27349 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:21.739801 27349 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:21.740125 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.740936 20252 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:21.740774 27349 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:21.741847 27349 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.742151 20252 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:20:21.742502 20252 pending_rounds.cc:85] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 11
I20260709 12:20:21.742760 20252 pending_rounds.cc:107] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:20:21.742993 20252 raft_consensus.cc:2889] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:21.743752 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.733165 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.745424 20172 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:21.733639 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.698558 27369 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.745954 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.768224 20253 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:21.769101 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:21.769338 27369 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.769574 21038 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:21.769918 20253 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:21.770813 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:21.771514 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:21.764106 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.749070 20248 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:21.751345 20171 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 10: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:21.763410 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.776536 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.777354 20253 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:21.764577 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.764927 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:21.765641 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.777640 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:21.724151 27434 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:21.724038 27452 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.764220 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:21.782313 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.787077 20249 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:21.787547 20252 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:21.796482 20324 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:21.796948 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:21.797706 20327 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:21.798318 20329 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:20:21.796648 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.804227 21038 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:20:21.805328 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.749511 27432 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:21.764955 27227 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.809309 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.807117 20330 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:21.809643 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:21.817090 20251 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
W20260709 12:20:21.807338 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 106981us
I20260709 12:20:21.809077 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.820029 20253 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:21.820497 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:21.821997 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.822413 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.823523 20249 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:21.824433 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.825140 20253 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:21.827447 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:21.828441 20252 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:21.830487 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:21.831296 20327 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:21.832441 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:21.836522 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.836925 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:21.837157 21035 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.836582 21038 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:20:21.839994 20329 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:21.844621 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:21.845208 21040 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:21.845712 27313 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.846557 27434 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.853750 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.854444 20251 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:21.859598 21035 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:21.859874 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.860702 20255 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:21.863138 21040 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
W20260709 12:20:21.864913 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.865105 27251 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.820091 27364 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:20:21.871318 20220 connection.cc:256] RPC call timeout handler was delayed by -1.7194470140000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3292s for a response
W20260709 12:20:21.873988 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.871948 20220 leader_election.cc:336] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.528s (SENT)
I20260709 12:20:21.872370 27280 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:21.875259 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:21.879351 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.611s (SENT)
I20260709 12:20:21.879824 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.880573 27280 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.881098 27323 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:21.881913 27323 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:21.795687 27452 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:21.883980 20220 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.630s (SENT)
W20260709 12:20:21.884166 27436 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.306s	user 0.004s	sys 0.001s
I20260709 12:20:21.884462 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.885437 27323 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:21.885708 27452 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:21.886019 27257 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:21.886711 20220 connection.cc:256] RPC call timeout handler was delayed by -1.5780462570000964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:20:21.887411 20220 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.028s (SENT)
I20260709 12:20:21.872529 27312 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:21.888568 20220 leader_election.cc:336] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.148s (SENT)
I20260709 12:20:21.888724 20177 raft_consensus.cc:2368] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16.
I20260709 12:20:21.888965 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:21.889715 27323 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:21.890780 20250 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:21.892050 21037 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
W20260709 12:20:21.872936 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 197911us
W20260709 12:20:21.871131 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 43811us
I20260709 12:20:21.990520 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:21.873140 27454 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:21.992187 27454 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:21.910312 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.993939 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:21.910421 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:21.910758 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:21.871632 27364 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:21.993157 27426 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.874126 27221 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:21.900082 27452 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:21.900290 27440 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.000516 27452 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.001673 27440 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:21.934787 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46228.7us
I20260709 12:20:22.002760 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:22.003242 27452 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.914084 27449 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:21.957077 27469 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:21.960742 27312 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:21.969286 20247 raft_consensus.cc:1240] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:21.972277 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:21.995803 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 85112.6us
I20260709 12:20:21.995843 20249 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:22.003592 27354 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:21.935670 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.004276 27364 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.014779 27364 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:22.015955 27354 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:22.018639 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.020354 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:22.020872 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 110572us
I20260709 12:20:21.996951 27426 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:22.023952 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:22.017179 27470 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:22.026086 27426 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:22.026943 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:22.027102 27426 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:22.033012 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60846.5us
I20260709 12:20:22.033012 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.033215 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.035938 27432 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:22.054709 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.057257 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.059916 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.060388 20254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1864) took 1133 ms. Trace:
W20260709 12:20:22.060796 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 158880us
I20260709 12:20:22.061738 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.062709 27454 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:22.063072 20249 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:22.060849 20254 rpcz_store.cc:276] 0709 12:20:20.926515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.926634 (+   119us) service_pool.cc:224] Handling call
0709 12:20:20.946448 (+ 19814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.732257 (+785809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.060130 (+327873us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54002fc954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:22.060327 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779774208}
W20260709 12:20:22.064550 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61105.7us
I20260709 12:20:22.036403 27432 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.054983 27313 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:22.063123 27454 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.063470 27221 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:20:22.036244 27303 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:22.073506 20324 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:22.034716 27312 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:22.063201 27399 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:22.023155 27372 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.092494 20325 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:22.088536 27303 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.073834 27432 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:22.094193 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.096391 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.034752 27280 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:20:22.041249 27440 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:20:22.094183 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.067760 27439 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:22.104271 20249 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:22.083489 27454 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:22.114542 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.115319 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.100207 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.109138 20328 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:22.109344 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:22.031790 27354 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:22.113737 20220 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.201s (SENT)
I20260709 12:20:22.099251 27399 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.103376 27303 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:22.115947 20171 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:22.145464 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.115725 27439 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.113078 27312 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:22.149312 20180 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:22.153528 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:22.097445 27313 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.155920 20173 raft_consensus.cc:2393] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:22.157549 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:22.156316 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45094.7us
I20260709 12:20:22.158836 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.160851 27438 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:22.161345 27438 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.162534 20330 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:20:22.163923 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.164378 27438 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.129951 27399 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:22.168371 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.169390 20179 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:22.164638 20330 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:22.172130 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.147315 27221 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:20:22.182322 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82229.4us
I20260709 12:20:22.115002 27449 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:20:22.185156 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.185709 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.187638 20172 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:22.188171 20175 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:22.188391 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.155054 27440 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:22.189023 20178 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 10.
W20260709 12:20:22.194468 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84916.5us
I20260709 12:20:22.154848 27312 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.168311 27481 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:22.155654 27439 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:22.199375 20220 connection.cc:256] RPC call timeout handler was delayed by -1.4524404280000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:20:22.199959 20220 connection.cc:256] RPC call timeout handler was delayed by -1.3219801080001616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 12:20:22.200416 20220 connection.cc:256] RPC call timeout handler was delayed by -1.1545801080001183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.233s for a response
I20260709 12:20:22.202196 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:22.204772 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:22.206959 27480 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:20:22.209165 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.211908 27257 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:22.198741 27481 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:22.214213 27481 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.215672 27481 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:22.217264 27469 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:20:22.217613 27313 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.218318 27313 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:22.218683 27313 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.219065 27313 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:22.221617 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.235495 20324 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:22.236325 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.245067 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.184613 27221 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:22.236210 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:22.249884 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.248339 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.196640 27440 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.252883 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:22.198386 27312 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:22.255748 20172 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:22.197943 27280 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.259784 20330 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:22.265340 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.262307 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.267124 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:22.267884 20179 raft_consensus.cc:2393] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:22.265448 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.195209 27473 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 12:20:22.216545 27439 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.250819 20178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:22.276700 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.254451 27221 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:22.279955 20321 raft_consensus.cc:2393] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:22.278405 20178 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:22.280630 20178 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:22.280954 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 120441us
I20260709 12:20:22.282533 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.263664 27440 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.283162 20324 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:22.284008 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 98948.1us
I20260709 12:20:22.248632 27283 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:20:22.288372 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.289026 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.289199 20321 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:22.291451 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.293608 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.296330 20321 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:20:22.293989 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 205839us
I20260709 12:20:22.299226 20172 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:20:22.266767 27349 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:20:22.311203 27349 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:22.311574 27349 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:22.312463 27349 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.313771 27349 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.280421 27310 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:20:22.316437 27310 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:22.316814 27310 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:22.317657 27310 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:22.320227 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.272887 27280 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.322722 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1585) took 1193 ms. Trace:
I20260709 12:20:22.323336 21041 rpcz_store.cc:276] 0709 12:20:21.116879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.177588 (+ 60709us) service_pool.cc:224] Handling call
0709 12:20:22.310167 (+1132579us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400662454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:22.310317 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878196992}
I20260709 12:20:22.325876 27313 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.322119 27404 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:22.335840 27251 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.336787 27251 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:22.319702 27417 consensus_queue.cc:1175] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 17 status { last_received { term: 16 index: 11 } last_committed_idx: 11 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:22.339272 27251 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.331849 27484 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:22.345719 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.346289 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:22.345674 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83405.8us
W20260709 12:20:22.347937 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 43586.6us
I20260709 12:20:22.349203 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:22.352442 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:22.322793 27372 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.364494 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.361385 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:22.360194 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 58593.6us
I20260709 12:20:22.331943 27434 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:22.370008 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:22.371762 27417 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:22.372519 27417 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:22.374046 27312 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.375576 20176 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:22.375715 27310 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:22.379168 27312 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.380533 27227 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:22.381175 27465 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:22.381242 27312 consensus_queue.cc:1059] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:22.383708 27473 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:22.385203 27473 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:22.385627 27473 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:22.389433 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.390137 21037 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:22.379770 27499 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:22.380213 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.393031 27499 raft_consensus.cc:3055] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:22.393411 27499 raft_consensus.cc:740] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:22.393334 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.394443 27499 consensus_queue.cc:260] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.395768 27449 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:22.396168 27449 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:22.396543 27449 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.399384 27439 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.400136 27439 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:22.397478 27250 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:22.400534 27439 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:22.395193 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.401464 27469 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:22.402032 27469 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:22.401645 27439 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:22.403079 27439 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.402993 27469 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.407861 27257 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:22.408207 27313 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.408870 27257 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:22.409215 27257 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:22.410130 27465 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.410001 27257 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.410630 27465 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.348542 27484 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.386737 27473 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.412879 27473 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:22.417520 27465 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.417083 27250 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.420696 27364 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:22.420827 20178 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.421424 27364 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:22.422868 20178 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:22.423715 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52650.9us
W20260709 12:20:22.424738 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54848.6us
I20260709 12:20:22.411816 27484 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:22.426883 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:22.433988 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.426828 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:22.432684 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:22.438473 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:22.441069 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 97013.5us
I20260709 12:20:22.443305 20324 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:22.422446 27364 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.451911 27364 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:22.454705 27323 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:22.444301 27426 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:22.456446 27426 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.456840 27426 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:22.448979 27251 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:22.431798 27250 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:22.435057 27257 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:22.439877 27372 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:22.478036 20252 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:22.481328 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.480675 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.435141 27465 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:20:22.514134 20219 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:22.515552 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.515795 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:22.516111 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.516280 21040 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:22.517066 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.517351 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:22.477370 27494 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:22.517948 21034 raft_consensus.cc:2376] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23. Re-sending same reply.
I20260709 12:20:22.518561 27494 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.519022 27494 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:22.517359 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.520901 21039 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:22.515452 20247 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:22.518213 27280 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.530144 27323 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:22.530609 27323 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.530967 27323 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:22.533095 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:22.534792 21035 raft_consensus.cc:2410] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:20:22.482527 27372 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:22.537926 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:22.540371 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.542377 21038 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:20:22.542717 21038 pending_rounds.cc:85] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 13
I20260709 12:20:22.542929 21038 pending_rounds.cc:107] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:20:22.543200 21038 raft_consensus.cc:2889] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:22.543749 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:22.544899 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:22.545933 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.546622 21037 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:22.547323 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.548079 21036 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:22.548689 27364 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:22.549105 27364 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:22.549141 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.549537 27364 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.549880 21042 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:22.550691 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.550557 27484 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.551802 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.551666 27465 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:22.552229 21040 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:22.552704 27465 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:22.553083 27465 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:22.554035 27465 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.555517 27465 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:22.557706 27364 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.534566 27417 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:22.560237 27364 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.560036 27417 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.562163 27417 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.562266 27440 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.564281 27221 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.565790 27484 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.565989 27449 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.567198 27303 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.568347 20174 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:22.570097 27303 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.570150 27251 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:22.580691 27399 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.582902 27399 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.583912 27434 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.584455 27434 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:22.586720 21038 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:22.588424 27372 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.592001 20180 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:22.591998 20324 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:22.593389 20294 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:22.594949 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 241899us
W20260709 12:20:22.603170 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 58339.1us
I20260709 12:20:22.609556 27364 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:22.619747 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:22.596699 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:22.627388 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:22.629182 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:22.629935 20323 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.602629 27438 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.625059 27432 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.006s
I20260709 12:20:22.614348 27417 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:22.652108 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48156.5us
I20260709 12:20:22.634393 27251 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:22.657750 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:22.612597 27465 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:20:22.638368 27303 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:22.605125 27426 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.666592 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:22.639890 27484 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:20:22.643138 27280 consensus_queue.cc:1059] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:20:22.680606 27426 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:22.666062 27303 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.645812 27438 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:20:22.673101 27454 consensus_meta.cc:287] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.005s
I20260709 12:20:22.668551 27221 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.706169 27494 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.696419 27434 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.647593 27432 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.712224 27434 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:22.695844 27303 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:22.713573 27432 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:22.714681 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.717718 27474 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.509s	user 0.000s	sys 0.003s
I20260709 12:20:22.720604 20328 raft_consensus.cc:2368] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:22.721884 27440 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.655918 27417 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.722653 27454 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.723107 27250 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:22.723766 27283 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:22.724206 27283 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:22.724411 27417 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.725093 27283 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.726892 27283 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:22.733104 27438 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:22.734325 27449 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:22.739223 20323 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:22.689240 27496 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:22.753374 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 160058us
W20260709 12:20:22.767127 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.801888 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.786036 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:22.754377 27481 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:22.746485 27502 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:20:22.831496 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 45533.9us
I20260709 12:20:22.835256 20294 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:22.841179 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.841800 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.829924 27489 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.854295 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 193605us
W20260709 12:20:22.858577 20220 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.690s (SENT)
I20260709 12:20:22.834591 27449 raft_consensus.cc:2764] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:20:22.834877 27502 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:22.840878 27323 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.888808 20174 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:22.868610 27434 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:22.894272 20173 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:22.894317 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:22.899259 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.899276 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.900786 20255 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:22.900691 20256 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:22.900089 20174 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:22.871021 27502 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:22.902129 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:22.905400 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.906251 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.908595 20253 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 9.
I20260709 12:20:22.907073 20329 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:22.909467 20326 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:22.911504 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.912281 20251 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:22.899324 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.918376 20254 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 15: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:22.918210 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:22.917127 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:22.919090 20175 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.919196 20174 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:22.920234 20173 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:22.924914 20180 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:22.894915 27280 consensus_queue.cc:1243] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:20:22.861764 27489 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:22.956084 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.958297 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.959507 20249 raft_consensus.cc:2410] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:22.923892 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:22.960958 20179 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:22.882475 27496 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:20:22.964610 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:22.972107 20254 raft_consensus.cc:2393] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 12: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:22.966641 21041 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:22.967512 27434 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:22.968407 27469 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:20:22.969528 27515 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:20:22.970089 27506 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:20:22.980748 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:22.978796 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:22.982023 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.942174 27325 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:22.903053 27449 consensus_queue.cc:1059] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:20:22.943171 27484 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.920315 27494 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:22.949368 27473 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:22.985143 20254 raft_consensus.cc:2410] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:22.987325 20178 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:22.992331 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:22.995088 20249 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:22.998641 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:22.999468 20254 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:22.999366 27473 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:23.000310 27507 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.266s	user 0.003s	sys 0.000s
I20260709 12:20:22.984974 27417 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.000491 27473 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.001183 27417 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.003118 27449 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:23.003654 20256 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:22.988777 27470 consensus_queue.cc:1059] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:20:23.006129 27470 raft_consensus.cc:3055] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:22.998824 27323 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:23.013253 20294 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.509s (SENT)
I20260709 12:20:22.975325 27454 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:23.013788 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.020022 20180 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:23.020399 27512 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:20:23.008353 27484 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.012276 27450 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.022245 27450 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.022728 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.024426 27450 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:23.024560 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:23.025767 27510 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:23.026867 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.030759 20255 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:22.989233 27516 consensus_queue.cc:1059] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:20:23.033958 27517 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.027153 27509 log.cc:927] Time spent T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:20:23.034502 27517 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:23.027868 27503 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:20:23.036263 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.036839 27517 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.028059 27508 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:22.981694 27250 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:22.957315 27452 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.050s
I20260709 12:20:23.003492 27449 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.037571 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.038192 20249 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.038448 27449 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.039022 27489 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:23.030026 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.036872 20247 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:23.040469 20255 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:20:23.043776 21038 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:23.044992 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:23.045253 27452 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:23.045477 27499 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.006467 27470 raft_consensus.cc:740] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:23.045950 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.046627 27470 consensus_queue.cc:260] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.047422 27303 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.048027 27470 raft_consensus.cc:3060] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:23.003468 27417 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.039798 27449 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.049604 20251 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:20:23.052465 27440 raft_consensus.cc:3055] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:23.045588 20178 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:23.054427 20173 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:23.023345 27484 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.055925 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.057425 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:23.059029 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.093559 20177 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 24: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:23.058858 27497 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:23.059378 27439 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:23.060214 27469 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:23.065971 20175 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:23.066464 20249 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:23.068933 20247 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
W20260709 12:20:23.070763 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 404317us
I20260709 12:20:23.072840 20255 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:20:23.066349 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.002s	sys 0.010s
W20260709 12:20:23.111662 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.010s
W20260709 12:20:23.111999 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 597967us
W20260709 12:20:23.112046 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 227846us
I20260709 12:20:23.112885 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:23.082618 20251 pending_rounds.cc:85] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 10
I20260709 12:20:23.115787 20251 pending_rounds.cc:107] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:20:23.116073 20251 raft_consensus.cc:2889] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:23.092510 20179 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:23.117190 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.118000 27417 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:23.118549 27417 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.118970 27417 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.119907 21038 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:23.067905 27452 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:23.124504 27452 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.125721 27452 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:23.132745 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.137388 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.138116 21042 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:23.139334 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:23.081290 27325 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:23.143210 21039 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:23.083227 27440 raft_consensus.cc:740] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:23.153002 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.154605 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.159715 21034 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:23.109265 27439 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:23.165735 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 54834.6us
I20260709 12:20:23.167186 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:23.149434 27157 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:23.172586 21038 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:23.169823 20295 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:23.168753 20178 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:20:23.179441 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:23.183709 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:23.183791 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.184887 21039 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:23.138650 27502 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.188326 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.189023 20330 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:23.140823 27512 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:20:23.190514 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.190713 20322 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:23.153851 27250 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:23.201761 20172 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:23.192910 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.155660 27404 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:20:23.156750 27511 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:20:23.196360 27440 consensus_queue.cc:260] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.186573 27221 raft_consensus.cc:2804] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:23.197942 27323 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:23.200063 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:23.174541 27310 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:23.235304 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.209856 20330 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:23.212177 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:23.192986 27508 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:23.216751 27283 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:23.226461 27432 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:23.195434 27512 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:23.191947 27372 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:23.212692 27157 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:23.174124 27496 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:20:23.198786 27516 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:23.269943 27516 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.270016 27157 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.270917 20328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3722) took 1112 ms. Trace:
I20260709 12:20:23.271330 20328 rpcz_store.cc:276] 0709 12:20:22.158440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.158600 (+   160us) service_pool.cc:224] Handling call
0709 12:20:23.270699 (+1112099us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54003ae3d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:23.270829 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290023296}
I20260709 12:20:23.271121 27516 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.272815 27516 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.273452 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.274045 21035 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:23.238559 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:23.276221 27498 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.759s	user 0.000s	sys 0.005s
I20260709 12:20:23.276851 20144 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:23.236761 27450 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:23.279379 27517 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:23.280333 27517 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:20:23.239214 27499 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:23.266285 27372 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.282292 27372 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:23.278442 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.283833 27484 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:23.284327 27484 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:23.284610 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.284837 27484 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.262027 27512 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.259855 27432 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.288304 27432 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.240175 27303 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:23.241175 27426 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:23.295389 27530 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:23.206712 27349 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:23.257452 27312 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:23.243072 27221 raft_consensus.cc:697] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.244704 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:23.247321 27455 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.247707 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.248090 27323 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:23.248951 27310 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.263971 27508 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:23.249475 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.251659 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.253274 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.278605 27502 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.291297 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:23.242704 27440 raft_consensus.cc:3060] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:23.298061 21035 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:23.206780 27521 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 12:20:23.312276 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67674.1us
I20260709 12:20:23.319931 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:23.321820 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.313235 27530 consensus_queue.cc:1243] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:23.298825 27312 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:23.326436 27303 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:23.305177 27432 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.331157 20175 raft_consensus.cc:1240] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:23.332238 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.328958 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.238447 27439 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.332602 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:23.335711 27303 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:23.339221 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.339360 27404 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:23.340019 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:23.340996 20174 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:20:23.350762 20171 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:23.296499 27499 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:20:23.346738 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.320289 27496 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:23.341507 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:23.347368 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.350178 27404 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:23.353555 27303 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.364334 27404 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.366655 27372 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.303459 27349 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.356082 27489 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:23.367961 27489 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.367993 27499 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:23.368491 27489 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:23.368590 27499 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:23.369470 27508 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.369634 27499 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.370995 27499 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:23.361240 20176 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:23.372450 20176 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:23.360735 27523 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:20:23.378113 27523 consensus_queue.cc:1243] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:20:23.300247 27417 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.361866 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.381767 20328 raft_consensus.cc:2368] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:23.334393 27312 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.359784 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.363044 20175 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:23.319927 27455 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.362831 27310 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.337458 27502 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:23.386188 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.392138 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.393043 20171 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:23.425861 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:23.426743 20176 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.361418 27257 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:23.360455 27496 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:23.429467 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 69781.3us
I20260709 12:20:23.437620 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.432324 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:23.390341 27502 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.443091 20328 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:23.443396 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.444818 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.445531 20254 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.454720 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:23.435752 27511 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:23.355813 27221 consensus_queue.cc:237] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.456992 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.437963 27496 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.459561 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:23.452366 27491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.017s	sys 0.031s
I20260709 12:20:23.448612 27502 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:23.465080 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.465307 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1733) took 1093 ms. Trace:
I20260709 12:20:23.470719 21041 rpcz_store.cc:276] 0709 12:20:22.371918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.426585 (+ 54667us) service_pool.cc:224] Handling call
0709 12:20:23.465131 (+1038546us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400602f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:23.465250 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135360768}
I20260709 12:20:23.466420 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.472034 21034 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:23.469484 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.473881 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.474716 21035 raft_consensus.cc:2410] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:23.475828 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:23.477069 21043 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:23.477763 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.477934 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.479295 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:23.481251 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.481997 20255 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:23.482976 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.483587 21037 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.484088 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.487424 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.437690 27257 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.461019 27432 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.532629 27257 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:23.536170 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.537218 20247 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:23.538368 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.539036 20247 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.539947 27283 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:23.547101 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.476166 27227 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.552747 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.553601 21038 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:23.554574 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.554741 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.555982 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:23.556210 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.557260 27349 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:23.558110 27349 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:23.558631 27349 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.557189 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.553311 27325 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:23.492027 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:23.492815 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.495735 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.562918 20249 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:23.501814 27465 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:23.455366 27473 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:20:23.502606 27450 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:23.565044 27450 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.565197 27473 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:23.565696 27473 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:23.510016 27417 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.515640 27251 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:23.566636 27251 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:23.517033 27511 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.568046 27325 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:23.568606 27251 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.569222 27325 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:23.522418 21040 raft_consensus.cc:2468] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:23.490123 27452 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.570842 27452 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.571296 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.571972 20255 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.528959 27455 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.573674 27455 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:23.560618 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:23.567855 27511 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.576920 21041 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:23.520464 27372 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.579792 27465 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:23.566756 27473 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.585450 27473 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:23.586797 27334 consensus_queue.cc:1175] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5c544fad8874e818acaad733a9d14f1" responder_term: 12 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 11. Current term is 12. Ops: [11.11-11.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:23.588891 27511 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.594497 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.595244 20256 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:23.596421 20251 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:23.596660 27349 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.597779 27404 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:23.603902 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 111960us
I20260709 12:20:23.556581 21038 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:23.605039 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.609413 20254 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:23.610423 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:23.616169 20249 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:23.617595 21037 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:23.618265 20176 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:23.621479 27470 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:23.623035 27470 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:23.623492 27470 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:23.624652 27470 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.633713 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.637818 27157 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.632586 20247 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:23.646687 20255 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:23.665663 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:23.626849 27325 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.619168 27257 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:23.674391 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.668695 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.676214 20327 raft_consensus.cc:2410] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:20:23.645644 27354 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:23.678267 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.660501 27452 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:23.678791 27449 consensus_meta.cc:287] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
W20260709 12:20:23.687249 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.675307 27227 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:23.679858 27469 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:23.680251 27354 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.713836 27354 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:23.681805 27250 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:23.712206 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:23.683694 27470 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.696810 27452 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:23.663332 27157 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.660310 27312 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.715943 27469 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:23.779053 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.788107 20247 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:23.791075 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.796518 20254 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:23.796980 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.797958 20327 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.798554 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.694087 27450 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:23.800765 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.800077 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.726811 27454 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.797672 27508 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.805713 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.922050 20251 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:23.806654 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:23.806981 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.807437 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.807729 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.923439 20256 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:23.807446 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.811690 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.818347 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.745265 27497 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.180s
W20260709 12:20:23.928459 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 121588us
W20260709 12:20:23.831051 27528 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.487s	user 0.002s	sys 0.000s
I20260709 12:20:23.833356 20321 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:23.871116 27496 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.840330 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:23.962426 20252 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:20:23.844537 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.963359 20326 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:23.845531 20255 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:23.963500 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.852816 27426 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:23.966488 27426 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:23.855227 27439 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:23.856221 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.959s (SENT)
I20260709 12:20:23.971987 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:23.973058 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 116887us
W20260709 12:20:23.974058 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.993s (SENT)
I20260709 12:20:23.974516 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.862931 27312 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.977339 27349 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:23.864898 27334 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.870930 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:23.978639 27334 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:23.979110 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 108297us
I20260709 12:20:23.980027 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:23.980590 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:23.981065 27334 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:23.877820 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.981936 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.740391 27227 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 12:20:23.880041 27512 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:23.880561 27499 consensus_meta.cc:287] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 12:20:23.863390 20176 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:23.885671 27450 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
W20260709 12:20:23.886153 27484 consensus_meta.cc:287] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.002s
W20260709 12:20:23.898078 27538 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:20:23.899892 27221 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:23.901991 27502 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.863391 27404 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:23.798696 27469 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.740211 27489 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.020280 27491 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:23.906728 27440 consensus_meta.cc:287] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.579s	user 0.003s	sys 0.008s
I20260709 12:20:23.731462 27511 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:23.916458 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:23.798301 27452 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.790934 27517 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.919950 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 258072us
I20260709 12:20:23.933684 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:23.839573 20327 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 16.
I20260709 12:20:23.942418 20324 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:23.947832 27257 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:20:24.119014 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 202654us
I20260709 12:20:23.929081 27454 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:23.950284 27157 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:23.954120 27523 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.954296 27432 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:23.917781 27530 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:20:23.964576 20322 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:24.145220 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:24.146586 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:24.147264 20322 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:23.984032 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 350373us
I20260709 12:20:23.997557 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:24.154426 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 156997us
W20260709 12:20:23.999485 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.030s (SENT) [suppressed 44 similar messages]
W20260709 12:20:24.157119 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 157681us
W20260709 12:20:24.157912 20220 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.050s (SENT)
I20260709 12:20:24.158386 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:23.921298 27303 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.019850 20328 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:24.021073 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.022550 20171 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:20:23.934631 27250 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:24.027765 20323 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:24.029600 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:24.104735 20325 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:24.114260 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:24.027769 27484 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.121348 20180 raft_consensus.cc:2410] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:24.123122 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:24.166656 20171 pending_rounds.cc:85] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 14
I20260709 12:20:24.119886 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:24.166945 20171 pending_rounds.cc:107] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:20:24.167229 20171 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:24.167290 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47495.8us
I20260709 12:20:23.930502 27508 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.128549 20255 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:24.140512 27454 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:24.123762 27534 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:24.141216 27523 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.185792 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:24.025813 27312 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:24.173314 27349 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:24.186545 20324 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:24.187067 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.181567 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.157s (SENT)
I20260709 12:20:24.184851 20328 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:24.071702 27450 consensus_queue.cc:1059] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:20:24.175864 20327 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:24.190469 20322 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:24.190696 20219 leader_election.cc:400] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:24.199853 20219 leader_election.cc:403] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:20:24.200029 20330 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:20:24.202389 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:24.173573 27511 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:24.205372 20173 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:24.125141 27452 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.213565 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:24.215754 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 233860us
I20260709 12:20:24.218797 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1882) took 1339 ms. Trace:
I20260709 12:20:24.176661 27157 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:24.219218 20248 rpcz_store.cc:276] 0709 12:20:22.879265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.879383 (+   118us) service_pool.cc:224] Handling call
0709 12:20:22.891297 (+ 11914us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:20:22.899268 (+  7971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.899304 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:20:23.063049 (+163745us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b2c00000448. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:20:23.079131 (+ 16082us) log.cc:844] Serialized 78 byte log entry
0709 12:20:23.210584 (+131453us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:23.210633 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.210704 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.830227 (+619523us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:24.218570 (+388343us) raft_consensus.cc:1685] finished
0709 12:20:24.218592 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.218737 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3712,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10437,"spinlock_wait_cycles":31613184,"thread_start_us":98732,"threads_started":1,"wal-append.queue_time_us":203839}
I20260709 12:20:24.133023 27517 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.227669 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:24.229121 27517 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.229521 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.229746 27502 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.231148 27523 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.230974 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.232100 27489 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.172232 27303 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.233119 27484 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.234956 27496 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.199070 27325 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:24.236205 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:24.236661 20176 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
W20260709 12:20:24.247041 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 262788us
W20260709 12:20:24.218713 27473 consensus_meta.cc:287] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.002s
I20260709 12:20:24.249337 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.254288 20171 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.211295 27534 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
W20260709 12:20:24.254194 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:24.258708 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.260128 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:24.260906 20330 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:24.229779 27517 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:24.306442 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 124902us
W20260709 12:20:24.310091 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49618.8us
I20260709 12:20:24.245621 27325 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:24.322784 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 86653.3us
I20260709 12:20:24.254217 27157 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:24.330850 27426 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:24.333840 27542 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.490s	user 0.000s	sys 0.002s
W20260709 12:20:24.336519 27544 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:20:24.340237 27432 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:24.230858 27511 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.347988 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1325) took 1016 ms. Trace:
I20260709 12:20:24.366159 20180 rpcz_store.cc:276] 0709 12:20:23.331546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.332030 (+   484us) service_pool.cc:224] Handling call
0709 12:20:24.347696 (+1015666us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b540031a6d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:24.347886 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756140288}
I20260709 12:20:24.326416 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:24.317304 27283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40622 (request call id 11) took 2947 ms. Trace:
I20260709 12:20:24.368505 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:24.320120 27557 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:24.393038 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:24.325275 27517 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:24.393654 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:24.351051 27349 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.356772 27454 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.399180 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:24.405086 20330 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:24.408263 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.409015 20180 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.364986 27432 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:24.389424 27523 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:24.393693 27426 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:24.398602 27303 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.401742 27502 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:24.447906 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:24.441433 20326 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 24.
I20260709 12:20:24.452126 21040 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:24.457852 21037 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:20:24.462981 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:24.464156 21037 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:24.406816 27349 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.432646 27556 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:24.448426 27497 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:24.440979 27523 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:24.465279 20252 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 24.
I20260709 12:20:24.453608 27221 raft_consensus.cc:2764] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:20:24.419345 27454 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.492297 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:24.463318 27496 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.462563 27502 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:24.240118 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:24.498980 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:24.499703 21036 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:24.499950 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:24.500550 21034 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:24.499305 21042 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:24.388504 27283 rpcz_store.cc:276] 0709 12:20:21.339911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.340074 (+   163us) service_pool.cc:224] Handling call
0709 12:20:21.557720 (+217646us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b54008b0ea0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddae75520 00007f5ddaefeb42 00007f5ddaefd800 00007f5ddaef69fa 00007f5ddfebe4c9 00007f5dd943ac54 00007f5dd943abe2 00007f5dd943ab11 00007f5dd943aa8c 00007f5dd9439d42
0709 12:20:21.607728 (+ 50008us) log.cc:844] Serialized 501 byte log entry
0709 12:20:24.287473 (+2679745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43698,"raft.queue_time_us":30077,"raft.run_cpu_time_us":1825,"raft.run_wall_time_us":163641,"spinlock_wait_cycles":122623872,"thread_start_us":328852,"threads_started":2,"wal-append.queue_time_us":95323,"wal-append.run_cpu_time_us":2095,"wal-append.run_wall_time_us":1030546}
W20260709 12:20:24.504225 27354 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
I20260709 12:20:24.504689 27354 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.505788 21043 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 12:20:24.508221 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 115299us
I20260709 12:20:24.471199 27566 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:24.510990 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 2280) took 1049 ms. Trace:
I20260709 12:20:24.510015 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:24.477375 27497 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.492542 27531 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:24.515035 20075 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 208) took 46727 ms (client timeout 15000 ms). Trace:
I20260709 12:20:24.432439 27325 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.546983 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:24.486927 27556 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:24.538167 21036 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
W20260709 12:20:24.525465 20220 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.342s (SENT)
I20260709 12:20:24.548695 20326 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:24.525568 20252 rpcz_store.cc:276] 0709 12:20:23.443940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.444061 (+   121us) service_pool.cc:224] Handling call
0709 12:20:23.840233 (+396172us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b5c00277c0c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dde862161 00007f5ddea03a79 00007f5ddfebd9b6 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:24.493726 (+653493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9208704}
I20260709 12:20:24.492969 27560 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.549723 20075 rpcz_store.cc:269] 0709 12:19:37.787257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.787587 (+   330us) service_pool.cc:224] Handling call
0709 12:20:24.514758 (+46727171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69752,"reported_tablets":36}
W20260709 12:20:24.558032 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.459467 27157 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:24.574174 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 76780.4us
I20260709 12:20:24.550076 27497 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:24.523469 27566 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:24.577183 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:24.580282 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:24.476226 27432 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.558175 27499 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.523878 27530 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:20:24.588932 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:24.599036 21036 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:24.556309 27534 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 12:20:24.587680 27553 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:20:24.566936 27440 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:24.530889 27452 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:24.482771 27517 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.584749 27566 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:24.572104 27560 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.584273 27549 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:24.604398 20251 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:24.623364 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:24.644790 20322 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:24.594776 27303 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:24.640309 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:24.596999 27572 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:24.592439 20171 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:24.649943 20328 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:24.651980 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:24.653368 20295 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:24.605288 27283 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:20:24.674818 21035 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:24.601969 27499 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.603971 27251 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:24.688724 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.641988 27349 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.642127 27312 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:24.648572 27549 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.624500 27440 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:24.691425 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.702044 21036 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:24.653954 27569 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.711473 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.712338 20179 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:24.705828 21039 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:24.713009 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.597170 27502 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.673383 27562 raft_consensus.cc:2804] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:24.595059 27523 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:24.705885 27555 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 12:20:24.708453 27455 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.134s	user 0.007s	sys 0.007s
I20260709 12:20:24.656616 27303 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.709300 27549 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:24.720598 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.721966 20180 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:20:24.728449 27563 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:20:24.727964 27570 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:20:24.664189 27572 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.709003 27312 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.748592 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.749370 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:24.711962 27559 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.752074 20179 raft_consensus.cc:2410] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:20:24.752347 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.701843 27251 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.728247 27440 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.735285 27455 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:24.780471 20323 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:24.720253 27569 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:24.760078 20063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 51424us
I20260709 12:20:24.717975 27530 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:20:24.783418 27465 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.783985 27465 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:24.785934 27469 consensus_meta.cc:287] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260709 12:20:24.786134 27465 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.786401 27469 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.787424 20321 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:24.788890 27572 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.789459 27572 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:24.789786 27572 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:24.790650 27572 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.791148 27312 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.792376 27560 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:24.765246 27574 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:20:24.765465 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.812326 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:24.769157 27512 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:24.775166 20220 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.667s (SENT)
W20260709 12:20:24.776168 27571 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:20:24.766618 27559 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.653357 27556 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:24.777340 27576 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:20:24.777391 27499 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.779408 27251 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.794875 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:24.951908 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 157117us
I20260709 12:20:24.797806 20321 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:24.799281 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:24.746196 27562 raft_consensus.cc:697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:24.811450 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:24.936872 27439 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.968s	user 0.013s	sys 0.007s
I20260709 12:20:24.920111 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:24.792328 27508 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:24.921182 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:24.944686 27557 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:20:24.957873 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:24.958546 20254 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:24.925752 27440 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:24.925239 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.959951 27440 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.960763 20180 raft_consensus.cc:2368] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 23. Current term is 24.
I20260709 12:20:24.961688 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:24.962136 27440 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.962432 20180 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:24.926026 20322 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
W20260709 12:20:24.885877 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 197801us
W20260709 12:20:24.965379 27552 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.625s	user 0.002s	sys 0.000s
I20260709 12:20:24.927215 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:24.967590 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 192420us
I20260709 12:20:24.968045 27534 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:24.968736 27534 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.970417 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4003) took 1111 ms. Trace:
I20260709 12:20:24.935711 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:24.941334 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:24.941447 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:24.971330 20256 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:24.971299 20249 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:24.918105 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:24.924934 27577 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:20:24.936599 27465 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.934083 27250 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:24.924605 27560 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.949795 27580 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.198s	user 0.001s	sys 0.002s
I20260709 12:20:24.796609 21036 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:24.761919 27454 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.953126 21043 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:24.919912 27312 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:24.954603 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 3999) took 1097 ms. Trace:
I20260709 12:20:24.957973 27557 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:24.996870 27557 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:24.997058 27569 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.997839 27584 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:24.998018 27557 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:24.918756 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:24.990046 27250 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:24.999930 20251 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:24.970325 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:25.001771 27250 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:24.977344 27251 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:25.002498 27251 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:25.004406 27585 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:20:25.004611 27251 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.006639 20329 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:25.007673 27455 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:25.008050 27426 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.007s
I20260709 12:20:25.008217 27455 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.010375 27354 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:24.944686 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:24.945065 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:25.013921 20248 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:24.973323 20322 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:20:24.993736 20172 rpcz_store.cc:276] 0709 12:20:23.857637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.865134 (+  7497us) service_pool.cc:224] Handling call
0709 12:20:23.865475 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:23.865888 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.865920 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:23.887087 (+ 21167us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b2c000fd238. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:20:23.887773 (+   686us) log.cc:844] Serialized 52 byte log entry
0709 12:20:24.174006 (+286233us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:24.468131 (+294125us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.468560 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.468798 (+   238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.943069 (+474271us) raft_consensus.cc:1685] finished
0709 12:20:24.954370 (+ 11301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.954533 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10452,"prepare.queue_time_us":303718,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":493,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":10269,"spinlock_wait_cycles":46957952,"thread_start_us":545416,"threads_started":2,"wal-append.queue_time_us":504655}
I20260709 12:20:24.973551 20177 raft_consensus.cc:2410] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:20:24.973166 21040 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:24.969789 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:24.972443 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:24.963392 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:24.970968 20175 rpcz_store.cc:276] 0709 12:20:23.858968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.863499 (+  4531us) service_pool.cc:224] Handling call
0709 12:20:23.863878 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.864245 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.864295 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.873559 (+  9264us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b2c000fd238. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd97f1a11 00007f5dd9801372 00007f5ddaf33a01 00007f5ddaef843a 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2
0709 12:20:23.874009 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.105325 (+231316us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:24.105377 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.105456 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.964661 (+859205us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:24.970178 (+  5517us) raft_consensus.cc:1685] finished
0709 12:20:24.970205 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.970350 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":624,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"spinlock_wait_cycles":33271424,"thread_start_us":230874,"threads_started":1,"wal-append.queue_time_us":379461}
I20260709 12:20:24.955008 27283 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:24.986886 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:25.030702 20326 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 21: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:24.989558 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 347097us
I20260709 12:20:24.989799 21008 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:24.989125 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50365.7us
W20260709 12:20:24.992956 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.196s (SENT)
I20260709 12:20:25.033131 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:24.996116 27312 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.001886 20327 raft_consensus.cc:2393] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:24.944818 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:25.015689 20251 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:25.016324 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46652.7us
W20260709 12:20:25.044876 27511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.023s
I20260709 12:20:24.941393 27523 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:25.017079 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.045421 27452 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.032162 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:25.034456 27578 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:20:25.048467 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55556.1us
I20260709 12:20:25.049408 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:25.035437 27562 consensus_queue.cc:237] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:25.054677 21034 raft_consensus.cc:2410] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:25.038431 27586 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:24.999527 27557 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:25.041234 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.045020 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:25.046271 20172 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:20:24.983503 27303 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.007370 27534 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:25.058471 27561 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.027s
I20260709 12:20:24.990259 27560 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.056860 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.062414 27578 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:25.040004 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:25.062152 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:25.058050 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:25.065819 20173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1324) took 1734 ms (client timeout 1879 ms). Trace:
W20260709 12:20:25.045447 27511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.006s	sys 0.023s
I20260709 12:20:24.985884 27465 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.050168 27484 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.067481 20175 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.046851 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:25.055511 27517 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:25.044255 27349 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.047919 27489 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:24.984261 27469 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.051353 27354 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.087s
W20260709 12:20:25.185539 20173 rpcz_store.cc:269] 0709 12:20:23.331256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.331875 (+   619us) service_pool.cc:224] Handling call
0709 12:20:25.065523 (+1733648us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54002c4054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:25.065731 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983586560}
I20260709 12:20:25.204212 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:25.185199 27561 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.004s	sys 0.029s
I20260709 12:20:25.186154 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.184679 20248 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
W20260709 12:20:25.189555 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 131594us
I20260709 12:20:25.195992 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:25.198555 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 151795us
W20260709 12:20:25.199033 20176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 4008) took 1309 ms (client timeout 1546 ms). Trace:
I20260709 12:20:25.200765 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.045836 27523 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.050653 27566 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.208228 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.214648 20173 raft_consensus.cc:2410] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:25.210181 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:25.215739 20175 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:20:25.215837 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:25.210008 20176 rpcz_store.cc:269] 0709 12:20:23.889507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.020666 (+131159us) service_pool.cc:224] Handling call
0709 12:20:25.198849 (+1178183us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b540031a1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:25.198967 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161026944}
I20260709 12:20:25.211434 20172 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:25.201144 20220 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.144s (SENT)
I20260709 12:20:25.210952 21036 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:25.217870 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:25.212913 27312 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.205308 27499 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:25.059433 27452 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.208019 27589 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:20:25.223095 21008 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.721s (SENT)
I20260709 12:20:25.222230 20295 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:25.224237 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.225479 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.231978 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.207772 27517 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:25.199759 27569 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:25.065189 27586 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.240908 20175 raft_consensus.cc:2368] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17.
I20260709 12:20:25.205493 27484 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.239697 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.242637 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.232530 27589 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.264178 20172 raft_consensus.cc:2410] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:20:25.264539 20176 raft_consensus.cc:2410] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:20:25.243723 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.244735 20255 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:25.247538 27578 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:25.258499 27590 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:25.224895 27559 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.240964 20173 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.212453 27489 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:25.272686 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.240625 27556 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.205353 27549 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.291749 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.292719 20173 raft_consensus.cc:2410] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:25.276007 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.294989 20175 raft_consensus.cc:2368] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 10. Current term is 11.
W20260709 12:20:25.295037 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 79332us
I20260709 12:20:25.296432 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.297091 20175 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:25.276518 20180 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.240350 27349 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:20:25.259577 27569 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.298569 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:25.277136 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.300832 20176 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:20:25.261307 27469 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:25.247640 27499 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:25.286670 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.308816 20172 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:25.309751 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.309688 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:25.310614 20172 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:25.259753 27511 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:25.262637 27598 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.265980 27589 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:25.305385 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.311543 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.312498 20173 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.315367 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.316232 20173 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:25.313203 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.317480 20176 raft_consensus.cc:2410] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 12:20:25.314272 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 124651us
I20260709 12:20:25.306412 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.319404 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:25.321298 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:25.322140 21039 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:25.322852 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:25.323050 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.324263 20176 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.320458 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:25.325114 20173 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.327972 20175 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.329118 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.331780 20176 raft_consensus.cc:2393] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.330493 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:25.341711 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.879s (SENT)
I20260709 12:20:25.342355 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:25.344877 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.358081 20220 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.694s (SENT)
I20260709 12:20:25.358590 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:25.368963 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:25.370882 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:25.392057 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:25.304409 27569 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:25.393996 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52330.8us
I20260709 12:20:25.406615 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:25.258556 27517 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:25.321359 27497 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.725s	user 0.014s	sys 0.008s
I20260709 12:20:25.413530 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:25.307631 27469 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:25.421686 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.407351 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4011) took 1158 ms. Trace:
I20260709 12:20:25.459190 20175 rpcz_store.cc:276] 0709 12:20:24.248845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.406421 (+1157576us) service_pool.cc:224] Handling call
0709 12:20:25.406730 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.406963 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.406989 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.407036 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:25.407084 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.407141 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.407275 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.430775 20176 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:25.461123 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4006) took 1572 ms. Trace:
I20260709 12:20:25.461555 20176 rpcz_store.cc:276] 0709 12:20:23.888898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.407425 (+1518527us) service_pool.cc:224] Handling call
0709 12:20:25.407756 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.460767 (+ 53011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.461052 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.431053 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:25.463590 20173 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:25.318061 27439 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.435981 20322 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:25.326151 27303 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:25.499063 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:25.499969 20248 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:25.519301 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3791) took 1090 ms. Trace:
I20260709 12:20:25.519982 20180 rpcz_store.cc:276] 0709 12:20:24.429230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.327296 (+898066us) service_pool.cc:224] Handling call
0709 12:20:25.519209 (+191913us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:25.431473 27597 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:20:25.392905 27354 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:25.531471 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.408202 27283 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:25.407985 27465 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.408622 27523 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.421528 27556 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:25.588598 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4014) took 1336 ms. Trace:
I20260709 12:20:25.589217 20173 rpcz_store.cc:276] 0709 12:20:24.252429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.524391 (+1271962us) service_pool.cc:224] Handling call
0709 12:20:25.587924 (+ 63533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.588159 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.588194 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.588251 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:25.588314 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.588384 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.588523 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.578325 20176 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:25.591030 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4013) took 1339 ms. Trace:
I20260709 12:20:25.591549 20176 rpcz_store.cc:276] 0709 12:20:24.251246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.523419 (+1272173us) service_pool.cc:224] Handling call
0709 12:20:25.523792 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.590710 (+ 66918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.590968 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.326152 27157 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.193s
I20260709 12:20:25.493261 27469 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:25.393129 27511 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.407351 27489 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.594352 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4016) took 1338 ms. Trace:
I20260709 12:20:25.518472 27303 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:25.643018 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 272181us
I20260709 12:20:25.647425 20180 rpcz_store.cc:276] 0709 12:20:24.255626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.547735 (+1292109us) service_pool.cc:224] Handling call
0709 12:20:25.593707 (+ 45972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.593952 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.593989 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.594045 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:25.594090 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.594169 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.594284 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:25.645390 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 230761us
I20260709 12:20:25.574497 27516 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.648578 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:25.660354 20173 raft_consensus.cc:1275] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:25.580916 27439 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:25.663678 20329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2415) took 1865 ms (client timeout 2229 ms). Trace:
I20260709 12:20:25.498168 27497 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.681136 20326 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
W20260709 12:20:25.677938 20329 rpcz_store.cc:269] 0709 12:20:23.798512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.807078 (+  8566us) service_pool.cc:224] Handling call
0709 12:20:25.663478 (+1856400us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002d9bd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:25.663612 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461329792}
I20260709 12:20:25.661111 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4017) took 1315 ms. Trace:
I20260709 12:20:25.682060 20173 rpcz_store.cc:276] 0709 12:20:24.345882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.590421 (+1244539us) service_pool.cc:224] Handling call
0709 12:20:25.660008 (+ 69587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.660822 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.661048 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.682789 20176 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:25.608295 27523 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.595363 27602 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:25.694335 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 45987.3us
I20260709 12:20:25.649940 27303 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:25.696098 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:25.695341 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:25.699443 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:25.701465 27600 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:20:25.701651 20173 raft_consensus.cc:1240] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:25.702798 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3799) took 1240 ms. Trace:
I20260709 12:20:25.581698 27354 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.703331 20173 rpcz_store.cc:276] 0709 12:20:24.462278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.682985 (+1220707us) service_pool.cc:224] Handling call
0709 12:20:25.701347 (+ 18362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.702413 (+  1066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.702719 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.679855 27560 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.653466 27559 consensus_queue.cc:1059] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:20:25.585490 27499 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.686126 27566 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.677655 27516 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.686630 27584 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:20:25.732913 27584 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:25.713124 27534 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:25.676239 27601 consensus_queue.cc:1059] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:20:25.722862 27610 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:25.717494 27439 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.704027 27602 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.736851 27604 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:25.839368 27556 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:25.872474 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 264365us
I20260709 12:20:25.860394 27549 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.896991 27610 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.910673 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 1065) took 1105 ms. Trace:
I20260709 12:20:25.861979 27560 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:25.912825 21034 rpcz_store.cc:276] 0709 12:20:24.805552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.805709 (+   157us) service_pool.cc:224] Handling call
0709 12:20:25.908556 (+1102847us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b540053b1d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:25.910589 (+  2033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225078016}
I20260709 12:20:25.870918 27452 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.914943 27610 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:25.918923 27606 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:25.924954 27602 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.901974 27604 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:25.925722 27604 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:25.926931 27455 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:25.912964 27562 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:20:25.933861 27556 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:25.934870 27556 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.939786 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:25.940286 20256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1892) took 1005 ms. Trace:
I20260709 12:20:25.940567 27603 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.941263 27603 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:25.942251 27599 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.665s	user 0.012s	sys 0.000s
I20260709 12:20:25.943638 27603 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:25.943461 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.944796 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.945075 27283 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.945655 27251 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.945642 27283 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.946362 27251 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:25.946781 20177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1323) took 2615 ms (client timeout 1721 ms). Trace:
W20260709 12:20:25.947191 20177 rpcz_store.cc:269] 0709 12:20:23.330959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.331760 (+   801us) service_pool.cc:224] Handling call
0709 12:20:25.946529 (+2614769us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540016ab54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:25.946699 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3731581184}
I20260709 12:20:25.947875 27283 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.945046 27562 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.948520 27251 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:25.948851 20177 raft_consensus.cc:1275] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:20:25.949307 20177 pending_rounds.cc:85] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:20:25.949535 20177 pending_rounds.cc:107] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:25.949769 20177 raft_consensus.cc:2889] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.904281 27157 raft_consensus.cc:3055] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:25.954087 20178 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:25.890841 27586 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:25.940652 20256 rpcz_store.cc:276] 0709 12:20:24.934727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.985282 (+ 50555us) service_pool.cc:224] Handling call
0709 12:20:24.985658 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.014585 (+ 28927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.014623 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.014684 (+    61us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:25.014720 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.940035 (+925315us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b54001ca054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:25.940081 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.940216 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65927040}
W20260709 12:20:25.945844 20220 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.858s (SENT)
I20260709 12:20:25.961979 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:25.963148 20220 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.877s (SENT)
W20260709 12:20:25.964145 20220 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.904s (SENT)
I20260709 12:20:25.964524 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:25.969893 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:25.970634 21037 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:25.970784 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:25.971403 21038 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:25.974207 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:25.975979 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1628) took 1494 ms. Trace:
I20260709 12:20:25.976369 21035 rpcz_store.cc:276] 0709 12:20:24.481825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.492014 (+ 10189us) service_pool.cc:224] Handling call
0709 12:20:25.975811 (+1483797us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54005870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:25.975921 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417995520}
I20260709 12:20:25.976975 27449 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:25.977317 27610 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.979669 27251 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:25.948957 27562 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.889604 27534 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.958734 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3806) took 1378 ms. Trace:
I20260709 12:20:25.977501 27449 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:25.984355 20177 rpcz_store.cc:276] 0709 12:20:24.585177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.948105 (+1362928us) service_pool.cc:224] Handling call
0709 12:20:25.948489 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.958501 (+ 10012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.958677 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.986641 21041 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:25.984123 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:25.980635 27586 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:25.994043 27449 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:25.994658 27449 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.995129 27449 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.988647 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:25.955519 27157 raft_consensus.cc:740] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:25.997352 27449 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.006341 20177 raft_consensus.cc:1240] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:26.004746 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:26.008742 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3808) took 1394 ms. Trace:
I20260709 12:20:26.009141 20177 rpcz_store.cc:276] 0709 12:20:24.614641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.986476 (+1371835us) service_pool.cc:224] Handling call
0709 12:20:26.006153 (+ 19677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.008459 (+  2306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.008682 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:25.951530 27560 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:25.990316 27561 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:25.998142 27511 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.004597 27549 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:26.015084 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:25.994073 27562 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.015154 20249 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:26.020767 20177 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:20:26.008121 27605 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:26.022593 20177 pending_rounds.cc:85] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 11
I20260709 12:20:26.028470 20177 pending_rounds.cc:107] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:20:26.028821 20177 raft_consensus.cc:2889] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:26.029615 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3810) took 1414 ms. Trace:
I20260709 12:20:26.029987 20177 rpcz_store.cc:276] 0709 12:20:24.615428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.009934 (+1394506us) service_pool.cc:224] Handling call
0709 12:20:26.020419 (+ 10485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.029363 (+  8944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.029559 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.037879 27602 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.008088 27449 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:20:26.041189 27602 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.022517 27561 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.028019 27465 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:26.043946 27465 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.044330 27465 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:26.044791 27561 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.047451 27516 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.020550 27452 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:26.021128 27549 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:25.989163 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 289837us
I20260709 12:20:26.054880 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:26.023699 27497 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.056375 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:26.061223 20249 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:26.043417 27602 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.028342 27605 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.062577 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:26.066515 20249 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:26.075143 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:26.075831 20248 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:26.076912 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:26.077639 20255 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:26.078086 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:26.017439 27604 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:26.080216 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84115.8us
W20260709 12:20:26.083226 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 61361.8us
W20260709 12:20:25.989807 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 292316us
I20260709 12:20:26.059988 27452 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.062691 27549 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:26.088874 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:26.090082 20329 raft_consensus.cc:2368] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20.
W20260709 12:20:26.078751 27557 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.993s	user 0.009s	sys 0.006s
I20260709 12:20:26.063762 27561 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:26.064021 27610 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.078908 27605 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:26.096567 20179 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3811) took 1480 ms (client timeout 1667 ms). Trace:
I20260709 12:20:26.089802 27452 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:26.097041 20179 rpcz_store.cc:269] 0709 12:20:24.615766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.720391 (+104625us) service_pool.cc:224] Handling call
0709 12:20:26.096335 (+1375944us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b54001d24d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:26.096502 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34515712}
I20260709 12:20:26.082713 27602 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:26.102334 20172 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:26.102986 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3822) took 1381 ms. Trace:
I20260709 12:20:26.103292 20172 rpcz_store.cc:276] 0709 12:20:24.721152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.101765 (+1380613us) service_pool.cc:224] Handling call
0709 12:20:26.102029 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.102705 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.102930 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:26.106495 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.106778 20249 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:26.107957 20172 raft_consensus.cc:1240] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:26.108634 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1344) took 1359 ms. Trace:
I20260709 12:20:26.108951 20172 rpcz_store.cc:276] 0709 12:20:24.749229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.107136 (+1357907us) service_pool.cc:224] Handling call
0709 12:20:26.107621 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.108345 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.108585 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.111127 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.111605 20172 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:26.112020 20322 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:26.112227 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4020) took 1136 ms. Trace:
I20260709 12:20:26.112586 20172 rpcz_store.cc:276] 0709 12:20:24.976135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.109629 (+1133494us) service_pool.cc:224] Handling call
0709 12:20:26.109908 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.111984 (+  2076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.112180 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:26.111042 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:26.118059 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.118549 27621 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:26.118682 27497 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.118759 20322 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:26.119661 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:26.060621 27157 consensus_queue.cc:260] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:26.100061 27561 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.230899 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4018) took 1812 ms. Trace:
I20260709 12:20:26.267422 27547 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.181210 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:26.145391 20325 raft_consensus.cc:1240] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:26.200161 20321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3747) took 2306 ms (client timeout 1970 ms). Trace:
I20260709 12:20:26.134742 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.265931 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:26.201462 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:26.312610 20321 rpcz_store.cc:269] 0709 12:20:23.893597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.933346 (+ 39749us) service_pool.cc:224] Handling call
0709 12:20:26.199940 (+2266594us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002d96d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:26.200068 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549959040}
I20260709 12:20:26.319804 20327 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:26.320297 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:26.343777 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.339109 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.321276 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:26.317402 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 136313us
I20260709 12:20:26.127193 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:26.277912 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:26.213587 20251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1893) took 1278 ms. Trace:
W20260709 12:20:26.219551 20323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3749) took 1959 ms (client timeout 1961 ms). Trace:
I20260709 12:20:26.120453 27497 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:26.385582 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 119764us
I20260709 12:20:26.385900 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.386502 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:26.386802 20321 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:26.309633 20176 rpcz_store.cc:276] 0709 12:20:24.418362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.592444 (+1174082us) service_pool.cc:224] Handling call
0709 12:20:25.592841 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.684995 (+ 92154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.230449 (+545454us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b54002c4f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:26.230792 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205879040}
I20260709 12:20:26.388489 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.389158 20325 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
W20260709 12:20:26.357651 20220 leader_election.cc:336] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.030s (SENT)
I20260709 12:20:26.389838 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:26.390640 20323 rpcz_store.cc:269] 0709 12:20:24.259738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.259875 (+   137us) service_pool.cc:224] Handling call
0709 12:20:26.219342 (+1959467us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54001a2554. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:26.219481 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195087104}
I20260709 12:20:26.391376 20322 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:26.391654 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:26.392479 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.393151 20323 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:20:26.395946 27622 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:26.120216 27534 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:26.208328 27618 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:20:26.227051 27595 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.043s	user 0.002s	sys 0.012s
W20260709 12:20:26.221930 27596 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.950s	user 0.000s	sys 0.009s
I20260709 12:20:26.394729 20251 rpcz_store.cc:276] 0709 12:20:24.934987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.000844 (+ 65857us) service_pool.cc:224] Handling call
0709 12:20:25.001174 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.043932 (+ 42758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.213280 (+1169348us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b54002fce54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:26.213516 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32467200}
I20260709 12:20:26.401017 20177 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:20:26.267397 27609 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.415222 27609 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:26.417402 27609 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.181347 27499 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:26.417951 27499 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.418320 27499 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:26.421649 27497 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.268671 27157 raft_consensus.cc:3060] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:26.381861 27626 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 12:20:26.404685 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.439055 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:26.439775 20321 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:26.404556 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46977.9us
I20260709 12:20:26.128665 27560 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.228745 27432 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:26.115037 27557 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.274s
I20260709 12:20:26.143812 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:26.462409 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:26.177639 27584 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:26.409580 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:26.469054 20176 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
I20260709 12:20:26.410054 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:26.383889 27449 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:26.110680 27602 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.119153 27621 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.430977 27604 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:26.432662 27589 consensus_meta.cc:287] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.064s	user 0.013s	sys 0.000s
I20260709 12:20:26.398290 27607 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:26.432934 27499 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.421031 27334 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:26.401684 27469 consensus_meta.cc:287] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 12:20:26.316913 27623 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:26.321825 27250 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.315178 27559 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:26.317472 27569 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.000s
W20260709 12:20:26.440977 20220 leader_election.cc:336] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.605s (SENT)
I20260709 12:20:26.508752 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:26.458184 27598 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:26.401773 27439 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:26.461145 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 71013.5us
I20260709 12:20:26.408085 27617 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:26.403954 27610 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:26.432997 27627 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:20:26.465889 20322 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:26.178057 27588 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.234s
I20260709 12:20:26.427949 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.398468 27562 consensus_queue.cc:1048] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
W20260709 12:20:26.486402 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 86324.4us
I20260709 12:20:26.387784 27547 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:26.495959 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 104396us
I20260709 12:20:26.498275 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3814) took 1870 ms. Trace:
I20260709 12:20:26.525731 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.525916 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:26.525648 20179 rpcz_store.cc:276] 0709 12:20:24.627598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.097999 (+1470401us) service_pool.cc:224] Handling call
0709 12:20:26.098355 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.098580 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:26.313796 (+215216us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.497308 (+183512us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.497889 (+   581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.497939 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:26.497984 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.498051 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.498203 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8800,"prepare.queue_time_us":212176,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":41127,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10173,"thread_start_us":373693,"threads_started":3,"wal-append.queue_time_us":82318}
I20260709 12:20:26.527021 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.498045 20321 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:26.528427 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.480011 27449 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.510677 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:26.511343 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70423.5us
I20260709 12:20:26.512916 20330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3755) took 1546 ms. Trace:
I20260709 12:20:26.532684 20330 rpcz_store.cc:276] 0709 12:20:24.966309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.972556 (+  6247us) service_pool.cc:224] Handling call
0709 12:20:24.989008 (+ 16452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:25.005231 (+ 16223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.005262 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.005810 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:20:25.048869 (+ 43059us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:25.048930 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.049026 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.221232 (+1172206us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:26.507412 (+286180us) raft_consensus.cc:1685] finished
0709 12:20:26.507440 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.512834 (+  5394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18096,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":24082304,"thread_start_us":42653,"threads_started":1,"wal-append.queue_time_us":205641}
I20260709 12:20:26.513628 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 3135) took 1946 ms. Trace:
I20260709 12:20:26.468297 27465 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.497833 27604 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:26.516634 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.518479 20325 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
W20260709 12:20:26.523109 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 245266us
I20260709 12:20:26.501664 27607 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:26.507019 27334 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:26.492125 27584 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.505868 27469 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.498034 27589 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.510382 27559 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.510210 27250 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.512917 27569 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.509919 27623 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.547745 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3804) took 1996 ms. Trace:
W20260709 12:20:26.530674 27303 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.000s
I20260709 12:20:26.535421 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.566442 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:26.538286 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:26.517375 27531 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:26.579279 20252 rpcz_store.cc:276] 0709 12:20:24.567508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.567697 (+   189us) service_pool.cc:224] Handling call
0709 12:20:24.570822 (+  3125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.315513 (+1744691us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b180046b940. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaef0bfb 00007f5ddaefb64b
0709 12:20:26.315691 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.315718 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.382671 (+ 66953us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.457948 (+ 75277us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:26.457994 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.459272 (+  1278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.509082 (+ 49810us) raft_consensus.cc:1685] finished
0709 12:20:26.509104 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.513564 (+  4460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14170,"raft.queue_time_us":40717,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":22818,"spinlock_wait_cycles":12597120,"thread_start_us":132129,"threads_started":2,"wal-append.queue_time_us":75175}
I20260709 12:20:26.585963 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42166 (request call id 3758) took 1265 ms. Trace:
I20260709 12:20:26.619639 20326 rpcz_store.cc:276] 0709 12:20:25.320219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.320398 (+   179us) service_pool.cc:224] Handling call
0709 12:20:26.585776 (+1265378us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003980d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:26.585895 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663026560}
W20260709 12:20:26.586594 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 53636.5us
I20260709 12:20:26.620760 20324 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:26.537824 27449 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:26.584340 27557 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:26.621379 20220 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.139s (SENT)
I20260709 12:20:26.589457 20173 rpcz_store.cc:276] 0709 12:20:24.551052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.704663 (+1153611us) service_pool.cc:224] Handling call
0709 12:20:25.721486 (+ 16823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:25.721736 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.721765 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.722299 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.010387 (+288088us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:26.163992 (+153605us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.266896 (+102904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.266985 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.547392 (+280407us) raft_consensus.cc:1685] finished
0709 12:20:26.547428 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.547639 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102577,"prepare.queue_time_us":299025,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":150718,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":68534,"thread_start_us":306828,"threads_started":2,"wal-append.queue_time_us":331106}
I20260709 12:20:26.565647 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:26.623587 21039 raft_consensus.cc:2368] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20.
W20260709 12:20:26.627482 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.629546 20220 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.520s (SENT)
I20260709 12:20:26.586596 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:26.630017 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:26.587085 27454 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.530846 27617 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:26.641067 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54548.3us
I20260709 12:20:26.642778 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:26.567404 27497 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:20:26.561921 27452 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.651729 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:26.626196 27534 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:26.662429 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:26.664672 27629 log.cc:927] Time spent T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:20:26.664873 27465 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.620728 27303 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.665531 27584 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:26.659684 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 137020us
I20260709 12:20:26.645649 27531 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:26.694123 20294 leader_election.cc:400] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:26.698793 20294 leader_election.cc:403] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:26.587507 27604 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.645212 27454 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.708299 20179 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
W20260709 12:20:26.654198 27567 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 2.155s	user 0.009s	sys 0.004s
I20260709 12:20:26.710536 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4005) took 2851 ms. Trace:
I20260709 12:20:26.710927 20174 rpcz_store.cc:276] 0709 12:20:23.859556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.232868 (+373312us) service_pool.cc:224] Handling call
0709 12:20:24.233209 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:24.233585 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:24.233616 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.234160 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.460519 (+226359us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:24.460571 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.460640 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:26.587169 (+2126529us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:26.710198 (+123029us) raft_consensus.cc:1685] finished
0709 12:20:26.710220 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.710465 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":57038720,"thread_start_us":225354,"threads_started":1,"wal-append.queue_time_us":264708}
I20260709 12:20:26.712870 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:26.713578 20174 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 26.
W20260709 12:20:26.713790 27635 log.cc:927] Time spent T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:20:26.651196 27560 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:26.716970 27560 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.717417 27560 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:26.736016 27547 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:26.737071 21036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1761) took 1688 ms (client timeout 1513 ms). Trace:
W20260709 12:20:26.737598 21036 rpcz_store.cc:269] 0709 12:20:25.048890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.049156 (+   266us) service_pool.cc:224] Handling call
0709 12:20:26.736861 (+1687705us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54005da054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:26.736989 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365521152}
I20260709 12:20:26.741591 27621 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.742790 27561 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.743541 27607 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.653913 27557 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:26.630792 27634 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
W20260709 12:20:26.848155 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 154174us
I20260709 12:20:26.849130 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:26.851148 27617 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:26.853520 27645 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:26.854456 27645 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:26.854846 27645 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:26.854923 27589 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.855275 27645 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.770743 27602 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.857327 27569 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.691442 27334 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:26.953531 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 102927us
W20260709 12:20:26.975180 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 449325us
I20260709 12:20:26.752435 27584 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.972935 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:26.753350 27465 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:26.865311 27469 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.853631 27559 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:26.689694 27534 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:26.935614 27531 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.966974 27250 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.937443 27633 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:26.992676 27605 consensus_meta.cc:287] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.884s	user 0.012s	sys 0.000s
I20260709 12:20:26.860154 27623 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:26.974102 27497 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:20:26.990254 27465 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:27.010380 27622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.023s	sys 0.029s
I20260709 12:20:27.020011 27605 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.029279 27648 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:20:27.032675 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 390015us
I20260709 12:20:27.043991 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:27.046973 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:27.013130 27572 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:27.039685 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:27.054317 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 3816) took 2414 ms (client timeout 1694 ms). Trace:
W20260709 12:20:27.054855 20171 rpcz_store.cc:269] 0709 12:20:24.639702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.760300 (+120598us) service_pool.cc:224] Handling call
0709 12:20:27.039490 (+2279190us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800002d98. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:20:27.054221 (+ 14731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359680}
I20260709 12:20:27.055858 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:27.041836 27569 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:27.051611 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:27.059002 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.059263 20325 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:27.039948 27622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.024s	sys 0.029s
I20260709 12:20:27.051684 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.052917 20251 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:27.024921 27452 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:26.867166 27557 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.060575 20249 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:26.990792 27584 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.039656 27465 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:27.063293 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.064625 20256 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 22
W20260709 12:20:27.065013 20172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.018s
W20260709 12:20:27.065369 20172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.017s	sys 0.018s
I20260709 12:20:27.015360 27588 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:20:27.065399 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.066285 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:27.069303 20325 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:27.070348 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.070269 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:27.071062 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.067281 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:27.071769 20248 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:27.075798 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.076504 20171 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:27.077199 20325 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:27.077308 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.069538 27589 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.079794 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.057125 27623 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:27.080739 27623 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:27.081884 27562 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:27.081697 27623 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.082262 27562 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:27.079794 27589 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.085740 20171 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:27.086730 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.087083 27589 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.054322 27561 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:27.088096 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.053826 27530 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:27.020203 27633 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.102313 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:27.114388 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:27.116465 20256 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:27.117115 20250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1898) took 2070 ms. Trace:
I20260709 12:20:27.115916 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:27.118410 20250 rpcz_store.cc:276] 0709 12:20:25.046979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.047786 (+   807us) service_pool.cc:224] Handling call
0709 12:20:25.066043 (+ 18257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.222153 (+156110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:25.222185 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:25.222233 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:25.222293 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.116879 (+1894586us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400196ed4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:27.116933 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.117059 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358396672}
I20260709 12:20:27.117247 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.120479 20251 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 22 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:20:27.121330 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.025794 27531 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:27.109920 27157 consensus_meta.cc:287] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.003s
I20260709 12:20:27.123661 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.125046 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.127149 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:27.127638 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.127907 21036 raft_consensus.cc:2368] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18.
I20260709 12:20:27.130192 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:27.130546 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:27.132570 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.133200 20249 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:27.135219 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:27.135596 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:27.135761 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:27.136759 20251 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:27.138536 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.140579 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.141852 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.142621 20173 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.109862 27349 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.112891 27648 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:27.064927 27569 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.143343 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.083135 27562 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:27.136468 27549 consensus_meta.cc:287] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.029s	user 0.008s	sys 0.007s
I20260709 12:20:27.117686 27652 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.152055 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:27.147126 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.147431 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.148496 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.124111 27621 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:27.144644 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.156086 20173 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.157461 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.174108 20171 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.161558 20250 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:27.161695 20180 raft_consensus.cc:2368] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:27.119099 27469 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:27.162770 20294 leader_election.cc:400] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18.
I20260709 12:20:27.179622 20294 leader_election.cc:403] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:27.164067 20248 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:27.099502 27641 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:20:27.120860 27591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.863s	user 0.034s	sys 0.030s
I20260709 12:20:27.177181 20251 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:27.146817 27432 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.006s
I20260709 12:20:27.156893 27648 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.144599 27651 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:27.184202 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.188620 20322 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:27.186466 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.189632 20248 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:27.189960 20173 raft_consensus.cc:2393] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:27.188890 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:27.184003 27591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.926s	user 0.034s	sys 0.031s
I20260709 12:20:27.193882 20180 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.197604 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.112524 27530 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:27.210052 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47472.2us
I20260709 12:20:27.155978 27349 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.182886 27621 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:27.211585 20254 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:27.214820 20248 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:27.190578 27648 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:27.186966 27562 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:27.174889 27652 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.216607 27647 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.217044 27642 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:27.192656 27651 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.191448 27516 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.217710 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:27.218077 20220 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.857s (SENT)
I20260709 12:20:27.216092 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:27.191586 27469 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:27.176066 27549 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.258698 27584 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.260321 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.260703 27549 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:27.261008 20253 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:27.222033 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.262226 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.262904 20171 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:20:27.264178 27659 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:20:27.266633 27654 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:20:27.267936 27605 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.229898 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.271060 20180 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:27.222506 27534 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.272848 20180 raft_consensus.cc:1275] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:27.232908 20256 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:27.230371 27642 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.274112 27642 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:27.277351 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:27.245340 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:27.234608 27651 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:27.249971 27449 consensus_meta.cc:287] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.005s
I20260709 12:20:27.250196 27516 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.292627 27455 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:27.296896 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51668.2us
I20260709 12:20:27.298157 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.300393 20173 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:27.302609 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:27.303268 20255 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:27.299743 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:27.283118 27497 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:27.299281 27455 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.231809 27647 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.299177 27449 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.332310 27530 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.343957 27633 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:27.346808 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.314190 27641 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:27.318401 27432 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.313364 27559 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:27.358806 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 4028) took 1040 ms. Trace:
I20260709 12:20:27.341988 27455 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:27.360773 20247 raft_consensus.cc:2410] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:27.312816 27667 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:20:27.361096 20179 rpcz_store.cc:276] 0709 12:20:26.318726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.538002 (+219276us) service_pool.cc:224] Handling call
0709 12:20:27.358590 (+820588us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b54000c6cd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:27.358713 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204825472}
I20260709 12:20:27.363549 20323 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:27.298715 27465 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.345952 27655 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.368870 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.361460 20255 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:27.372339 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:27.341331 27531 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.352006 27641 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.379518 27616 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.380117 27616 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.380609 27647 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.380765 27449 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.365320 27432 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.383410 27432 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:27.313452 27621 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.366833 27559 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.386088 27559 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.388141 21036 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:27.388413 27641 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:27.391273 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:27.391844 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:27.392503 21042 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:27.396927 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.399207 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4012) took 3149 ms. Trace:
I20260709 12:20:27.370393 27569 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.399667 20175 rpcz_store.cc:276] 0709 12:20:24.250152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.522776 (+1272624us) service_pool.cc:224] Handling call
0709 12:20:26.099247 (+576471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.099464 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.099496 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.099544 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:26.099600 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.099672 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:27.399028 (+1299356us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54001d24d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:27.399148 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324651904}
I20260709 12:20:27.391937 27349 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.401863 20253 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:27.379158 27655 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.403237 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:27.440032 20329 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:27.406405 27636 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.779s	user 0.004s	sys 0.021s
I20260709 12:20:27.406872 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.407168 20173 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:27.407645 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.407925 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.408118 21039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1767) took 1094 ms. Trace:
I20260709 12:20:27.408293 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.448973 20177 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:27.448954 21039 rpcz_store.cc:276] 0709 12:20:26.313428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.321024 (+  7596us) service_pool.cc:224] Handling call
0709 12:20:27.407920 (+1086896us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54005870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:27.408059 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489073536}
I20260709 12:20:27.408706 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.450718 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:27.410068 27432 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.411157 27511 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.411942 21042 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:27.412820 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42162 (request call id 2431) took 1232 ms. Trace:
I20260709 12:20:27.414654 27469 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18.
I20260709 12:20:27.389293 27465 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.462219 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.463165 20180 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:27.440554 27623 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:27.449052 20174 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 12.
I20260709 12:20:27.454970 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.468317 20173 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 24: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.456275 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.458958 20323 rpcz_store.cc:276] 0709 12:20:26.180578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.393939 (+213361us) service_pool.cc:224] Handling call
0709 12:20:26.394344 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.367856 (+973512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:27.412489 (+ 44633us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54000861d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:27.412735 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228483456}
I20260709 12:20:27.468453 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.425040 27473 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.463510 27560 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.010s
I20260709 12:20:27.465579 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.467243 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.495302 20171 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:27.471333 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.422793 27652 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.478579 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.453091 20329 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:27.458407 27432 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.480782 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:27.483202 27455 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.491961 27516 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:27.501914 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.504549 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:27.505409 20177 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.604979 20174 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.578800 20322 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:27.493986 27623 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.610595 27623 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:27.503674 27473 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.507037 27560 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.612207 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:28.721570 20177 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:27.604807 20175 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:28.763998 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1356) took 1357 ms. Trace:
I20260709 12:20:28.812144 20175 rpcz_store.cc:276] 0709 12:20:27.406220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.480532 (+ 74312us) service_pool.cc:224] Handling call
0709 12:20:28.763918 (+1283386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:28.813396 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:28.425318 27687 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.814751 27687 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:28.433168 27688 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.815900 27688 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:28.818399 27688 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:28.434398 27686 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:28.467697 20174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.011s	sys 0.013s
W20260709 12:20:28.819164 20174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.011s	sys 0.013s
I20260709 12:20:28.820189 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1360) took 1412 ms. Trace:
I20260709 12:20:28.468151 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1333) took 5109 ms. Trace:
I20260709 12:20:28.434558 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:28.837198 20177 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
W20260709 12:20:29.044693 20177 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1367) took 1540 ms (client timeout 1941 ms). Trace:
W20260709 12:20:29.045257 20177 rpcz_store.cc:269] 0709 12:20:27.504362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.609255 (+104893us) service_pool.cc:224] Handling call
0709 12:20:29.044439 (+1435184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:28.872336 20294 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:29.050982 27688 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.052071 27688 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:28.607328 20171 consensus_meta.cc:287] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 1.111s	user 0.017s	sys 0.000s
I20260709 12:20:29.056095 20171 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
W20260709 12:20:29.056814 20171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1353) took 1651 ms (client timeout 1923 ms). Trace:
W20260709 12:20:29.057204 20171 rpcz_store.cc:269] 0709 12:20:27.405340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.458611 (+ 53271us) service_pool.cc:224] Handling call
0709 12:20:29.056744 (+1598133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:29.058658 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:28.833384 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.060986 20176 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 24: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:29.062151 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.063090 20176 raft_consensus.cc:2393] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 13: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:27.610361 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.065943 27439 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.066787 20180 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
W20260709 12:20:28.437371 20247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 1890) took 3510 ms (client timeout 2198 ms). Trace:
W20260709 12:20:29.070400 20247 rpcz_store.cc:269] 0709 12:20:24.927076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.955629 (+ 28553us) service_pool.cc:224] Handling call
0709 12:20:28.437117 (+3481488us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54003e9c54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:28.437277 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5390974336}
I20260709 12:20:28.857188 20248 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:29.071844 20171 raft_consensus.cc:2393] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:29.072937 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.073729 20171 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:29.074816 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:28.463160 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:28.862671 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:28.462411 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:28.801635 20252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1904) took 1751 ms. Trace:
I20260709 12:20:28.852221 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:28.662094 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 203009us
W20260709 12:20:28.636143 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.675s (SENT)
I20260709 12:20:28.699453 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4021) took 3708 ms. Trace:
I20260709 12:20:28.793882 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:28.820564 20174 rpcz_store.cc:276] 0709 12:20:27.407486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.614640 (+207154us) service_pool.cc:224] Handling call
0709 12:20:27.614924 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.615130 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:27.615726 (+   596us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.819763 (+1204037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:28.819834 (+    71us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:28.819889 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.819986 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.820125 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":2929,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":1203556,"threads_started":1,"wal-append.queue_time_us":293497}
I20260709 12:20:28.820863 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:28.821053 20178 rpcz_store.cc:276] 0709 12:20:23.358781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.361151 (+  2370us) service_pool.cc:224] Handling call
0709 12:20:25.950768 (+2589617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.955737 (+  4969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.467920 (+2512183us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b540016ab50. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:28.468064 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5930097920}
I20260709 12:20:28.765158 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1350) took 1360 ms. Trace:
W20260709 12:20:27.897222 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.920351 20220 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.014s (SENT)
I20260709 12:20:29.097648 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:27.829679 27652 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.102321 27652 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.909750 27588 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:29.105144 27588 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:28.819175 27686 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.110105 27686 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.110745 27686 raft_consensus.cc:2764] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 12:20:27.923648 27562 consensus_meta.cc:287] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.004s
W20260709 12:20:27.927095 27651 consensus_meta.cc:287] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.634s	user 0.003s	sys 0.007s
I20260709 12:20:27.455444 27648 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.130616 27588 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.131554 27588 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:29.132227 27588 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:29.132409 27648 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:28.471971 27334 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.134935 27334 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.137598 27334 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.091877 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:28.757966 27221 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:28.428164 27325 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.082683 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:28.866042 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:28.835855 27404 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.156410 27404 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:28.593360 21036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1637) took 1463 ms (client timeout 1697 ms). Trace:
I20260709 12:20:29.085189 27688 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:28.647408 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1643) took 1512 ms. Trace:
I20260709 12:20:28.433354 27432 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:28.848413 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.173720 21038 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:28.429250 21041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1768) took 2110 ms. Trace:
W20260709 12:20:28.678993 27681 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.780s	user 0.001s	sys 0.012s
W20260709 12:20:27.627537 27669 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:20:28.727246 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.889810 27645 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.909s	user 0.016s	sys 0.000s
I20260709 12:20:27.630240 27484 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.193464 27645 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:27.925719 27641 consensus_meta.cc:287] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.005s
I20260709 12:20:29.197569 27641 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.630650 27621 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:29.201252 27621 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:27.908278 27473 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:28.462563 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1639) took 1328 ms. Trace:
W20260709 12:20:28.811635 27680 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.145s	user 0.007s	sys 0.006s
W20260709 12:20:29.206121 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 771482us
I20260709 12:20:28.871529 27695 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:28.823043 27687 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:28.820446 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:28.866031 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.211210 27695 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.216243 20255 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:27.909505 27560 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:27.899904 27655 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:28.825809 27455 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:28.464200 27653 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:29.224229 27621 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.224130 27653 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.226073 27641 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:27.665354 27642 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:27.879617 27604 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:28.461567 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:28.718752 27499 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:28.462535 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:28.609514 20322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1704) took 1332 ms. Trace:
W20260709 12:20:28.410066 20324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2427) took 2290 ms (client timeout 2060 ms). Trace:
I20260709 12:20:28.490589 20327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1688) took 2178 ms. Trace:
I20260709 12:20:28.696218 27454 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:28.464974 27303 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:27.460832 27511 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:28.455631 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1646) took 1064 ms. Trace:
W20260709 12:20:28.459183 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.391449 27354 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:28.958040 27610 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.982043 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.021760 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:29.035490 27639 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.064762 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:29.047165 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.066926 27439 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.067427 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1366) took 1570 ms. Trace:
I20260709 12:20:29.075359 20171 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:29.084923 20251 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:29.085332 20253 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:29.086717 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:29.087302 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.123875 27651 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.084542 20252 rpcz_store.cc:276] 0709 12:20:27.050748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.051275 (+   527us) service_pool.cc:224] Handling call
0709 12:20:27.054634 (+  3359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.181866 (+127232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.181916 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.181981 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:27.182029 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.801320 (+1619291us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000d8254. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:28.801386 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.801560 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291963136}
I20260709 12:20:29.087767 20172 rpcz_store.cc:276] 0709 12:20:24.990771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.113373 (+1122602us) service_pool.cc:224] Handling call
0709 12:20:26.113675 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.503480 (+389805us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:26.511337 (+  7857us) log.cc:844] Serialized 14 byte log entry
0709 12:20:27.065793 (+554456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:27.065845 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:27.065903 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.699179 (+1633276us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400111a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:28.699226 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.699371 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10469,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":2465,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":27669,"spinlock_wait_cycles":895901952,"thread_start_us":549702,"threads_started":1,"wal-append.queue_time_us":632609,"wal-append.run_cpu_time_us":1145,"wal-append.run_wall_time_us":1034618}
I20260709 12:20:29.126544 20250 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
I20260709 12:20:29.088518 20173 raft_consensus.cc:2376] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20. Re-sending same reply.
I20260709 12:20:29.086277 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.138646 20178 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.139034 27221 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:29.093058 20179 rpcz_store.cc:276] 0709 12:20:27.404343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.433749 (+ 29406us) service_pool.cc:224] Handling call
0709 12:20:27.434251 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:27.447924 (+ 13673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.447957 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:27.448478 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:20:27.617283 (+168805us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:28.764561 (+1147278us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.764822 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.764913 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.764961 (+    48us) raft_consensus.cc:1685] finished
0709 12:20:28.764973 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.765099 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1266698,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":13209,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":8863,"thread_start_us":136746,"threads_started":1,"wal-append.queue_time_us":318489}
I20260709 12:20:29.089272 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.090878 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:28.893342 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1760) took 3844 ms. Trace:
I20260709 12:20:28.855089 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.298646 21042 raft_consensus.cc:2410] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:29.300112 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:29.300458 20174 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18. Re-sending same reply.
I20260709 12:20:29.301139 21042 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 22: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:29.161456 20249 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:29.301776 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.302024 20322 rpcz_store.cc:276] 0709 12:20:27.276863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.276996 (+   133us) service_pool.cc:224] Handling call
0709 12:20:28.609311 (+1332315us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003980d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:28.609448 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439986944}
I20260709 12:20:29.302974 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:29.304067 20249 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 22: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:29.305235 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.163978 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.306217 21039 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:29.161199 21036 rpcz_store.cc:269] 0709 12:20:27.129813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.129939 (+   126us) service_pool.cc:224] Handling call
0709 12:20:28.593065 (+1463126us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400406fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:28.593269 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591515904}
I20260709 12:20:29.180143 27652 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.173385 21035 rpcz_store.cc:276] 0709 12:20:27.135397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.151945 (+ 16548us) service_pool.cc:224] Handling call
0709 12:20:27.159219 (+  7274us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:27.159637 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:27.159665 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:27.180667 (+ 21002us) log.cc:844] Serialized 52 byte log entry
0709 12:20:27.318555 (+137888us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:27.461979 (+143424us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.647019 (+1185040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.647103 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.647148 (+    45us) raft_consensus.cc:1685] finished
0709 12:20:28.647160 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.647331 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":999342,"prepare.queue_time_us":46979,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1005429,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":8930,"thread_start_us":429449,"threads_started":3,"wal-append.queue_time_us":169245}
I20260709 12:20:29.182555 21038 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:20:29.134054 27588 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.177855 21041 rpcz_store.cc:276] 0709 12:20:26.318412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.318552 (+   140us) service_pool.cc:224] Handling call
0709 12:20:26.397991 (+ 79439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:26.555716 (+157725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.555763 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:26.556414 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 12:20:26.672141 (+115727us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:26.672202 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.428771 (+1756569us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400602f54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:28.428823 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.428878 (+    55us) raft_consensus.cc:1685] finished
0709 12:20:28.428895 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.429179 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26565,"raft.queue_time_us":5496,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":28701,"spinlock_wait_cycles":361607040,"thread_start_us":106810,"threads_started":1,"wal-append.queue_time_us":426571,"wal-append.run_cpu_time_us":2029,"wal-append.run_wall_time_us":1067209}
I20260709 12:20:29.189378 27697 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.189630 27614 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.311865 20329 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:29.199807 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.27941e+06us
W20260709 12:20:29.212308 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 288662us
I20260709 12:20:29.212635 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.205976 21034 rpcz_store.cc:276] 0709 12:20:27.134175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.134329 (+   154us) service_pool.cc:224] Handling call
0709 12:20:27.154996 (+ 20667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.155268 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:27.196667 (+ 41399us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.462219 (+1265552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:28.462275 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:28.462326 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.462394 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.462507 (+   113us) inbound_call.cc:177] Queueing success response
0709 12:20:28.677701 (+215194us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
Metrics: {"mutex_wait_us":933732,"prepare.queue_time_us":164479,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":938856,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":3407616,"thread_start_us":368591,"threads_started":2,"wal-append.queue_time_us":586971}
I20260709 12:20:29.218124 27695 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:28.574481 27616 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.304080 21040 rpcz_store.cc:276] 0709 12:20:27.391148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.391291 (+   143us) service_pool.cc:224] Handling call
0709 12:20:27.420285 (+ 28994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:27.420597 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:27.420994 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.455014 (+1034020us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b18002b6b40. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7d85c0a 00007f5de14c5219 00007f5dd7e0da40 00007f5dd7e084e4 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287 00007f5ddaf13208
0709 12:20:28.455187 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:28.455254 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:28.455311 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.455385 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.455546 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19212,"prepare.queue_time_us":19083,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":1040518,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":18797312}
I20260709 12:20:29.297844 21043 rpcz_store.cc:276] 0709 12:20:25.048520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.048784 (+   264us) service_pool.cc:224] Handling call
0709 12:20:25.909437 (+860653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.909690 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:26.083654 (+173964us) log.cc:844] Serialized 14 byte log entry
0709 12:20:26.500966 (+417312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.501021 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:26.501074 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.506474 (+  5400us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.893105 (+2386631us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540053b1d0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:28.893263 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187609,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":87522,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":20640,"spinlock_wait_cycles":1974727424,"thread_start_us":567085,"threads_started":3,"wal-append.queue_time_us":183400,"wal-append.run_cpu_time_us":2299,"wal-append.run_wall_time_us":1258338}
I20260709 12:20:29.306232 27511 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.322404 27610 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:20:29.323928 20220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.087s (SENT) [suppressed 24 similar messages]
I20260709 12:20:29.226883 27653 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.295717 27686 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.304708 27221 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.329186 27221 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.303296 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.331883 20174 raft_consensus.cc:2393] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:29.159385 27404 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.335072 27621 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.308414 20176 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:29.312400 27614 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.307832 27651 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.335857 27455 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:29.335824 27621 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.336583 27455 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.309813 27641 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.338397 27621 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.338217 27641 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.338862 27455 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.340637 27641 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.341293 20321 raft_consensus.cc:2410] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:29.341686 27511 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.320219 20249 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:29.342355 27511 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.295603 20180 rpcz_store.cc:276] 0709 12:20:27.497169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.609873 (+112704us) service_pool.cc:224] Handling call
0709 12:20:29.067354 (+1457481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:29.301810 27642 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:29.298092 20324 rpcz_store.cc:269] 0709 12:20:26.119216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.134448 (+ 15232us) service_pool.cc:224] Handling call
0709 12:20:28.409738 (+2275290us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400328054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:28.409950 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703950208}
I20260709 12:20:29.314553 21037 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:29.208587 27645 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.326776 20254 raft_consensus.cc:2410] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:29.316835 20247 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 11.
I20260709 12:20:29.327955 27686 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.341615 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.322170 20179 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:29.313258 20177 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
W20260709 12:20:29.314073 20173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60784 (request call id 1363) took 1852 ms (client timeout 2228 ms). Trace:
I20260709 12:20:29.343736 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.386461 20327 rpcz_store.cc:276] 0709 12:20:26.312371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.618591 (+306220us) service_pool.cc:224] Handling call
0709 12:20:26.618857 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.622875 (+  4018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.623673 (+   798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.623723 (+    50us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:26.623759 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.490296 (+1866537us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5400087fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:28.490359 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.490517 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8627584}
I20260709 12:20:29.402442 20180 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:29.405170 27511 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.407120 27686 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.389845 27697 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.371387 20176 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:29.397483 20253 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:20:29.408721 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:29.408913 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85046.1us
I20260709 12:20:29.396965 20251 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:29.412428 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:29.412667 27614 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.369560 20329 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:29.414379 20175 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:29.343998 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.417523 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:29.394134 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 307795us
I20260709 12:20:29.420315 27454 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:29.420938 20250 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:29.421118 27610 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:29.421481 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.420255 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:29.414958 20173 rpcz_store.cc:269] 0709 12:20:27.461801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.503899 (+ 42098us) service_pool.cc:224] Handling call
0709 12:20:29.309134 (+1805235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:29.417380 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 208656us
I20260709 12:20:29.422714 20178 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:29.424093 20252 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:29.426012 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:29.426931 20175 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:29.432611 20174 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:29.435554 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:29.436282 27439 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.439095 20328 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:20:29.440722 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 804533us
I20260709 12:20:29.443655 27653 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:29.444259 27653 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:29.445536 27653 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.449261 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:29.451093 27454 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:29.451545 27454 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.416180 27639 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.451983 27454 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:29.453076 27645 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:29.453514 27645 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.453753 27639 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.453949 27645 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.457089 27697 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:29.458918 20220 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.522s (SENT)
I20260709 12:20:29.425566 27641 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:20:29.464139 27454 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.451205 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:29.466661 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:29.468151 27561 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:29.471760 27561 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:29.473060 27561 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.476094 27697 raft_consensus.cc:2764] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:20:29.478416 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.479127 21034 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:29.436738 20248 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:29.483453 20171 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:20:29.500640 20220 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.535s (SENT)
W20260709 12:20:29.502018 20328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2426) took 3383 ms (client timeout 1591 ms). Trace:
W20260709 12:20:29.502436 20328 rpcz_store.cc:269] 0709 12:20:26.118909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.119383 (+   474us) service_pool.cc:224] Handling call
0709 12:20:29.501743 (+3382360us) spinlock_profiling.cc:243] Waited 3.29 s on lock 0x7b54002da5d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:29.501901 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7564775808}
I20260709 12:20:29.494360 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:29.508004 27700 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:29.509290 20219 leader_election.cc:400] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20.
I20260709 12:20:29.509634 20219 leader_election.cc:403] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:20:29.510762 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.228s (SENT)
I20260709 12:20:29.511853 27610 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20.
I20260709 12:20:29.517338 27560 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:29.518018 27560 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:29.519809 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800298dc0 after lost signal to thread 18964
W20260709 12:20:29.521389 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800278600 after lost signal to thread 20112
I20260709 12:20:29.521494 27560 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.492034 27454 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:29.530798 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 49808.7us
I20260709 12:20:29.532155 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1361) took 2077 ms. Trace:
I20260709 12:20:29.505975 27641 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.536047 27641 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.538776 27641 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.535789 20179 rpcz_store.cc:276] 0709 12:20:27.454901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.306127 (+1851226us) service_pool.cc:224] Handling call
0709 12:20:29.306604 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.416071 (+109467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.531859 (+115788us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54002369d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:29.532085 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29944576}
I20260709 12:20:29.522183 27560 consensus_queue.cc:1059] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:29.541612 27354 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:29.562693 20072 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:29.564383 20072 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 17 to 18, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 18 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.566320 20072 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 16 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 17 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.567867 27354 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:29.569020 27354 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.576530 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.577471 20248 raft_consensus.cc:2410] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:29.584812 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:29.586447 27454 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:29.586966 27454 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:29.587064 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.590937 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.591182 27473 raft_consensus.cc:3055] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:20:29.587863 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.591751 27473 raft_consensus.cc:740] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:29.588642 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.588403 21034 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:20:29.592828 27473 consensus_queue.cc:260] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.580909 27700 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:29.593410 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72209.2us
I20260709 12:20:29.594290 27473 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.591243 21040 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:29.590427 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.589989 27454 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.595492 21043 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:29.593978 27700 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.589956 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.596457 21041 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
W20260709 12:20:29.597483 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800328420 after lost signal to thread 20204
I20260709 12:20:29.597795 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:29.603639 21037 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 24.
W20260709 12:20:29.606240 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 114363us
I20260709 12:20:29.605711 20072 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:29.607803 20072 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 14 to 15, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:29.610527 20220 connection.cc:256] RPC call timeout handler was delayed by -1.8598734430001969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 12:20:29.610119 20072 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 9, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.614259 20072 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 14 to 16, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:29.616392 27700 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.617892 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.619412 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:29.621702 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:29.622465 21034 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:29.622545 21040 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:29.624601 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.625975 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.626569 21041 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:29.627503 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.627950 20255 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:29.628429 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.628602 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.630455 21041 raft_consensus.cc:2410] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:20:29.632324 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.632472 20328 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:29.633114 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.634168 27645 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:29.640791 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.642328 20248 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:20:29.642735 20248 pending_rounds.cc:85] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 14
I20260709 12:20:29.643252 20248 pending_rounds.cc:107] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:20:29.643580 20248 raft_consensus.cc:2889] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:29.644721 20324 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:29.616420 20072 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 15 to 16, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 16 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:29.635030 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.911s (SENT)
W20260709 12:20:29.647589 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.041s (SENT)
I20260709 12:20:29.628132 21034 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:29.642328 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:29.656561 20201 debug-util.cc:398] Leaking SignalData structure 0x7b080014e020 after lost signal to thread 20280
I20260709 12:20:29.659830 20237 tablet_service.cc:1558] Processing DeleteTablet for tablet ae0621ca652d416d9284323ec7eb2363 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:36730
W20260709 12:20:29.612243 20220 connection.cc:256] RPC call timeout handler was delayed by -1.7668211750001319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:20:29.661746 20220 connection.cc:256] RPC call timeout handler was delayed by -1.7083372629999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2969s for a response
W20260709 12:20:29.662230 20220 connection.cc:256] RPC call timeout handler was delayed by -1.6462372629998754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3038s for a response
W20260709 12:20:29.662613 20220 connection.cc:256] RPC call timeout handler was delayed by -1.5343871400000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 12:20:29.662984 20220 connection.cc:256] RPC call timeout handler was delayed by -1.3247862280002209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.323s for a response
I20260709 12:20:29.665458 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.650213 20072 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 14 to 15, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:29.682703 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.690637 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.693311 20072 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 11, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 11 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:29.698565 20078 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 321) took 44444 ms (client timeout 15000 ms). Trace:
W20260709 12:20:29.699057 20078 rpcz_store.cc:269] 0709 12:19:45.253629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.253898 (+   269us) service_pool.cc:224] Handling call
0709 12:20:29.698230 (+44444332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1027972,"reported_tablets":48}
I20260709 12:20:29.683100 27700 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:29.703908 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:29.694434 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:29.705821 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:29.707888 21041 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.715896 21040 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:29.717044 27700 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:29.721866 20201 debug-util.cc:398] Leaking SignalData structure 0x7b0800412e60 after lost signal to thread 20354
I20260709 12:20:29.723876 20248 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:29.725037 20253 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:29.713419 20324 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:29.725528 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:29.730757 20201 debug-util.cc:398] Leaking SignalData structure 0x7b08002599c0 after lost signal to thread 21072
I20260709 12:20:29.732375 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:29.733011 27610 consensus_queue.cc:1048] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:29.735791 27699 consensus_queue.cc:1059] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:29.737112 27686 raft_consensus.cc:3055] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:29.737244 27645 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:29.737581 27686 raft_consensus.cc:740] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:29.738726 27561 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:29.738613 27686 consensus_queue.cc:260] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.739125 27561 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.739835 27561 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.742205 27560 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:29.743937 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:29.744716 27697 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:29.746232 27697 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:29.711891 20072 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 7 to 8, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 8 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:29.751098 20072 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.753182 20072 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 9 to 10, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 10 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:29.754508 20072 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 15 to 16, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 16 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:29.755414 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.756026 20220 leader_election.cc:400] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:29.756433 20220 leader_election.cc:403] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:20:29.756577 27700 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:29.758839 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.759621 27616 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:29.762161 20327 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:29.762296 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.760699 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:29.782196 20328 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:29.785179 20255 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:20:29.797103 27610 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.792935 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.798024 20321 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:29.797823 27610 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.798694 27699 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.799147 20253 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:29.799342 27699 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.800149 27610 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:29.797359 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.801417 27699 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.776947 27588 consensus_queue.cc:1048] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:20:29.805913 20219 connection.cc:256] RPC call timeout handler was delayed by -2.7320399789998646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 12:20:29.795898 20072 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 15 to 16, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 16 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
W20260709 12:20:29.807387 20219 connection.cc:256] RPC call timeout handler was delayed by -2.5897012610000729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 12:20:29.809481 20219 connection.cc:256] RPC call timeout handler was delayed by -2.31353997899987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:20:29.809859 20219 connection.cc:256] RPC call timeout handler was delayed by -2.0307023459999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:20:29.810160 20219 connection.cc:256] RPC call timeout handler was delayed by -1.912802346000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:20:29.810436 20219 connection.cc:256] RPC call timeout handler was delayed by -1.7625023460000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:20:29.810696 20219 connection.cc:256] RPC call timeout handler was delayed by -1.4304023459999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 12:20:29.811043 20219 connection.cc:256] RPC call timeout handler was delayed by -1.1984399789998861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3326s for a response
I20260709 12:20:29.767318 27561 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.818360 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.819636 27639 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.820185 27639 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.804852 27697 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:29.806488 27354 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:29.831961 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6082048430000668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 12:20:29.832543 20144 connection.cc:256] RPC call timeout handler was delayed by -2.5992048430000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 12:20:29.839697 20144 connection.cc:256] RPC call timeout handler was delayed by -2.4084048430001985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 12:20:29.840088 20144 connection.cc:256] RPC call timeout handler was delayed by -2.3562048430001141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:20:29.840703 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1771048430000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
I20260709 12:20:29.827504 27439 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.843900 20321 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:29.841606 27686 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:29.856220 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1771048430000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 12:20:29.856820 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1465048430000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 12:20:29.856947 21041 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:29.860000 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:29.861579 20144 connection.cc:256] RPC call timeout handler was delayed by -2.081704843000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 12:20:29.862002 20144 connection.cc:256] RPC call timeout handler was delayed by -2.0331048430000465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 12:20:29.866096 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.869395 20072 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:29.871366 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:29.870230 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48039.6us
W20260709 12:20:29.872153 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 111583us
I20260709 12:20:29.871363 27700 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:29.873492 20219 leader_election.cc:400] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20.
I20260709 12:20:29.860265 27439 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:29.899166 27714 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:20:29.902371 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60229.3us
I20260709 12:20:29.907084 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:29.907444 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.917153 20327 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:29.908023 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.908123 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:29.908226 20324 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:20:29.908735 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:29.909053 27639 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.871622 27697 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:29.909833 20322 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:29.910902 27439 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.911453 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.933327 20325 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:29.912375 20323 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:29.912784 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:29.934917 20330 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.936173 27561 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.919476 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:29.937031 20326 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:29.938839 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d963e0e1da434f887fc330570683e5"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:29.939406 20326 raft_consensus.cc:606] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.939894 20326 raft_consensus.cc:614] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:29.927870 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:29.943459 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:29.946252 20326 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.939894 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:29.948192 21038 raft_consensus.cc:1813] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Handling vote request from an unknown peer 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:29.948891 21038 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:29.945760 27697 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:29.949767 27697 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:29.950140 27697 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:29.956954 27686 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:29.957562 20321 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 24.
I20260709 12:20:29.958583 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:29.959230 27645 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:29.961944 27645 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.962318 27439 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.961341 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:29.945222 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.962904 27439 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.962319 27645 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:29.964416 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:29.966264 27699 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:29.965091 27686 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:29.966763 27699 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:29.967522 27511 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:29.968227 27511 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.968672 27511 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:29.967888 27699 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.972283 27439 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:29.962643 20326 raft_consensus.cc:606] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:29.979740 20326 raft_consensus.cc:614] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:29.983966 27700 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:29.984440 27700 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:29.984968 27700 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:29.985096 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:29.988651 20321 raft_consensus.cc:606] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:29.995895 20321 raft_consensus.cc:614] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:29.991214 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.521s (SENT)
W20260709 12:20:29.984404 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 77427.5us
I20260709 12:20:30.006237 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:30.007143 27473 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:20:30.019723 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48302.8us
I20260709 12:20:30.021602 27641 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:30.022300 27641 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.993657 27697 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:29.983965 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:29.979472 27645 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:29.998425 27700 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.030742 21035 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:29.921343 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:30.031988 27645 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:30.032351 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 162828us
I20260709 12:20:30.033123 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.033732 27439 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:30.033905 27639 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:30.034391 27639 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.034786 27639 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.034813 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:30.000121 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 78537.4us
I20260709 12:20:30.002315 20063 catalog_manager.cc:5028] TS e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): tablet ae0621ca652d416d9284323ec7eb2363 (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:20:30.001876 20072 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:30.045053 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 61177.9us
I20260709 12:20:30.046643 20072 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 8 to 9, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 9 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:30.053490 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:30.055697 20072 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 15 to 16, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 16 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.057813 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.058102 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.058404 20178 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:30.058775 20253 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:30.059358 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.058102 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:30.062757 20248 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:30.058737 20072 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 10 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 14 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:30.034391 27641 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.044783 27700 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.048796 27221 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:30.082010 27221 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:30.082506 27221 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.082593 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:30.083534 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:30.084604 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 49927.9us
I20260709 12:20:30.084784 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.085577 20177 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 13: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:30.086302 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:30.088172 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.088973 20179 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:20:30.088819 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.089498 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.089749 20178 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:30.093408 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.095690 20180 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 26.
I20260709 12:20:30.094345 20171 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:30.097702 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:30.098377 20251 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:30.098385 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.046593 27511 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.105332 27511 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.087077 27439 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:30.103156 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:30.110230 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.111120 20255 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:30.103652 27616 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:30.115720 27561 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:30.120223 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.121868 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:30.124269 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:30.125512 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.129771 20251 raft_consensus.cc:2468] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:30.130097 27439 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:30.135638 27697 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:30.137302 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.138593 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:30.139353 20247 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.139549 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:30.139997 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.140198 20249 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.142438 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.143103 20251 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:30.143803 27616 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.145244 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.145917 20248 raft_consensus.cc:1813] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Handling vote request from an unknown peer 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:30.146027 27616 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:30.147042 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:30.147310 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:30.147751 20256 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.148437 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.149299 27655 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:30.149662 27655 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.150218 27655 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:30.150372 27641 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:30.150869 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 56051.9us
I20260709 12:20:30.153787 20249 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:30.138710 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:30.157100 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.146504 20248 raft_consensus.cc:2410] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:30.149629 20294 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:30.160281 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 48823.3us
I20260709 12:20:30.233084 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:30.197741 20247 raft_consensus.cc:2468] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:30.182621 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.213066 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.290935 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.197305 20256 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:30.236431 20254 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:30.210872 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:30.183933 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:30.172865 20321 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:30.204957 20177 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:30.292560 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.180238 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.234045 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:30.181595 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.314543 20251 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.309852 20172 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.210254 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.160748 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.316550 20255 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:30.314857 20325 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 24.
I20260709 12:20:30.210606 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:30.329882 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 180327us
I20260709 12:20:30.330688 20328 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:30.331648 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:30.180657 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:30.333300 20330 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:30.333957 20322 raft_consensus.cc:2393] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:30.332617 20180 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:30.344611 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:30.175310 27724 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 12:20:30.181092 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.222118 27221 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.325701 27641 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:30.354537 20326 raft_consensus.cc:2368] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
W20260709 12:20:30.359316 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.679s (SENT)
I20260709 12:20:30.360226 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.361702 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.367844 27687 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:30.368631 27221 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.372439 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.373420 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:30.374044 20253 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.345631 20324 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:30.373432 20250 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:30.376281 20247 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:30.239077 27639 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.378185 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.362913 27645 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:30.365353 27641 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.390307 20180 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:30.353180 27511 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:20:30.395095 20180 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:30.401294 27639 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:30.397071 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:30.403585 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.404412 27697 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:30.404582 20326 raft_consensus.cc:2410] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:20:30.405000 27697 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:30.405743 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:30.406172 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.406419 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.405999 27697 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.408452 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.408581 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.409840 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.411984 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.413353 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:30.402899 20176 raft_consensus.cc:2368] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:30.414012 20175 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:30.415374 21007 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:30.420854 20251 raft_consensus.cc:2468] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 15.
I20260709 12:20:30.418071 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.426962 27616 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:30.431644 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:30.432457 20177 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.436134 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:30.440243 27687 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.440788 27687 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.460258 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:30.461395 27727 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:30.461867 27727 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.462248 27727 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.381532 27645 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:30.468520 20253 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:20:30.464789 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46784.3us
I20260709 12:20:30.473433 20172 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:30.475524 20330 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:30.477553 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:30.468677 20180 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.481933 20180 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:30.484155 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 136825us
W20260709 12:20:30.485292 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 399079us
I20260709 12:20:30.489004 27655 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.491724 20326 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
W20260709 12:20:30.491820 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 76576.3us
I20260709 12:20:30.491991 27641 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.475083 27645 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.493642 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:30.493038 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:30.474982 27588 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:30.475214 27687 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.482016 27354 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:30.500514 20325 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:30.530759 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:30.533247 27697 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:30.526928 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.534282 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:30.497409 27588 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.544906 20177 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:30.546825 20175 raft_consensus.cc:2468] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:30.535403 20219 leader_election.cc:400] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:30.485147 27725 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:20:30.553982 20219 leader_election.cc:403] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:30.531553 27686 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:30.532279 27561 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:30.548197 27588 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:30.583943 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.584335 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:30.585863 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 99164.1us
I20260709 12:20:30.584277 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.560860 27687 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:30.571177 27686 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.588055 27354 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:30.585315 20252 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:30.589007 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.582497 27511 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:20:30.593422 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45524.4us
I20260709 12:20:30.585860 27616 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
W20260709 12:20:30.598124 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 62860.3us
I20260709 12:20:30.600533 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:30.590112 27687 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.594029 27686 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:30.603199 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.607978 20327 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:30.597357 27729 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:30.613716 27741 log.cc:927] Time spent T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:20:30.597680 27511 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:30.605193 27687 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:30.623363 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.624859 27641 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.616092 27697 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:30.620973 27439 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:30.663703 27439 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:30.663955 27748 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:30.663751 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.665953 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.620779 27561 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:30.664326 27439 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.621826 27511 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:30.615393 27729 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:30.670782 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:30.680847 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 78177.3us
I20260709 12:20:30.684769 20180 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:30.635308 27655 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:30.693473 27737 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:20:30.684159 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:30.661983 27697 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.671355 27639 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:30.707516 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 63355.1us
I20260709 12:20:30.669097 27725 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.681712 27729 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:30.706605 27740 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 12:20:30.715029 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 180843us
I20260709 12:20:30.716078 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.704926 27697 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.704977 27473 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:30.724417 27752 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:30.724874 27752 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.725195 27752 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.728464 27751 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:30.728967 27751 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.729357 27751 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:30.726293 27511 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.684643 27561 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:30.720247 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52080us
I20260709 12:20:30.706960 27639 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:30.712173 27655 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:30.740625 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.745213 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:30.746387 27739 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
I20260709 12:20:30.747049 27754 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:30.747507 27754 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.747848 27754 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.748329 27747 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:30.668382 27354 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.751752 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:30.741842 27639 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.756750 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:30.761567 20326 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:30.742901 27655 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:30.749929 27747 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:30.762704 20327 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:30.731370 27511 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.768363 20251 raft_consensus.cc:1240] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:30.775501 20327 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:30.776311 20330 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:20:30.766649 27747 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:30.784590 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66803.4us
I20260709 12:20:30.769271 27645 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.795951 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:30.800395 27743 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 12:20:30.801191 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:30.802073 21035 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:30.803792 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:30.804318 21041 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 19: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:30.794412 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 84912.8us
I20260709 12:20:30.815924 27757 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.825261 27645 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.786852 27747 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.828012 20295 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:30.833766 21038 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:30.844226 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:30.845125 21040 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
W20260709 12:20:30.847297 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 135907us
I20260709 12:20:30.873163 27588 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.834980 27748 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:20:30.849509 27756 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:30.826125 27727 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.877712 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.826020 27751 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.712666 27725 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.726292 27729 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.881770 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:30.889207 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:30.816527 27757 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.899114 21041 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:30.899887 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:30.894025 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.902458 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 218409us
I20260709 12:20:30.904726 27729 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.905158 27725 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.905427 27729 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:30.902091 27760 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:30.905860 27729 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:30.906044 27760 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:30.906345 27729 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:30.906497 27760 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:30.908499 27697 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.910447 27757 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.910802 27751 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:30.911866 20249 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:30.912850 27727 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:30.891741 27639 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.922868 27639 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:30.923089 27641 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:30.923517 27641 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:30.910749 27697 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.924397 27641 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.925645 27641 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:30.936576 27750 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:30.937475 21041 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:30.939208 27588 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:30.889991 27756 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:30.947402 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:30.951310 20294 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:30.952565 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:30.887401 27754 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.944643 27561 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.918701 27686 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.945016 27756 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:30.980223 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 111146us
I20260709 12:20:30.976745 21007 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:20:30.982788 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.983713 27749 raft_consensus.cc:2764] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 12:20:30.984217 27745 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:30.984719 27745 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:30.985175 27745 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:30.990549 27221 raft_consensus.cc:2804] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:30.991148 27221 raft_consensus.cc:697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:30.992240 27221 consensus_queue.cc:237] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:30.999970 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.005465 27752 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.004709 27760 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:30.945641 27687 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.008623 20325 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:31.009627 27687 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:31.005864 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 60568.5us
I20260709 12:20:31.012174 27655 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.013597 27655 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:31.014572 27760 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.013499 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:31.016072 27588 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:31.016557 27588 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.016953 27588 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:31.021149 27686 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.025599 27588 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.029599 27754 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.035068 27745 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:30.971205 27645 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:30.950737 27354 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 12:20:31.036162 27645 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:31.040388 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.003100 27439 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:31.071623 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 87895.5us
I20260709 12:20:31.077280 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:31.078985 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:31.080375 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52229.9us
I20260709 12:20:31.082479 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:31.091609 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 136041us
I20260709 12:20:30.982951 27561 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.075902 27588 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.098770 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.083884 27752 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:31.051257 27645 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.076066 27729 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.081224 27473 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:20:31.105253 20295 leader_election.cc:400] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:31.118036 20295 leader_election.cc:403] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:31.085384 27354 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 12:20:31.130796 21043 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:31.090226 27754 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:20:31.134254 27759 raft_consensus.cc:993] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:31.135994 27771 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:31.136519 27771 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.136850 27771 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:31.095122 27760 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:20:31.140828 27760 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:31.141158 27729 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.143000 20295 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:31.144080 20295 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:31.148224 27752 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.148931 27745 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.092132 27639 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:20:31.151556 27768 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:31.152413 27473 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.135999 27439 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.187927 27473 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.123541 27749 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 12:20:31.190861 27766 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:20:31.156260 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:31.192127 20174 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.158464 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:31.175405 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 84739.7us
I20260709 12:20:31.182272 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:31.193017 20180 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:31.193198 20173 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:20:31.193288 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 99284.2us
I20260709 12:20:31.185492 27729 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.152393 27687 raft_consensus.cc:2804] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:31.204301 20255 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:20:31.206516 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:31.209547 20330 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 26. Current term is 27. Ops: []
I20260709 12:20:31.212436 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:31.213696 20180 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 27.
I20260709 12:20:31.218914 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:31.219640 20175 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.221848 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:31.222496 20177 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.228096 20175 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:31.229772 20327 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:20:31.233664 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:31.230825 20177 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:31.237367 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:31.238451 20330 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 21: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:31.245613 21043 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:31.152343 27770 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 12:20:31.191679 27768 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.250530 20253 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:31.252195 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 150626us
I20260709 12:20:31.184899 27771 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.258435 20249 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:31.191905 27748 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:20:31.265491 20176 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:31.266947 20177 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:31.248595 27511 raft_consensus.cc:1081] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:31.274516 20219 leader_election.cc:400] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:31.259819 27745 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:31.208431 27729 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.280833 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:31.247170 27757 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
W20260709 12:20:31.287952 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75601.7us
I20260709 12:20:31.196280 27756 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.288585 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:31.289757 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:31.292186 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:31.268615 27748 consensus_queue.cc:1243] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:31.292987 20322 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:31.294736 20323 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:31.293979 20326 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 22: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:31.296974 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:31.299173 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 99479us
I20260709 12:20:31.299750 27757 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.299688 27616 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:31.300052 20294 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.300450 27757 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.300683 27610 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:31.302726 27757 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.269179 27747 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.316356 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.317662 20328 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:31.294296 27766 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:20:31.319254 27751 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:31.327888 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:31.328855 27771 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:31.358829 20329 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 25: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:31.315282 27778 raft_consensus.cc:993] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:31.362216 20173 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 25.
I20260709 12:20:31.368033 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:31.369933 20328 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:31.310508 27749 consensus_queue.cc:1059] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:20:31.382717 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:31.383700 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:31.385967 27760 consensus_queue.cc:1059] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:31.386868 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:31.388284 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.389955 20322 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:31.396757 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 80485.9us
I20260709 12:20:31.402102 20294 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.361498 27687 raft_consensus.cc:697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.387673 27755 consensus_queue.cc:1059] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:20:31.380944 27561 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:31.406435 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:31.391386 27473 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.385979 20173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:31.431277 20173 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.431770 20173 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:31.412194 27439 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.414932 27775 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:31.436308 27752 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:31.406324 27757 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:31.415545 27767 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 12:20:31.416606 27777 log.cc:927] Time spent T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:20:31.437758 27729 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.439024 27639 raft_consensus.cc:3055] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:31.439450 27639 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:31.440335 27639 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.443723 20173 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.446527 20173 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.425325 27770 raft_consensus.cc:3055] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:31.454422 27770 raft_consensus.cc:740] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:31.455549 27770 consensus_queue.cc:260] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.457198 27770 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:31.361896 27776 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.164s
W20260709 12:20:31.426337 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.428337 27756 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:31.402809 27221 raft_consensus.cc:1081] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:31.429750 27747 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:31.316808 27768 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.406385 27641 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.446708 27757 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.464243 27757 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.466495 27757 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.466368 27687 consensus_queue.cc:237] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.447927 27725 raft_consensus.cc:3055] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:31.467509 27725 raft_consensus.cc:740] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:31.468597 27725 consensus_queue.cc:260] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.470198 27725 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.470786 27751 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.471843 27751 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.450773 27755 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:31.420714 27769 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:31.436340 27439 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.451853 27686 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:20:31.475975 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69671us
I20260709 12:20:31.476209 27786 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:20:31.450255 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:31.478567 20174 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:31.480216 27729 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.484578 20322 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
W20260709 12:20:31.488008 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 122316us
I20260709 12:20:31.488389 20321 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
W20260709 12:20:31.493288 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.494971 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:31.521468 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 119411us
W20260709 12:20:31.523202 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:31.527526 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 221797us
I20260709 12:20:31.520351 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:31.535249 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.087s (SENT)
I20260709 12:20:31.542979 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:31.543977 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.606s (SENT)
I20260709 12:20:31.544713 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:31.538757 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 230739us
W20260709 12:20:31.535197 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 85014.3us
I20260709 12:20:31.493714 27769 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:31.548759 27221 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:31.554510 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.553248 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:31.549105 20295 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:31.558578 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.572011 20325 raft_consensus.cc:1240] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:20:31.575089 27511 consensus_queue.cc:1059] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:31.546455 27645 raft_consensus.cc:2804] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:31.595880 27221 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.576478 27768 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:31.575718 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.573712 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:31.553822 27686 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:31.574482 27776 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:31.634418 27221 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.636575 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:31.546463 27610 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:31.541013 27729 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.540406 27786 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.540665 27616 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:31.614298 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 70384.1us
W20260709 12:20:31.631848 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 96631.3us
I20260709 12:20:31.632706 27641 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.633147 27439 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.633512 27790 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:31.633931 27787 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:20:31.638783 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82657.9us
W20260709 12:20:31.653755 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 80150.2us
W20260709 12:20:31.641408 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 65811.2us
I20260709 12:20:31.646725 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:31.640951 27768 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.644222 27686 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:31.642624 27776 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.643589 27756 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:31.654345 27641 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.653594 27645 raft_consensus.cc:697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.679868 20294 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.654088 27727 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.690780 20294 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.691901 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:31.692314 20173 pending_rounds.cc:85] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 13
I20260709 12:20:31.692660 20173 pending_rounds.cc:107] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:20:31.692961 20173 raft_consensus.cc:2889] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:31.694779 20324 raft_consensus.cc:2410] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 12:20:31.695055 21008 leader_election.cc:336] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.638s (SENT)
I20260709 12:20:31.682235 27752 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:31.697026 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:31.699185 20251 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:31.704269 20255 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:31.694929 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:31.707479 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.707679 20180 raft_consensus.cc:2368] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:31.702193 20249 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:31.661154 27749 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:20:31.655829 27616 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.700903 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:31.701550 27748 raft_consensus.cc:2804] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:31.718052 27768 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.718084 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:31.723129 20176 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:31.723608 20176 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.694036 27759 raft_consensus.cc:2804] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:31.728714 27729 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.692986 27561 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 12:20:31.682552 27793 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.709975 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:31.730217 20252 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.690013 27727 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.733144 27727 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.714895 20177 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 21. Ops: []
I20260709 12:20:31.728827 27641 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.739537 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:31.707090 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.741765 20330 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 21. Current term is 22. Ops: []
W20260709 12:20:31.750005 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 199508us
I20260709 12:20:31.752426 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:31.744179 20176 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.757090 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:31.758673 20252 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:31.715278 27752 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.760037 20219 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:31.681458 27786 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 26.21, Last appended by leader: 21, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:31.775887 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 75080.4us
I20260709 12:20:31.750386 27771 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:31.778806 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:31.776705 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:31.779695 20328 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:31.767606 27749 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:31.751039 27759 raft_consensus.cc:697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.761971 27747 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:31.761816 27725 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:31.762194 27793 raft_consensus.cc:2764] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:20:31.779036 27610 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:31.784472 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 89448.2us
W20260709 12:20:31.785583 27794 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:20:31.785717 27697 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:31.767439 27776 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.760623 27748 raft_consensus.cc:697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:31.819181 20176 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:31.750310 27354 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 26.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.031s
I20260709 12:20:31.819478 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:31.781872 20294 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.821607 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:31.831307 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.798s (SENT)
I20260709 12:20:31.775043 27745 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:20:31.844561 20321 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:31.853001 20220 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.550s (SENT)
I20260709 12:20:31.820238 27781 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:31.784489 27639 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:31.832589 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 96797.4us
I20260709 12:20:31.820322 27725 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.855479 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.858048 20220 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:31.835748 27795 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.195s	user 0.003s	sys 0.000s
I20260709 12:20:31.835309 27697 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:20:31.869686 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87924.3us
I20260709 12:20:31.848259 27610 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:31.775367 27645 consensus_queue.cc:237] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.892455 27805 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:31.893003 27805 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.893360 27805 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.895356 27759 consensus_queue.cc:237] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.901223 27686 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:31.901366 27748 consensus_queue.cc:237] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.904345 27697 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:31.905855 27697 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.865805 27725 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:31.909327 27793 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.909876 27793 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:31.912338 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81073.2us
I20260709 12:20:31.912173 27610 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:31.913002 21008 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.869s (SENT)
W20260709 12:20:31.913921 21008 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.912s (SENT)
I20260709 12:20:31.914317 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.833247 27792 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.190s
I20260709 12:20:31.764140 27799 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.105s
W20260709 12:20:31.919209 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46480.7us
I20260709 12:20:31.859791 27781 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:31.867415 27768 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:31.778774 27752 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:31.927829 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:31.953615 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:31.952852 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 185665us
I20260709 12:20:31.920295 27745 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:31.960430 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:31.956238 27761 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:20:32.003844 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:31.932307 27781 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:32.010473 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50548.3us
I20260709 12:20:32.019642 27616 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:31.950346 27354 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.027460 27561 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:32.044907 27745 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
W20260709 12:20:32.049479 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 227951us
I20260709 12:20:32.051779 20219 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:32.028997 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 176025us
I20260709 12:20:32.007627 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:32.033106 27588 raft_consensus.cc:3055] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:32.036517 27473 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:20:32.037557 20295 leader_election.cc:400] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:32.070727 20295 leader_election.cc:403] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:32.006278 27768 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.037679 27686 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:32.037765 27756 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:32.038177 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.039191 20173 raft_consensus.cc:3055] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:32.039011 27769 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.040684 27786 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:32.041994 20177 raft_consensus.cc:1240] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:32.080166 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:31.960189 27751 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:32.003877 27771 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:32.046236 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.047089 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 133182us
I20260709 12:20:32.048976 27561 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:32.061064 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:32.073393 27616 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:32.080991 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:32.078604 20180 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:20:32.083422 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.084791 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:32.088660 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.092099 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.923s (SENT)
I20260709 12:20:32.081063 27687 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:32.071226 27588 raft_consensus.cc:740] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:32.078733 27792 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:32.101148 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:32.070457 27473 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:32.077471 20173 raft_consensus.cc:740] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:32.073810 27793 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:32.108698 20248 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 22: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:32.108309 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:32.060258 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52774.6us
I20260709 12:20:32.087743 27759 consensus_queue.cc:1059] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:20:32.121625 20176 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:32.120476 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:32.123557 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:32.129209 20254 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 25: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:32.090209 27769 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:32.089457 27812 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:32.083046 27799 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:20:32.136044 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:32.141336 20253 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
W20260709 12:20:32.143239 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.135252 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:32.142805 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:32.143277 20250 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:32.145145 21043 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:32.089310 27760 consensus_queue.cc:1059] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:20:32.144461 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:32.112217 27616 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:32.114974 27792 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.151464 20173 consensus_queue.cc:260] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.153949 20294 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:32.110505 27729 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:20:32.167464 20254 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:32.171587 21043 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:32.166065 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:32.133086 27354 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:32.174767 20173 raft_consensus.cc:3060] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.176295 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:32.177729 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.941s (SENT)
I20260709 12:20:32.177148 21035 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:32.181989 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:32.190912 20256 raft_consensus.cc:2410] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:32.164449 27793 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:32.194058 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59502.9us
W20260709 12:20:32.194126 21008 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.973s (SENT)
I20260709 12:20:32.165028 27760 raft_consensus.cc:3055] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:32.205518 27760 raft_consensus.cc:740] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:32.206522 27760 consensus_queue.cc:260] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.207928 27760 raft_consensus.cc:3060] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:32.211127 20220 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.534s (SENT)
I20260709 12:20:32.211608 20220 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:32.212867 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.545s (SENT)
I20260709 12:20:32.213295 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:32.168875 27792 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.162536 27759 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:20:32.135892 27803 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 12:20:32.196547 27793 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:32.191509 27639 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.193725 27561 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.194233 27354 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:32.149551 27745 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
W20260709 12:20:32.243893 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.182s (SENT)
I20260709 12:20:32.244477 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:32.197297 27588 consensus_queue.cc:260] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.199224 27473 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 26.21, Last appended by leader: 21, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.245831 27588 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.147253 27812 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.249511 27812 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:32.254602 27805 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.185750 27748 raft_consensus.cc:2804] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:32.222441 20250 raft_consensus.cc:2468] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:32.218824 27610 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:32.223276 27793 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.243007 27354 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.245889 27473 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:32.204118 27616 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.257177 27561 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:32.166353 27783 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:20:32.265211 27755 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.291953 20255 raft_consensus.cc:2368] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:32.266726 27745 consensus_queue.cc:1243] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:20:32.266989 27749 consensus_queue.cc:1059] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:32.231053 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:32.268862 27687 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
W20260709 12:20:32.273276 27796 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.640s	user 0.004s	sys 0.000s
I20260709 12:20:32.289563 27697 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:32.220752 27799 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.299145 20324 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 26. Current term is 27. Ops: []
I20260709 12:20:32.300582 20173 raft_consensus.cc:1275] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:20:32.301229 27803 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:32.328251 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.301656 27561 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.330118 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.329952 27561 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.307893 27749 consensus_queue.cc:1243] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:20:32.312602 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 94294.9us
W20260709 12:20:32.313638 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.586s (SENT)
I20260709 12:20:32.323868 20173 pending_rounds.cc:85] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:20:32.332129 27639 consensus_queue.cc:1059] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:32.332525 20173 pending_rounds.cc:107] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:20:32.332765 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:32.332962 20173 raft_consensus.cc:2889] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:32.334342 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:32.337715 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.331614 27748 raft_consensus.cc:697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:32.224069 27768 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:20:32.344033 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.349164 21034 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:32.351315 27757 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:32.351852 27757 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:32.322945 27729 raft_consensus.cc:2764] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:20:32.352526 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.352680 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.360886 21038 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 21: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:32.374361 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.375067 21040 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:32.375816 27561 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:32.385568 21040 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 25.
I20260709 12:20:32.391402 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.300376 27755 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.397498 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.398378 21040 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:32.397907 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:32.403728 21038 raft_consensus.cc:2410] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:32.416427 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:32.417171 21040 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:32.386996 27725 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.396646 27729 raft_consensus.cc:2764] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 12:20:32.426867 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:32.436471 20249 raft_consensus.cc:1240] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 22. Current term is 23. Ops: [22.17-22.17]
W20260709 12:20:32.436599 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 103919us
I20260709 12:20:32.437924 21034 raft_consensus.cc:3055] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:32.438452 21034 raft_consensus.cc:740] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:32.444947 20252 raft_consensus.cc:2410] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 12:20:32.448140 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 204283us
I20260709 12:20:32.449997 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.450829 20173 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:32.455246 27805 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:32.455670 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.457722 27755 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:32.439980 27748 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.451525 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:32.474534 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.483956 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.432459 27792 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:32.490012 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.493252 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:32.490506 21008 leader_election.cc:336] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.287s (SENT)
I20260709 12:20:32.425150 27757 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.503664 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.508711 20173 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:32.505640 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:32.507480 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.510613 20175 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:32.480749 21034 consensus_queue.cc:260] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.512473 21034 raft_consensus.cc:3060] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:32.484782 27588 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:32.487818 27751 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.490221 27835 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.521672 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.502271 27805 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.529675 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46411.6us
I20260709 12:20:32.529765 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.531208 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.531858 20173 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:32.532208 20175 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:32.534116 21008 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.110s (SENT)
I20260709 12:20:32.535729 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:32.536671 27833 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.541654 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:32.542446 20256 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.548359 27783 raft_consensus.cc:3055] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:32.548792 27783 raft_consensus.cc:740] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:32.535051 27790 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:32.525622 27792 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:32.533449 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:32.556840 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.559592 20176 raft_consensus.cc:2368] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:32.559798 20294 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:32.565330 27641 raft_consensus.cc:2804] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:32.568151 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.568331 27641 raft_consensus.cc:697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:32.569878 27837 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:20:32.569608 27641 consensus_queue.cc:237] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.529795 27835 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.571678 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.573773 27835 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:32.550011 27830 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:32.595896 21040 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:20:32.557358 27790 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:32.574532 27776 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:32.530680 27805 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:32.600597 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.605652 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.605654 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.601351 27776 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.609318 27776 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:32.611500 27825 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
I20260709 12:20:32.615964 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:32.616734 20173 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:32.622337 20248 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:20:32.604709 27725 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:32.744362 20256 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:32.636541 27790 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:32.768004 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 230488us
W20260709 12:20:32.769754 27847 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:20:32.774050 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.170s (SENT)
I20260709 12:20:32.792228 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:32.618468 27783 consensus_queue.cc:260] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:32.815675 27846 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.217s	user 0.000s	sys 0.011s
I20260709 12:20:32.825937 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:32.803651 27781 consensus_meta.cc:287] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.006s
W20260709 12:20:32.833614 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59622.4us
I20260709 12:20:32.795534 27783 raft_consensus.cc:3060] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:32.815419 27473 consensus_meta.cc:287] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.006s
I20260709 12:20:32.842051 20324 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:20:32.819260 27790 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:32.845189 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:32.831664 27354 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.857827 27805 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:32.861004 27697 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:32.861546 27697 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:32.869118 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.870869 20176 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:32.876220 20175 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 26 index: 21. Preceding OpId from leader: term: 27 index: 22. (index mismatch)
W20260709 12:20:32.878384 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.878981 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.879896 20175 raft_consensus.cc:3055] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:32.880313 20175 raft_consensus.cc:740] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:32.883742 21034 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:20:32.884203 21034 pending_rounds.cc:85] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting all ops after (but not including) 12
I20260709 12:20:32.884264 20180 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:32.884757 21034 pending_rounds.cc:107] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:20:32.885113 21034 raft_consensus.cc:2889] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:32.879482 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.891636 21037 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 27.
I20260709 12:20:32.841066 27745 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:32.886612 21007 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:32.836872 27781 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:32.910843 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.915153 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.920207 20177 raft_consensus.cc:1275] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:32.917361 27354 raft_consensus.cc:2804] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:32.924458 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:32.915795 27822 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:20:33.002875 21008 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.578s (SENT)
I20260709 12:20:32.930642 20175 consensus_queue.cc:260] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.003661 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:33.017940 20177 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:33.023403 27781 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:33.025794 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.032126 27807 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:20:33.033336 27855 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:20:33.033483 27813 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.814s	user 0.000s	sys 0.002s
I20260709 12:20:32.910326 27745 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:32.944972 27354 raft_consensus.cc:697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:33.027439 27793 consensus_meta.cc:287] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.735s	user 0.002s	sys 0.007s
I20260709 12:20:33.065295 21038 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:33.068616 20175 raft_consensus.cc:3060] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:33.075075 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.076509 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 135432us
W20260709 12:20:33.081036 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.090487 20077 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:33.017215 27776 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.097873 20177 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:20:33.101620 27792 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:33.105679 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.083410 27760 consensus_meta.cc:287] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.871s	user 0.015s	sys 0.012s
I20260709 12:20:33.128469 20175 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:20:33.062772 27793 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.136107 20180 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:20:33.181583 20180 pending_rounds.cc:85] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 12
I20260709 12:20:33.181931 20180 pending_rounds.cc:107] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:20:33.182228 20180 raft_consensus.cc:2889] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:33.112563 27851 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:20:33.067955 27354 consensus_queue.cc:237] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:33.123215 27848 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 12:20:33.141848 20177 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:33.196182 20177 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:33.133601 27752 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.147285 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.154783 27778 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:33.180262 20174 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:33.199184 20174 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:33.197081 27863 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:20:33.183221 20175 pending_rounds.cc:85] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:20:33.218854 20175 pending_rounds.cc:107] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:20:33.220145 20175 raft_consensus.cc:2889] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.216933 20177 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:33.227775 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 121398us
W20260709 12:20:33.228528 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.175s (SENT)
I20260709 12:20:33.228957 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:33.229151 20177 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:33.230674 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 227833us
I20260709 12:20:33.198992 27778 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:33.232944 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.163s (SENT)
I20260709 12:20:33.235036 27810 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:33.236451 27778 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.238691 21043 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:20:33.241436 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.579s (SENT)
I20260709 12:20:33.241937 27776 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:33.233856 20174 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.243189 20174 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:33.244138 27745 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:33.245752 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:33.261862 27776 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.262564 27776 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.265115 27776 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:33.269675 27776 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:33.271770 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:33.273342 27221 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:33.274791 21039 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:33.276705 21042 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:33.277978 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.270488 27745 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.279002 27745 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.279433 20254 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:20:33.279855 20254 pending_rounds.cc:85] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 11
I20260709 12:20:33.280072 20254 pending_rounds.cc:107] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:20:33.280323 20254 raft_consensus.cc:2889] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.280622 20254 pending_rounds.cc:107] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:20:33.280892 20254 raft_consensus.cc:2889] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.281162 20177 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:20:33.281752 20177 pending_rounds.cc:85] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 9
I20260709 12:20:33.282032 20177 pending_rounds.cc:107] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:20:33.282536 20177 raft_consensus.cc:2889] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.282898 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:33.280861 20174 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:20:33.274735 27221 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:33.283792 20174 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 11
I20260709 12:20:33.287647 20174 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:20:33.283798 20324 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:33.293141 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:33.294121 21042 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:33.283970 27848 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:33.280743 27793 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:33.300855 20174 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.281203 27745 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:33.304502 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.214651 27752 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.308693 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:33.311802 21043 raft_consensus.cc:3060] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:33.299590 27864 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:20:33.313474 27768 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:33.329676 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:33.330488 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.332686 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.333425 20254 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 12:20:33.334746 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.320478 27511 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.337966 27511 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.338482 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:33.339103 20250 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:33.340133 27511 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:33.310307 27748 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:20:33.344347 20219 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:33.335773 27805 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.345306 27805 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.345860 27811 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:33.346315 27811 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.346658 27811 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.347069 27687 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:33.348959 27687 consensus_queue.cc:1048] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:33.350440 27751 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:33.353749 27752 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:33.355077 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.343294 21042 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:33.357295 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:33.347419 27805 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:33.363222 20250 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:33.367064 20253 raft_consensus.cc:1275] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:20:33.368603 27827 consensus_queue.cc:1048] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:33.372754 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:33.373416 20253 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:33.370347 27811 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.387521 20177 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
W20260709 12:20:33.374154 27697 consensus_meta.cc:287] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 12:20:33.391707 27774 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.393561 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.393580 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:33.394413 20179 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:33.390712 20174 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:33.391207 20177 pending_rounds.cc:85] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:20:33.362414 27759 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:20:33.362708 27873 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.029s
I20260709 12:20:33.396121 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.395562 20177 pending_rounds.cc:107] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:20:33.403957 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:33.401291 20255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 3204) took 1313 ms. Trace:
I20260709 12:20:33.405382 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:33.407256 20172 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:33.398765 20178 raft_consensus.cc:3055] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:33.408481 20178 raft_consensus.cc:740] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:33.408943 20177 raft_consensus.cc:2889] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:33.410432 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.428805 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:33.429567 21041 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:33.429314 20178 consensus_queue.cc:260] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.430418 20178 raft_consensus.cc:3060] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.430775 27511 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:33.431154 27511 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:33.393914 27752 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.038s
W20260709 12:20:33.432046 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.432971 27793 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.402117 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:33.433482 27793 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.435647 27793 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:33.435894 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:33.436889 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:33.432080 27511 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.438241 27864 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:33.438658 27511 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:33.438748 27864 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.441021 27864 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:33.441486 20220 leader_election.cc:336] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.057s (SENT)
I20260709 12:20:33.441902 27875 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:33.445111 27752 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:33.445021 27865 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:33.445564 27752 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.445982 27752 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:33.407748 20255 rpcz_store.cc:276] 0709 12:20:32.087493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.123318 (+ 35825us) service_pool.cc:224] Handling call
0709 12:20:33.401079 (+1277761us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400310454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:33.401202 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364767104}
I20260709 12:20:33.453877 27752 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.454595 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.455385 20174 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:33.456593 20179 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:33.456668 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.459615 20174 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:33.458056 27811 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:33.458444 20178 raft_consensus.cc:1275] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:20:33.469264 20178 pending_rounds.cc:85] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:20:33.469607 20178 pending_rounds.cc:107] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:20:33.469969 20178 raft_consensus.cc:2889] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.461285 20179 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:33.479292 21043 raft_consensus.cc:1275] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:33.481192 20327 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:33.388309 27588 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:20:33.445489 27873 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:20:33.497098 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.522543 21037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1675) took 1182 ms. Trace:
I20260709 12:20:33.527522 21034 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 26 index: 21. Preceding OpId from leader: term: 27 index: 22. (index mismatch)
I20260709 12:20:33.523099 21037 rpcz_store.cc:276] 0709 12:20:32.339785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.339913 (+   128us) service_pool.cc:224] Handling call
0709 12:20:33.522214 (+1182301us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54006d1fd4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:33.522409 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118898944}
I20260709 12:20:33.398118 27774 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.397082 27697 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:33.547492 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.566357 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.566785 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.569832 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.576952 20256 raft_consensus.cc:1240] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:33.581527 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40218 (request call id 1942) took 1813 ms. Trace:
I20260709 12:20:33.572573 27752 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:33.590003 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.590566 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.591056 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.582042 20249 rpcz_store.cc:276] 0709 12:20:31.765681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.765834 (+   153us) service_pool.cc:224] Handling call
0709 12:20:31.781078 (+ 15244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:32.437001 (+655923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.578473 (+1141472us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000d9654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:33.578749 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507495168}
I20260709 12:20:33.592664 20248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53430 (request call id 3211) took 1143 ms. Trace:
W20260709 12:20:33.579182 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 141286us
I20260709 12:20:33.602367 20248 rpcz_store.cc:276] 0709 12:20:32.448849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.517132 (+ 68283us) service_pool.cc:224] Handling call
0709 12:20:32.529303 (+ 12171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.622874 (+ 93571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.592338 (+969464us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b54003caad4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:33.592585 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212847360}
I20260709 12:20:33.615511 27871 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:33.618968 20294 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:33.631186 27781 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:33.631835 27781 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.632337 27781 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:33.612128 27786 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:20:33.648370 27877 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:20:33.649065 20294 leader_election.cc:400] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20.
I20260709 12:20:33.651230 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.651952 20171 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:33.654062 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.654788 20171 raft_consensus.cc:2393] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:33.657742 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:33.658380 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:33.659144 20250 raft_consensus.cc:1275] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:33.659056 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:33.660027 20253 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:20:33.664307 27697 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:33.667446 27774 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:33.669672 27641 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:33.670109 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.670856 20172 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.653766 27786 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:20:33.671697 27881 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.672207 27881 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.674471 27881 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:33.675096 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.677052 20248 raft_consensus.cc:1275] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:33.677476 20253 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
W20260709 12:20:33.692204 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.693502 20294 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:33.675616 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.695895 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.696600 20172 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:20:33.699873 20171 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:33.706679 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.707592 20178 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.708503 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.709290 20178 raft_consensus.cc:2410] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:20:33.704628 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.710271 20171 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:33.711072 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.712430 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.713076 20172 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:33.717623 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.718604 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.719909 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.720661 20178 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.721035 27221 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:33.721426 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.721493 27221 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:33.722316 20178 raft_consensus.cc:2393] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.724723 20171 raft_consensus.cc:2368] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:33.699404 27641 raft_consensus.cc:2804] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:33.729216 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.730052 20178 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.730763 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.731282 20178 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:33.731673 27641 raft_consensus.cc:697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:33.732726 27641 consensus_queue.cc:237] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:33.733722 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.932s (SENT)
I20260709 12:20:33.734205 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:33.733760 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.735771 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.736488 20171 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 16: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.736308 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.737432 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.738123 20174 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.738914 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.739975 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.740293 20178 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:33.740478 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.741258 20172 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.741163 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.741752 20178 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:33.745846 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.744721 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:33.746867 20174 raft_consensus.cc:2393] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.747850 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.748713 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.750444 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.751063 20178 raft_consensus.cc:2468] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:33.751022 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.752167 20174 raft_consensus.cc:3060] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:33.748402 20294 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:33.751163 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.754993 20171 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:33.767377 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.768209 20172 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:33.769745 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.770529 20171 raft_consensus.cc:1240] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:20:33.724725 27221 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.747825 27881 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:33.771421 27871 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:20:33.768859 27752 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:33.786474 27752 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:33.786989 27752 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:33.787150 20174 raft_consensus.cc:2468] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:33.776322 27760 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.749944 27786 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:33.781776 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.784714 27221 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.788362 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:33.792353 20171 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:33.796222 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.796847 20171 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
W20260709 12:20:33.798487 20220 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.012s (SENT)
I20260709 12:20:33.799010 20220 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:33.794011 27760 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:33.800889 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.801473 27760 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:33.779888 27757 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.803778 27697 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:33.793157 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:33.793211 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:33.808458 20172 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 12.
I20260709 12:20:33.811055 27771 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:33.812279 27786 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:33.821784 27786 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:33.824152 20179 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:33.825357 20179 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:33.825688 20179 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:33.828775 27887 log.cc:927] Time spent T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:20:33.775452 27781 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.841490 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3860) took 1222 ms. Trace:
I20260709 12:20:33.843487 20173 rpcz_store.cc:276] 0709 12:20:32.618735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.532228 (+913493us) service_pool.cc:224] Handling call
0709 12:20:33.532716 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.533210 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.533260 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.533875 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.697606 (+163731us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:33.737670 (+ 40064us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.737897 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.737976 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.841290 (+103314us) raft_consensus.cc:1685] finished
0709 12:20:33.841309 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.841429 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48776,"prepare.queue_time_us":39950,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":7726,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":12706,"thread_start_us":163213,"threads_started":1,"wal-append.queue_time_us":205633}
I20260709 12:20:33.846251 27881 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:33.846886 27881 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:33.881870 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.886670 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.017s	sys 0.061s
W20260709 12:20:33.991030 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.018s	sys 0.062s
W20260709 12:20:33.991207 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.991355 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 646115us
I20260709 12:20:33.992005 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:33.993554 27774 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:33.994256 27774 consensus_queue.cc:1243] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer f5c544fad8874e818acaad733a9d14f1 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:20:33.995647 20072 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 314) took 24429 ms (client timeout 15000 ms). Trace:
I20260709 12:20:33.851356 20179 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:33.948310 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1812) took 1108 ms. Trace:
W20260709 12:20:33.951501 20220 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.080s (SENT)
I20260709 12:20:33.997906 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:33.955430 27805 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.955677 27906 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:20:33.956089 27697 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.956696 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.959264 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4114) took 1062 ms. Trace:
I20260709 12:20:34.008337 20180 rpcz_store.cc:276] 0709 12:20:32.897117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.897269 (+   152us) service_pool.cc:224] Handling call
0709 12:20:32.897616 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.195452 (+297836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.958977 (+763525us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002413d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:33.959166 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547374848}
W20260709 12:20:33.965852 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.964749 20077 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:33.972082 27747 consensus_queue.cc:1059] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:33.970930 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:33.833195 27856 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:20:33.973299 27896 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.006s
W20260709 12:20:34.020035 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 49191.9us
I20260709 12:20:34.021210 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:34.014014 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 180488us
W20260709 12:20:33.998574 27903 log.cc:927] Time spent T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.154s	user 0.004s	sys 0.000s
I20260709 12:20:34.015340 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4116) took 1088 ms. Trace:
I20260709 12:20:34.010927 20077 catalog_manager.cc:5697] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 9 to 16, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 16 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.028887 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:33.997707 21038 rpcz_store.cc:276] 0709 12:20:32.839484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.839625 (+   141us) service_pool.cc:224] Handling call
0709 12:20:33.881910 (+1042285us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400738a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:33.948228 (+ 66318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504317184}
W20260709 12:20:34.027277 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76315.2us
I20260709 12:20:34.029711 20077 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 10 to 12, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 12 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.042361 20077 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.043867 20179 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:34.046674 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.028551 20176 rpcz_store.cc:276] 0709 12:20:32.926832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.926978 (+   146us) service_pool.cc:224] Handling call
0709 12:20:32.930630 (+  3652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.930829 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:33.113265 (+182436us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.968834 (+855569us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b1800293fe0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b 00007f5ddaa97d23 00007f5ddaa9823a
0709 12:20:34.007874 (+ 39040us) log.cc:844] Serialized 14 byte log entry
0709 12:20:34.014979 (+  7105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:34.015036 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:34.015091 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.015158 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.015281 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41959,"prepare.queue_time_us":334998,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":9512,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":5661056,"thread_start_us":288934,"threads_started":2,"wal-append.queue_time_us":315023}
I20260709 12:20:34.050179 20077 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 15, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 15 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:34.059645 27641 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.060029 27771 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:34.060241 27641 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:34.060642 27771 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.062232 27873 consensus_queue.cc:1048] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:34.062536 27641 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:34.062621 27771 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:34.063699 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1685) took 1141 ms. Trace:
I20260709 12:20:34.064611 20180 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 21. Ops: []
I20260709 12:20:34.071075 21036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1688) took 1142 ms. Trace:
I20260709 12:20:34.070920 21034 rpcz_store.cc:276] 0709 12:20:32.907931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.908549 (+   618us) service_pool.cc:224] Handling call
0709 12:20:33.527008 (+618459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.536152 (+  9144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.049542 (+513390us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54006d1fd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:34.049721 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410486656}
I20260709 12:20:34.071679 21036 rpcz_store.cc:276] 0709 12:20:32.928281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.928418 (+   137us) service_pool.cc:224] Handling call
0709 12:20:33.949233 (+1020815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.949460 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.949483 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.949528 (+    45us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:33.949567 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.949619 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.070844 (+121225us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400738a50. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:34.070992 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340037504}
W20260709 12:20:34.066236 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 53056.9us
I20260709 12:20:34.067553 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.068746 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.025650 27783 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.079430 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.080878 20077 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:34.082921 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.082602 20077 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 15 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.030252 27757 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:34.046226 27833 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:34.103472 20247 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
W20260709 12:20:34.101112 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 108437us
I20260709 12:20:34.108913 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:34.110312 21043 raft_consensus.cc:2368] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:34.063264 27645 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:20:33.996019 20072 rpcz_store.cc:269] 0709 12:20:09.566605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.566895 (+   290us) service_pool.cc:224] Handling call
0709 12:20:33.995526 (+24428631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:30.412594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:30.413457 (+   863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:30.413526 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:20:30.413558 (+    32us) tablet.cc:662] Decoding operations
0709 12:20:30.428222 (+ 14664us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:30.428297 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:30.428326 (+    29us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:20:30.430282 (+  1956us) tablet.cc:701] Row locks acquired
0709 12:20:30.430332 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:20:30.430513 (+   181us) write_op.cc:270] Start()
0709 12:20:30.430715 (+   202us) write_op.cc:276] Timestamp: P: 1783599630430442 usec, L: 0
0709 12:20:30.430746 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:20:30.490626 (+ 59880us) log.cc:844] Serialized 7855 byte log entry
0709 12:20:30.887939 (+397313us) op_driver.cc:464] REPLICATION: finished
0709 12:20:30.990308 (+102369us) write_op.cc:301] APPLY: starting
0709 12:20:30.990440 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:31.032774 (+ 42334us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:31.032906 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:31.462983 (+430077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:31.463437 (+   454us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:20:31.463516 (+    79us) write_op.cc:312] APPLY: finished
0709 12:20:31.464077 (+   561us) log.cc:844] Serialized 180 byte log entry
0709 12:20:31.464293 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.464512 (+   219us) write_op.cc:454] Released schema lock
0709 12:20:31.464593 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:31.465314 (+   721us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.465349 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":182222,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":101983,"apply.run_cpu_time_us":33791,"apply.run_wall_time_us":474981,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":294169,"prepare.run_cpu_time_us":61678,"prepare.run_wall_time_us":184550,"raft.queue_time_us":130456,"raft.run_cpu_time_us":9427,"raft.run_wall_time_us":72174,"replication_time_us":456978,"thread_start_us":457776,"threads_started":4,"wal-append.queue_time_us":200048,"wal-append.run_cpu_time_us":21054,"wal-append.run_wall_time_us":1770005}]]}
I20260709 12:20:34.059721 27687 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:34.116854 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.012030 27805 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.026427 27697 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.117679 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:34.122443 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.101363 27874 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:34.098156 20077 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:34.108723 27896 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:20:34.099468 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:34.109552 27833 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.103039 27783 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:34.095034 27751 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:20:34.095211 27820 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
W20260709 12:20:34.138629 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.140086 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:34.170380 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 71032.3us
I20260709 12:20:34.220921 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.221761 20255 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:34.149776 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52799us
W20260709 12:20:34.199726 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.221431 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:34.204061 20250 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:34.193135 20179 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:20:34.225729 20179 pending_rounds.cc:85] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 8
I20260709 12:20:34.226115 20179 pending_rounds.cc:107] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:20:34.226517 20179 raft_consensus.cc:2889] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:34.134507 27901 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:20:34.132671 27904 log.cc:927] Time spent T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:20:34.120743 27747 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:20:34.147739 27833 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:34.235009 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.130928 20077 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 18, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 18 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.148108 27757 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:34.229406 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 114001us
I20260709 12:20:34.136185 27221 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.139165 27781 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:34.134676 27774 raft_consensus.cc:3055] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:34.125396 27687 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.261734 20077 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:34.268579 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 159294us
I20260709 12:20:34.270821 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:34.272084 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.272433 20251 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:34.272724 20255 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:34.273056 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.273904 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.272742 20252 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
W20260709 12:20:34.272105 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50835.7us
I20260709 12:20:34.227782 27822 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:34.289956 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.289320 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.289155 20250 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:34.310806 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.233526 27835 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.311988 20251 raft_consensus.cc:2368] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21.
W20260709 12:20:34.312178 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47005us
I20260709 12:20:34.221522 27856 consensus_queue.cc:1048] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:20:34.233690 27760 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:34.289453 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:34.315490 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.315150 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.315672 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.326910 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.327796 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.328085 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.328568 20330 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:34.327976 20077 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 20, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 20 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.331122 20250 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:34.333963 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.313215 27901 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:20:34.334451 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.343214 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.337283 20077 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 15 to 22, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 22 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:34.337129 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.344141 20254 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:34.340245 20322 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:34.315436 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:34.334941 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.344705 20077 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 18, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 18 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:34.341249 20327 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:34.342042 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.346272 20077 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:34.348224 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:34.347870 20077 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 22, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 22 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:34.348300 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.353266 21040 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:34.353549 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.354645 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.355553 20321 raft_consensus.cc:2410] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:20:34.354908 20077 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 17, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:34.355470 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.260466 27641 consensus_queue.cc:1048] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:20:34.357733 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.357223 20077 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 18, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 18 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:34.287963 27774 raft_consensus.cc:740] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:34.361467 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.374732 20249 raft_consensus.cc:1217] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 12:20:34.361871 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.375254 20249 raft_consensus.cc:1240] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:20:34.363474 20077 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:34.266618 27830 consensus_queue.cc:1048] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:20:34.289178 27221 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:34.278386 27757 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:34.343494 27752 consensus_meta.cc:287] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.004s
I20260709 12:20:34.314710 27913 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:34.382087 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:34.388044 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.389134 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.390622 20321 raft_consensus.cc:2368] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:34.394836 20325 raft_consensus.cc:1240] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:34.391323 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.397002 20328 raft_consensus.cc:2393] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:34.398818 20249 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:34.339067 27760 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:34.402935 27805 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:34.403930 27778 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:20:34.405064 27221 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:34.405782 20329 raft_consensus.cc:2393] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 16: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:34.405898 27928 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:34.406479 27925 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:34.407624 27687 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:34.320039 27835 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.314574 27822 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.432473 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.376295 27881 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:34.439342 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 118152us
I20260709 12:20:34.442371 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.444011 20249 raft_consensus.cc:1240] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:20:34.439405 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.397559 27913 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:34.424858 27645 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:34.450605 20328 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
W20260709 12:20:34.447050 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 157569us
I20260709 12:20:34.453567 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:34.454226 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:34.439586 27907 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:20:34.434765 27911 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:34.453126 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.393831 27752 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.464821 21036 raft_consensus.cc:3060] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.460062 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:34.440289 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:34.465651 20249 raft_consensus.cc:1240] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:20:34.467947 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:34.469004 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:34.469594 20179 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:34.466575 20219 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:34.482807 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.483248 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.479426 20179 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:34.488847 20321 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:34.491665 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:34.498299 20178 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:34.498757 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.499723 20321 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
W20260709 12:20:34.492803 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.500941 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:34.501426 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 230722us
I20260709 12:20:34.502329 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.503113 20329 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:34.503214 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.503824 20321 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:34.503919 27928 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:34.504931 20321 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:34.506265 20321 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:20:34.507120 27782 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.507652 27782 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.508119 27790 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:34.508625 27790 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.509833 27782 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:34.510350 27782 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:34.510653 27790 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:34.510881 27782 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.511417 20321 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:20:34.513319 27782 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:34.514137 27782 consensus_queue.cc:1059] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:34.515828 27928 raft_consensus.cc:3055] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:34.516208 27928 raft_consensus.cc:740] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:34.517058 27928 consensus_queue.cc:260] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.518265 27928 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:34.521803 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.786s (SENT) [suppressed 55 similar messages]
I20260709 12:20:34.523701 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:34.542754 20247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53430 (request call id 3197) took 2474 ms (client timeout 1772 ms). Trace:
W20260709 12:20:34.543368 20247 rpcz_store.cc:269] 0709 12:20:32.068278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.082347 (+ 14069us) service_pool.cc:224] Handling call
0709 12:20:32.924296 (+841949us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800049898. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd3a22 00007f5de0cec8d9 00007f5ddfe46ee0 00007f5ddff100ab 00007f5ddff10131 00007f5ddfebe0a0 00007f5ddfebd984 00007f5dd94386d4 00007f5dd9438662
0709 12:20:34.542469 (+1618173us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002fc954. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:34.542616 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472882688}
I20260709 12:20:34.458278 27913 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:34.560307 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:34.496683 20295 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:34.566120 20173 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:34.560854 20249 raft_consensus.cc:1240] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:20:34.499784 20324 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:34.511199 27790 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:34.566494 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69881.9us
I20260709 12:20:34.463097 27911 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:34.463605 27221 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.481439 27697 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:34.590051 20295 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:34.595005 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:34.596261 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.596710 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:34.599256 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.449397 27925 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.560894 27875 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:34.602944 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3867) took 1013 ms. Trace:
I20260709 12:20:34.563001 27783 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:34.463541 27645 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.455689 27774 consensus_queue.cc:260] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.585489 27790 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:34.626909 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.605197 20174 rpcz_store.cc:276] 0709 12:20:33.589339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.815380 (+226041us) service_pool.cc:224] Handling call
0709 12:20:33.815752 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.831655 (+ 15903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.831691 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.838163 (+  6472us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.941095 (+102932us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:33.941163 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.941273 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:34.602672 (+661399us) raft_consensus.cc:1685] finished
0709 12:20:34.602703 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.602870 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15497,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8129,"thread_start_us":102460,"threads_started":1,"wal-append.queue_time_us":174021}
I20260709 12:20:34.593022 27641 raft_consensus.cc:2804] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:34.587447 27931 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:34.601114 27881 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:34.596283 27911 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:34.662518 20249 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:20:34.663409 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.600018 27792 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:34.676020 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.692397 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.715596 20249 raft_consensus.cc:1240] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 12:20:34.721555 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 209478us
I20260709 12:20:34.601608 27927 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:34.593248 27811 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:20:34.742025 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 218423us
W20260709 12:20:34.735450 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 275428us
I20260709 12:20:34.722559 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:34.656467 27687 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:34.745975 20220 leader_election.cc:400] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
I20260709 12:20:34.751497 20220 leader_election.cc:403] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:34.751183 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 229390us
I20260709 12:20:34.749993 27939 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.719173 27881 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:34.601760 27221 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:34.763310 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:34.682380 27934 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:34.756873 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:34.751164 27687 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:34.612311 27875 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:34.784930 20254 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:34.739581 27641 raft_consensus.cc:697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:34.789211 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.774607 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.776160 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:34.751362 27757 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:34.768922 20256 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:20:34.771611 20220 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:36.516544 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 1.74488e+06us
I20260709 12:20:36.517345 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:34.822054 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:35.385962 27959 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.574577 27959 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.577315 27959 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:35.915079 20173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.009s	sys 0.010s
W20260709 12:20:36.577924 20173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.009s	sys 0.010s
I20260709 12:20:36.578691 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4158) took 1969 ms. Trace:
I20260709 12:20:36.579028 20173 rpcz_store.cc:276] 0709 12:20:34.609695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.303298 (+693603us) service_pool.cc:224] Handling call
0709 12:20:35.328195 (+ 24897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:35.328742 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.328789 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:35.329446 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.578321 (+1248875us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:36.578365 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.578434 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.578481 (+    47us) raft_consensus.cc:1685] finished
0709 12:20:36.578497 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.578633 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":17309,"thread_start_us":1193077,"threads_started":1,"wal-append.queue_time_us":546978}
I20260709 12:20:35.915623 27961 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.583994 27961 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.586978 27961 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:36.033797 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.595007 20254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 2331) took 2311 ms (client timeout 1920 ms). Trace:
I20260709 12:20:36.595759 27819 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.596406 27819 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.597856 20173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4159) took 1987 ms. Trace:
W20260709 12:20:36.051472 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.598554 27923 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:36.599123 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.599555 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.598238 20173 rpcz_store.cc:276] 0709 12:20:34.610022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.580666 (+1970644us) service_pool.cc:224] Handling call
0709 12:20:36.581032 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.581267 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:36.581890 (+   623us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.597502 (+ 15612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:36.597556 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:36.597606 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.597679 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.597797 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":91,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":14967,"threads_started":1,"wal-append.queue_time_us":13914}
W20260709 12:20:36.599946 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.111951 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 56285.7us
W20260709 12:20:36.600414 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.600746 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.601040 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.263914 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.603946 20329 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:36.604496 20329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1754) took 1826 ms (client timeout 1540 ms). Trace:
W20260709 12:20:36.604857 20329 rpcz_store.cc:269] 0709 12:20:34.778427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.778593 (+   166us) service_pool.cc:224] Handling call
0709 12:20:36.604394 (+1825801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:36.605741 27950 consensus_queue.cc:1059] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:36.273110 27969 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:20:36.278640 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:36.283643 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.610672 20252 raft_consensus.cc:2410] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:20:36.288664 20172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.793s	user 0.001s	sys 0.026s
W20260709 12:20:36.611843 20172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.116s	user 0.002s	sys 0.026s
W20260709 12:20:36.595503 20254 rpcz_store.cc:269] 0709 12:20:34.283146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.309494 (+ 26348us) service_pool.cc:224] Handling call
0709 12:20:36.594916 (+2285422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:36.613112 27923 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.301445 27964 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.613615 20175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4147) took 2146 ms. Trace:
I20260709 12:20:36.598634 27819 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.614117 27964 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.616652 27964 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:36.304267 20177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.036s	sys 0.061s
W20260709 12:20:36.617534 20177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.894s	user 0.037s	sys 0.061s
I20260709 12:20:36.618317 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4155) took 2120 ms. Trace:
W20260709 12:20:36.305235 20178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.534s	user 0.051s	sys 0.062s
W20260709 12:20:36.619843 20178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.855s	user 0.052s	sys 0.062s
I20260709 12:20:36.328315 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.620765 20324 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:36.614089 20175 rpcz_store.cc:276] 0709 12:20:34.466741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.489849 (+ 23108us) service_pool.cc:224] Handling call
0709 12:20:34.572702 (+ 82853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.788845 (+216143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.788893 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.789456 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.059285 (+1269829us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:36.271208 (+211923us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.271906 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.272026 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.611529 (+339503us) raft_consensus.cc:1685] finished
0709 12:20:36.611551 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.613526 (+  1975us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211079,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":176693,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":226,"thread_start_us":423093,"threads_started":3,"wal-append.queue_time_us":10649}
W20260709 12:20:36.621302 20324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1753) took 1850 ms (client timeout 2024 ms). Trace:
W20260709 12:20:36.621672 20324 rpcz_store.cc:269] 0709 12:20:34.771263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.771709 (+   446us) service_pool.cc:224] Handling call
0709 12:20:36.621237 (+1849528us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:36.335929 20180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.586s	user 0.013s	sys 0.015s
I20260709 12:20:36.607451 27950 raft_consensus.cc:3055] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:20:36.622725 20180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.873s	user 0.013s	sys 0.015s
I20260709 12:20:36.622756 27950 raft_consensus.cc:740] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:36.623521 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4144) took 2157 ms. Trace:
I20260709 12:20:36.346556 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:36.624518 27937 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.624040 27950 consensus_queue.cc:260] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.626552 27950 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:36.628863 20325 consensus_meta.cc:287] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 2.175s	user 0.018s	sys 0.004s
W20260709 12:20:36.353803 20171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.860s	user 0.016s	sys 0.026s
W20260709 12:20:36.354849 20174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.608s	user 0.074s	sys 0.129s
W20260709 12:20:35.351439 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.646842 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:35.270896 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:36.646970 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.649958 21037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1711) took 1379 ms. Trace:
I20260709 12:20:36.650342 21037 rpcz_store.cc:276] 0709 12:20:35.270406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.270563 (+   157us) service_pool.cc:224] Handling call
0709 12:20:36.649893 (+1379330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:35.363590 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:36.652009 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1712) took 1360 ms. Trace:
I20260709 12:20:36.652302 21038 rpcz_store.cc:276] 0709 12:20:35.292001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.334588 (+ 42587us) service_pool.cc:224] Handling call
0709 12:20:36.651949 (+1317361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:36.031713 27748 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:20:34.776808 27687 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:34.721870 27792 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.663082 27792 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:34.772716 27747 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:36.664666 27747 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.665076 27747 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:34.832451 27760 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.669529 27760 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.670030 27760 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.637832 20325 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 12.
I20260709 12:20:36.671044 27968 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:35.487138 27778 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 1.055s	user 0.015s	sys 0.000s
W20260709 12:20:35.171461 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.674983 27929 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:35.875635 21035 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.026s	sys 0.023s
I20260709 12:20:34.873092 21036 raft_consensus.cc:2468] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:20:36.681143 21036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1820) took 2333 ms (client timeout 1551 ms). Trace:
W20260709 12:20:36.681605 21036 rpcz_store.cc:269] 0709 12:20:34.347810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.347963 (+   153us) service_pool.cc:224] Handling call
0709 12:20:36.680871 (+2332908us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54005d5a54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:36.681023 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266421632}
I20260709 12:20:35.093425 27221 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:35.062563 27641 consensus_queue.cc:237] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.686728 27981 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.687402 27981 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:35.097579 27645 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.690436 27981 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.022538 27786 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.691903 27786 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.693138 27760 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.694089 27786 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:35.167774 27790 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:34.772413 27805 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:34.753659 27811 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:36.698800 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4154) took 2201 ms. Trace:
I20260709 12:20:36.698721 27811 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.699231 20178 rpcz_store.cc:276] 0709 12:20:34.497452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.498987 (+  1535us) service_pool.cc:224] Handling call
0709 12:20:34.499323 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.499543 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 22
0709 12:20:34.764525 (+264982us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.698382 (+1933857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:36.698448 (+    66us) raft_consensus.cc:1645] Marking committed up to 22
0709 12:20:36.698503 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.698582 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.698726 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25859,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":73499,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":99,"thread_start_us":2197974,"threads_started":3,"wal-append.queue_time_us":520999,"wal-append.run_cpu_time_us":1316,"wal-append.run_wall_time_us":1001345}
I20260709 12:20:36.700855 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:34.854589 27822 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:35.488387 27833 consensus_meta.cc:287] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 1.123s	user 0.015s	sys 0.000s
I20260709 12:20:36.703981 27833 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.704705 27805 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.705255 27805 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.706130 27833 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:34.754935 27835 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.707445 27805 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:35.264784 27875 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:34.762295 27881 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:36.709798 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:36.710510 20252 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:36.712153 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:35.823727 27913 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.213s	user 0.016s	sys 0.000s
I20260709 12:20:36.714769 27913 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.717240 27913 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.717620 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:35.086999 27912 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 12:20:36.720376 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:35.096206 27914 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 12:20:35.095679 27916 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:36.723666 27916 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:36.724107 27916 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.710968 27687 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.726346 27687 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.726745 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:34.869782 27928 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.729163 27928 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:35.086159 27932 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:36.732704 27932 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:36.310595 27952 log.cc:927] Time spent T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.560s	user 0.002s	sys 0.018s
W20260709 12:20:36.391539 27936 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 1.678s	user 0.002s	sys 0.008s
I20260709 12:20:34.791389 27922 consensus_queue.cc:1048] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.406s
I20260709 12:20:34.776309 27934 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.738369 27932 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:35.172246 27942 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:35.158380 27925 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:35.171655 27926 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.742331 27926 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.744518 27926 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:35.917577 27927 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.166s	user 0.010s	sys 0.003s
I20260709 12:20:36.746124 27927 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:34.771435 27939 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.748405 27922 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:36.748898 27922 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.749490 27939 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:36.420840 20077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.042s	sys 0.074s
W20260709 12:20:36.750247 20077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.141s	user 0.043s	sys 0.075s
I20260709 12:20:36.750903 27922 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.747735 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:36.752544 27916 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:36.423110 20145 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.050s	user 0.049s	sys 0.070s
W20260709 12:20:36.753911 20145 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.380s	user 0.049s	sys 0.070s
W20260709 12:20:36.754570 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.754822 27916 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.441768 27976 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.759888 27976 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.762498 27976 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:36.442785 27864 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:36.763298 27864 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.765486 27864 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.469448 27756 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:36.766158 27756 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.768322 27756 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:36.508919 20176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.947s	user 0.013s	sys 0.024s
W20260709 12:20:36.769030 20176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.207s	user 0.014s	sys 0.024s
W20260709 12:20:36.512606 20256 consensus_meta.cc:287] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.689s	user 0.015s	sys 0.007s
I20260709 12:20:36.770717 20256 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
W20260709 12:20:36.771273 20256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 2343) took 2015 ms (client timeout 1783 ms). Trace:
W20260709 12:20:36.771641 20256 rpcz_store.cc:269] 0709 12:20:34.755805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.755985 (+   180us) service_pool.cc:224] Handling call
0709 12:20:36.771182 (+2015197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:36.513737 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.772823 20323 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:36.518766 27975 raft_consensus.cc:2804] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:36.773986 27975 raft_consensus.cc:697] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:36.775113 27975 consensus_queue.cc:237] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.778779 27931 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21.
W20260709 12:20:36.522246 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.924s	user 0.018s	sys 0.015s
W20260709 12:20:36.781478 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.184s	user 0.018s	sys 0.015s
W20260709 12:20:36.781847 20144 connection.cc:256] RPC call timeout handler was delayed by -3.3802891289999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 12:20:36.782171 20144 connection.cc:256] RPC call timeout handler was delayed by -3.286689129000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:20:36.782553 20144 connection.cc:256] RPC call timeout handler was delayed by -3.2209891289999177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 12:20:36.782878 20144 connection.cc:256] RPC call timeout handler was delayed by -3.2074891290001233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 12:20:36.783193 20144 connection.cc:256] RPC call timeout handler was delayed by -3.1084891289999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 12:20:36.528128 27978 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:36.784152 27978 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.784596 27978 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:36.532312 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:36.552635 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.788777 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.789155 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.567785 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:36.568614 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 51390.2us
I20260709 12:20:36.635371 27771 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:36.791661 27771 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.636561 27960 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.792033 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:36.792371 27960 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.793432 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:36.794641 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:36.634902 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 288427us
I20260709 12:20:36.796193 27960 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.797168 27811 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:36.797892 27811 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:36.798549 27811 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:36.636782 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4153) took 2156 ms. Trace:
W20260709 12:20:36.637802 20174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.905s	user 0.074s	sys 0.130s
W20260709 12:20:36.637348 20171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.145s	user 0.017s	sys 0.027s
I20260709 12:20:36.799275 20179 rpcz_store.cc:276] 0709 12:20:34.480615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.493930 (+ 13315us) service_pool.cc:224] Handling call
0709 12:20:34.494235 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:34.757952 (+263717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.757986 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:34.758644 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 12:20:36.636381 (+1877737us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:36.636425 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.636517 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.636569 (+    52us) raft_consensus.cc:1685] finished
0709 12:20:36.636581 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.636718 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":254662,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":69,"thread_start_us":282214,"threads_started":2,"wal-append.queue_time_us":1810371}
I20260709 12:20:36.624039 20180 rpcz_store.cc:276] 0709 12:20:34.465846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.489981 (+ 24135us) service_pool.cc:224] Handling call
0709 12:20:34.490285 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.748504 (+258219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.748539 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:34.749105 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.623143 (+1874038us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:36.623187 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.623282 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.623329 (+    47us) raft_consensus.cc:1685] finished
0709 12:20:36.623342 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.623463 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":258132,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":2131321,"threads_started":2,"wal-append.queue_time_us":520829,"wal-append.run_cpu_time_us":2330,"wal-append.run_wall_time_us":1073617}
I20260709 12:20:36.642988 27774 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:36.792069 27771 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:36.644353 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
W20260709 12:20:35.582393 21008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.060s	sys 0.128s
I20260709 12:20:36.804402 20171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4151) took 2324 ms. Trace:
W20260709 12:20:36.804719 21008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.030s	user 0.062s	sys 0.128s
I20260709 12:20:36.804894 20171 rpcz_store.cc:276] 0709 12:20:34.480089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.492077 (+ 11988us) service_pool.cc:224] Handling call
0709 12:20:34.492389 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.799850 (+2307461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.799883 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:36.800331 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.804021 (+  3690us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:36.804063 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.804138 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.804184 (+    46us) raft_consensus.cc:1685] finished
0709 12:20:36.804197 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.804342 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":256314,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":68,"thread_start_us":2310317,"threads_started":2,"wal-append.queue_time_us":1154}
I20260709 12:20:36.625330 27937 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.809554 27937 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.618674 20177 rpcz_store.cc:276] 0709 12:20:34.497789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.601611 (+103822us) service_pool.cc:224] Handling call
0709 12:20:34.660539 (+ 58928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.660743 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:34.697562 (+ 36819us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.617926 (+1920364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:36.617994 (+    68us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:36.618053 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.618129 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.618257 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54222,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":379585,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":8913,"thread_start_us":1894582,"threads_started":1}
I20260709 12:20:36.810468 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.810649 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:36.811136 20175 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:36.811264 20178 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.815164 27964 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.815709 27964 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.818401 27964 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.653509 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:20:36.820039 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 166633us
I20260709 12:20:36.671576 27968 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.820691 27774 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:36.672401 20325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2460) took 2252 ms (client timeout 1632 ms). Trace:
W20260709 12:20:36.821358 20325 rpcz_store.cc:269] 0709 12:20:34.419618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.419746 (+   128us) service_pool.cc:224] Handling call
0709 12:20:36.672304 (+2252558us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:20:36.678305 21035 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.029s	sys 0.023s
I20260709 12:20:36.684753 27929 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:34.871657 27752 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.691028 27981 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.824487 27981 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.826239 27929 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:36.826642 27981 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.691327 20326 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:36.827258 20171 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:36.703066 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.708071 27805 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.828418 27968 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:36.828504 27805 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:36.829351 21008 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.536s (SENT)
I20260709 12:20:36.830993 27805 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.713733 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:35.918840 27911 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 1.167s	user 0.013s	sys 0.000s
I20260709 12:20:36.833338 27960 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.833212 27911 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.834172 27960 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.707757 21034 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:36.718070 27747 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.836447 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53112 (request call id 1823) took 2073 ms. Trace:
I20260709 12:20:36.836807 21034 rpcz_store.cc:276] 0709 12:20:34.762967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.763253 (+   286us) service_pool.cc:224] Handling call
0709 12:20:36.836256 (+2073003us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54006022d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:36.836383 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4410071936}
I20260709 12:20:36.837220 27747 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.719025 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:36.727610 20251 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 21: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:36.838150 20250 raft_consensus.cc:2393] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:36.734160 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:36.838775 20178 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
W20260709 12:20:36.839216 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 105181us
I20260709 12:20:36.839984 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:36.840566 27805 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:36.840874 27960 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.735916 27928 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.740896 27942 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.841648 27911 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.841595 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4156) took 2232 ms. Trace:
I20260709 12:20:36.843479 27942 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:36.843365 27911 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:36.741642 27934 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.746627 27881 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.845790 27881 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.754700 20249 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 18.
I20260709 12:20:36.613703 27923 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:20:36.847249 20249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53438 (request call id 2344) took 2025 ms (client timeout 1572 ms). Trace:
I20260709 12:20:36.803005 20324 raft_consensus.cc:606] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:36.848507 27968 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.838151 20255 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 16: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:36.849079 27968 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.850455 27752 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.851011 27752 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.851464 27968 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:36.843500 20174 rpcz_store.cc:276] 0709 12:20:34.609068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.705274 (+ 96206us) service_pool.cc:224] Handling call
0709 12:20:34.705792 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.799741 (+2093949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.799788 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:36.800312 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.831124 (+ 30812us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:36.831737 (+   613us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.831950 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.832035 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.841400 (+  9365us) raft_consensus.cc:1685] finished
0709 12:20:36.841415 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.841531 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26473,"prepare.queue_time_us":164,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":385597,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":227,"thread_start_us":2097112,"threads_started":2,"wal-append.queue_time_us":3679}
I20260709 12:20:36.853761 27752 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:36.754902 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.854895 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.652683 27924 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.813151 20177 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:36.855365 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:36.855646 27924 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.856302 27881 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:36.783514 20144 connection.cc:256] RPC call timeout handler was delayed by -3.1048891289999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 12:20:36.856979 27881 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:36.857097 20144 connection.cc:256] RPC call timeout handler was delayed by -3.0805891289999181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 12:20:36.857450 27881 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:36.857651 20144 connection.cc:256] RPC call timeout handler was delayed by -2.9563891289999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 12:20:36.858139 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6125891290000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2627s for a response
I20260709 12:20:36.858191 27924 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.848078 27923 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:36.820706 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:20:36.847771 20249 rpcz_store.cc:269] 0709 12:20:34.821534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.821744 (+   210us) service_pool.cc:224] Handling call
0709 12:20:36.847026 (+2025282us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400374454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:36.847157 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396486912}
I20260709 12:20:36.841110 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:36.860968 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:36.861936 27931 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:36.862452 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:36.862696 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:36.863085 21034 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.701824 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4148) took 2234 ms. Trace:
I20260709 12:20:36.863487 21036 raft_consensus.cc:2410] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:36.864686 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:36.865705 27942 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:36.866022 21037 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:36.866122 27942 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.866617 27942 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:36.841212 27805 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:36.862325 27931 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.868027 27805 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.863741 20172 rpcz_store.cc:276] 0709 12:20:34.467023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.467184 (+   161us) service_pool.cc:224] Handling call
0709 12:20:34.467547 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.467833 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:36.612316 (+2144483us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.701413 (+ 89097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:36.701467 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:36.701517 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.701638 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.701762 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57320,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":2700,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":2205244,"threads_started":2,"wal-append.queue_time_us":85619}
I20260709 12:20:36.822727 20330 raft_consensus.cc:2368] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21.
I20260709 12:20:36.856222 27937 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.856508 27934 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.869858 20330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2456) took 2522 ms (client timeout 1899 ms). Trace:
I20260709 12:20:36.869568 27937 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.869856 27934 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:36.870447 20330 rpcz_store.cc:269] 0709 12:20:34.353071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.353221 (+   150us) service_pool.cc:224] Handling call
0709 12:20:36.869645 (+2516424us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540022e054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:36.869781 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5676482944}
I20260709 12:20:36.855455 27939 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.872251 27934 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.872234 27939 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.872979 27934 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.873442 27934 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.875070 27939 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.875690 27934 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.880082 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:36.880206 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:36.880847 20172 raft_consensus.cc:2368] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 21. Current term is 22.
I20260709 12:20:36.880970 20330 raft_consensus.cc:606] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:36.868567 27805 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:36.868510 27931 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:36.882432 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.883093 20177 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:36.884671 20177 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 26. Current term is 27. Ops: []
I20260709 12:20:36.886339 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.886581 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.887045 20173 raft_consensus.cc:2376] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13. Re-sending same reply.
I20260709 12:20:36.888008 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:36.887423 20172 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:36.821239 27774 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:36.891515 27981 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.892454 27981 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.894484 27981 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.895375 27937 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.890254 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.896445 20171 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:36.867806 27924 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:36.897327 27924 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.898063 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:36.898411 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:36.898746 20330 raft_consensus.cc:606] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:36.899326 27774 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:36.899083 21036 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:36.901677 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:36.902360 20173 raft_consensus.cc:2376] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13. Re-sending same reply.
I20260709 12:20:36.897773 27924 raft_consensus.cc:3060] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:36.903342 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:36.901005 20219 connection.cc:256] RPC call timeout handler was delayed by -1.1193652429999474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:20:36.904269 20172 raft_consensus.cc:2368] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19.
I20260709 12:20:36.899925 27923 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.904866 27923 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.905256 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.906037 20177 raft_consensus.cc:2368] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:20:36.900352 27981 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:36.906805 27981 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.907370 27923 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:36.899058 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.908000 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.908808 20171 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:36.914007 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:36.914601 20175 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.916414 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.917128 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:36.917261 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.915688 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.918408 20173 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:36.919067 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.921106 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.921521 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:36.922253 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:36.919116 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.861670 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:36.950043 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:36.961123 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 99518.5us
I20260709 12:20:36.950912 27928 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:20:36.962023 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:36.962929 27975 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:36.963364 27975 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.963837 27975 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:36.963893 27916 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:20:36.964613 27981 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:36.962049 20329 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:36.949606 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:36.968992 27939 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.969810 27939 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.972121 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:36.973002 20173 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18. Re-sending same reply.
I20260709 12:20:36.928730 27923 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:36.923493 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.925067 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:36.963222 20172 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:36.974167 27923 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:36.911054 27771 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:37.012981 20330 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:36.974858 20327 raft_consensus.cc:606] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Received request to transfer leadership to TS 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:36.976570 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.017140 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.017890 20172 raft_consensus.cc:2468] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:37.018818 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.018929 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.019961 20172 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:37.020860 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.977934 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.023872 20178 raft_consensus.cc:2368] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 21. Current term is 22.
I20260709 12:20:37.024721 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.025398 27771 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:37.025570 20178 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:37.026511 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.027423 20178 raft_consensus.cc:2393] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 18: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:36.981848 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.975356 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.980329 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.032377 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.033115 20178 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:37.028003 20172 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:37.034130 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.036307 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.034487 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.028618 20171 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:37.036545 21034 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:37.039987 27783 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:36.997009 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 166656us
I20260709 12:20:37.041594 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:37.046005 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.048707 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.936760 27978 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:37.041764 27942 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.382270 20174 raft_consensus.cc:2368] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
W20260709 12:20:37.100662 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.383131 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.232198 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.383616 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.384079 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.009570 27975 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:37.384862 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.076208 21035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1709) took 1818 ms. Trace:
W20260709 12:20:37.120479 27993 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:20:36.982820 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:37.395289 20329 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:37.083593 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:37.395922 20173 raft_consensus.cc:2410] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 28 because replica has last-logged OpId of term: 27 index: 22, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 21.
W20260709 12:20:37.396268 20294 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.054s	sys 0.146s
W20260709 12:20:37.396648 20294 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.055s	sys 0.146s
W20260709 12:20:37.396986 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 638689us
I20260709 12:20:37.387892 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.244695 20077 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 312) took 7569 ms. Trace:
W20260709 12:20:37.271505 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.402681 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.403151 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.388505 20172 raft_consensus.cc:2376] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18. Re-sending same reply.
I20260709 12:20:37.388721 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.154708 20078 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 19 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.389060 20178 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:37.403373 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.147396 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:37.405014 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:36.983815 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:37.383304 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 364530us
I20260709 12:20:37.406963 20174 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:37.063606 20175 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:37.411494 20178 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:37.407248 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.406195 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.408056 20177 raft_consensus.cc:2393] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:37.408151 20327 raft_consensus.cc:606] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:37.205296 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.405453 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.415881 20078 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 13 to 18, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 18 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:37.417162 20294 leader_election.cc:336] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Timed out: RequestConsensusVote RPC to 127.18.132.66:37765 timed out after 1.772s (SENT)
I20260709 12:20:37.417647 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.387351 21035 rpcz_store.cc:276] 0709 12:20:35.258012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.258173 (+   161us) service_pool.cc:224] Handling call
0709 12:20:35.258667 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.258990 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:20:36.822267 (+1563277us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.075785 (+253518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:37.075856 (+    71us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:37.075909 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.075985 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.076142 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25552,"prepare.queue_time_us":639462,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":498,"raft.queue_time_us":46178,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":1761282,"threads_started":2,"wal-append.queue_time_us":175594}
I20260709 12:20:37.418689 20078 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.421625 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:37.425772 20178 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:37.426151 20178 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:37.427124 20172 raft_consensus.cc:3060] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:37.427523 20179 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:37.398883 20077 rpcz_store.cc:276] 0709 12:20:29.647861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.648180 (+   319us) service_pool.cc:224] Handling call
0709 12:20:29.753098 (+104918us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b54002d0190. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd4640 00007f5de0cab846 00007f5de0db590e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:20:36.750608 (+6997510us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:36.750645 (+    37us) write_op.cc:454] Released schema lock
0709 12:20:37.217357 (+466712us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:35.352362 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:35.353212 (+   850us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:35.353254 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:20:35.353281 (+    27us) tablet.cc:662] Decoding operations
0709 12:20:35.355467 (+  2186us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:35.355556 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:35.365673 (+ 10117us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:20:35.915125 (+549452us) tablet.cc:701] Row locks acquired
0709 12:20:35.915155 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:20:35.919889 (+  4734us) write_op.cc:270] Start()
0709 12:20:35.920053 (+   164us) write_op.cc:276] Timestamp: P: 1783599635919410 usec, L: 0
0709 12:20:35.920081 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:20:35.923046 (+  2965us) log.cc:844] Serialized 7544 byte log entry
0709 12:20:35.931445 (+  8399us) op_driver.cc:464] REPLICATION: finished
0709 12:20:36.037971 (+106526us) write_op.cc:301] APPLY: starting
0709 12:20:36.038076 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:36.277933 (+239857us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:36.278039 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:36.294666 (+ 16627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:36.294932 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:20:36.294962 (+    30us) write_op.cc:312] APPLY: finished
0709 12:20:36.295258 (+   296us) log.cc:844] Serialized 172 byte log entry
0709 12:20:36.295468 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:36.295697 (+   229us) write_op.cc:454] Released schema lock
0709 12:20:36.295758 (+    61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1091855,"reported_tablets":47,"spinlock_wait_cycles":9751936,"child_traces":[["op",{"apply.queue_time_us":106133,"apply.run_cpu_time_us":23689,"apply.run_wall_time_us":258245,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83661,"num_ops":19,"prepare.queue_time_us":684254,"prepare.run_cpu_time_us":10939,"prepare.run_wall_time_us":574448,"raft.queue_time_us":1110,"raft.run_cpu_time_us":20758,"raft.run_wall_time_us":94172,"replication_time_us":11150,"thread_start_us":2236368,"threads_started":4,"wal-append.queue_time_us":4155,"wal-append.run_cpu_time_us":4438,"wal-append.run_wall_time_us":1381061}]]}
I20260709 12:20:37.428682 20177 pending_rounds.cc:85] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:20:37.431190 20177 pending_rounds.cc:107] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 11.11
W20260709 12:20:37.423943 21008 connection.cc:256] RPC call timeout handler was delayed by -1.7175165229998584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:20:37.431955 20174 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:20:37.068918 27926 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:37.433591 20173 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:37.434257 20178 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.973312 27939 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.441061 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:37.436204 20177 raft_consensus.cc:2889] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:37.422492 20078 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.431888 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:37.441649 20324 raft_consensus.cc:3060] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:37.436677 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:37.437103 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.442713 20174 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:37.438431 20175 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:37.069123 27928 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:37.439986 20173 raft_consensus.cc:1240] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:37.444137 20078 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 17 to 19, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 19 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.445118 20178 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:37.442052 20171 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:37.445936 20078 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.448211 20078 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 14 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 17 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.404175 27783 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:37.450726 20176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4146) took 2984 ms. Trace:
I20260709 12:20:37.450526 20078 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.451110 20176 rpcz_store.cc:276] 0709 12:20:34.466424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.472651 (+  6227us) service_pool.cc:224] Handling call
0709 12:20:34.561620 (+ 88969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:36.769452 (+2207832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:36.769490 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:36.770025 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:20:37.039762 (+269737us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:37.039821 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.039937 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:37.450497 (+410560us) raft_consensus.cc:1685] finished
0709 12:20:37.450525 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.450664 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":187277,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":2476444,"threads_started":2,"wal-append.queue_time_us":269243}
I20260709 12:20:37.452060 20078 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 12, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 12 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.454221 20078 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.455300 28011 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.008106 27881 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.432721 27747 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:37.462781 20329 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:37.456209 20078 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:36.943419 27924 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:36.995330 27805 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.433950 27976 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:36.993466 27931 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:37.447528 27968 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:37.435750 27923 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.465233 20078 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.472000 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:37.474401 20178 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:20:37.475397 20178 pending_rounds.cc:85] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 12
I20260709 12:20:37.474776 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:37.475661 20178 pending_rounds.cc:107] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:20:37.477299 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:37.476605 20178 raft_consensus.cc:2889] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:37.476239 20329 raft_consensus.cc:2393] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:37.478227 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:37.480686 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.482160 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:37.482019 20078 catalog_manager.cc:5697] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 16 to 18, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 18 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.483246 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.483704 20078 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:37.485246 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.485394 20078 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 14 to 18, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 18 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.486510 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:37.487170 20326 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:37.488131 20328 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:37.480099 27774 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.004s
I20260709 12:20:37.490087 20078 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 4 to 12, term changed from 16 to 17, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to <none>, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 17 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.479190 27923 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:37.491437 27928 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:37.475962 27968 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:37.498189 20324 raft_consensus.cc:2468] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:37.471165 27747 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.464290 28011 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:37.507171 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:37.508299 20328 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:37.501868 20078 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 16 to 17, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.509672 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.510593 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:37.511354 20172 raft_consensus.cc:1275] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:37.511376 20324 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
W20260709 12:20:37.512864 20351 debug-util.cc:398] Leaking SignalData structure 0x7b0800101660 after lost signal to thread 18964
W20260709 12:20:37.513973 20351 debug-util.cc:398] Leaking SignalData structure 0x7b0800304ec0 after lost signal to thread 20112
I20260709 12:20:37.513262 20078 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 14 to 15, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:37.515192 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1680 after lost signal to thread 20204
W20260709 12:20:37.515415 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1660 after lost signal to thread 20205
I20260709 12:20:37.514994 20078 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 20, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 20 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.499576 27968 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:37.516808 20351 debug-util.cc:398] Leaking SignalData structure 0x7b0800294b60 after lost signal to thread 20280
W20260709 12:20:37.519639 20351 debug-util.cc:398] Leaking SignalData structure 0x7b080034bc20 after lost signal to thread 20281
W20260709 12:20:37.521080 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08003f82c0 after lost signal to thread 20354
W20260709 12:20:37.521440 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0c40 after lost signal to thread 20355
I20260709 12:20:37.524580 27931 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.516844 20078 catalog_manager.cc:5697] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 11 to 14, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:37.499379 27939 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:37.525411 27939 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:37.525911 27978 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.527940 28011 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.526814 20078 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 9 to 13, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 13 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.529078 27783 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.525866 27939 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.523398 27924 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.500000 27774 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.534587 27774 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.535388 21038 raft_consensus.cc:2393] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:37.562196 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 52615.8us
W20260709 12:20:37.586412 20351 debug-util.cc:398] Leaking SignalData structure 0x7b0800321920 after lost signal to thread 21072
W20260709 12:20:37.586985 20351 debug-util.cc:398] Leaking SignalData structure 0x7b08003495e0 after lost signal to thread 21073
I20260709 12:20:37.613919 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.614250 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:37.614784 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:37.615433 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.616127 20255 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:20:37.616276 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.614975 20248 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:37.618840 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.619501 21035 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:37.620785 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:37.621984 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.622284 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.628968 20251 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 22: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:37.630352 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.520416 27937 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:37.547863 27975 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.654485 20250 raft_consensus.cc:1240] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:37.656193 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.656970 20249 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:37.660539 20255 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:37.664353 20255 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:37.666306 21043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.020s	sys 0.063s
W20260709 12:20:37.666692 21043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.020s	sys 0.063s
I20260709 12:20:37.668296 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:37.669359 20249 raft_consensus.cc:2393] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 21: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:37.670118 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:37.504129 27923 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.638298 27783 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:20:37.671497 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 44063us
I20260709 12:20:37.698945 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:37.673309 21008 connection.cc:256] RPC call timeout handler was delayed by -1.15337757899988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:20:37.704325 21008 connection.cc:256] RPC call timeout handler was delayed by -1.0650165229999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2788s for a response
W20260709 12:20:37.705672 21008 connection.cc:256] RPC call timeout handler was delayed by -1.0458494279998831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3247s for a response
I20260709 12:20:37.708333 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.709386 21034 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 23: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:37.634352 27771 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:20:37.722362 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:20:37.724279 20220 connection.cc:256] RPC call timeout handler was delayed by -1.3633864609998909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 12:20:37.726059 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.728888 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:37.729745 20256 raft_consensus.cc:3060] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.739166 21007 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:37.754838 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.755527 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:37.748088 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.749984 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:37.745550 20256 raft_consensus.cc:2468] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:37.750664 20250 raft_consensus.cc:1275] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:20:37.752177 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 668688us
I20260709 12:20:37.755544 20247 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 25.
W20260709 12:20:37.759280 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 89237.8us
I20260709 12:20:37.710309 27942 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.737581 27976 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:37.768401 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.769073 21034 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 16.
I20260709 12:20:37.769479 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:37.770092 20247 raft_consensus.cc:2376] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16. Re-sending same reply.
I20260709 12:20:37.736865 27975 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:37.765496 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:37.764139 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.763633 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:20:37.766165 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 63828.8us
I20260709 12:20:37.765030 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.744364 27774 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:37.776291 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:37.794118 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.797091 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.807487 20326 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:37.755138 27881 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:37.809760 20250 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:37.811527 20247 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:37.820044 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:37.822760 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:37.823448 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:37.767740 27928 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:37.768704 27976 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.840137 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:37.844170 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.846776 20250 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:37.838510 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:37.763053 28023 raft_consensus.cc:2804] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:37.856678 28023 raft_consensus.cc:697] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:37.857705 28023 consensus_queue.cc:237] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.818998 27975 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:37.859900 21037 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 22: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:37.860944 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:37.840502 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.754446 27924 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:20:37.855829 27747 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:37.862990 21008 leader_election.cc:336] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.063s (SENT)
I20260709 12:20:37.863502 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.862962 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:37.764978 27925 consensus_queue.cc:1059] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:20:37.805754 27774 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.875625 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:37.877679 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.867805 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.888129 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.888572 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.877796 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:37.859831 27937 raft_consensus.cc:2764] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
W20260709 12:20:37.878445 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 109542us
I20260709 12:20:37.897528 20247 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:37.879787 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:37.900095 21043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1708) took 2622 ms. Trace:
I20260709 12:20:37.900530 21043 rpcz_store.cc:276] 0709 12:20:35.257498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.257761 (+   263us) service_pool.cc:224] Handling call
0709 12:20:35.261632 (+  3871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.730512 (+1468880us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:37.122914 (+392402us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.688172 (+565258us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.688441 (+   269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:37.688502 (+    61us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:37.688565 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:37.879666 (+191101us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540056e354. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:37.879729 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:37.879869 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33862,"prepare.queue_time_us":270529,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":28693,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":2266,"spinlock_wait_cycles":3442456832,"thread_start_us":907211,"threads_started":2,"wal-append.queue_time_us":632058}
W20260709 12:20:37.860451 27997 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 12:20:37.842463 27928 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.900708 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:37.861819 27976 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:20:37.920796 28009 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.518s	user 0.003s	sys 0.000s
I20260709 12:20:37.925367 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:37.926376 20295 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:37.928076 27771 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:37.930061 27771 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:37.931795 27756 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:37.932271 27756 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:37.932701 27756 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.933629 27923 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:37.935809 27929 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:37.936262 27929 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.936631 27929 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:37.937348 28017 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:37.937824 28017 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.938170 28017 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:37.939816 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.927553 27864 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:37.941035 27864 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:37.942018 27864 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:37.942709 27964 raft_consensus.cc:3055] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:37.943245 27964 raft_consensus.cc:740] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:37.945168 28020 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:20:37.944504 27964 consensus_queue.cc:260] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:37.946906 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.896927 27774 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:37.821445 28014 consensus_queue.cc:1059] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.126s
I20260709 12:20:37.951812 27928 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:37.952621 27975 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:37.953658 27925 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:37.963497 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 200029us
W20260709 12:20:37.980160 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.981840 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:37.984216 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 220702us
W20260709 12:20:37.971477 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.971820 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.002732 20326 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:20:37.986326 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:37.987109 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.004370 20254 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:38.003132 20251 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:37.987918 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.005954 20252 raft_consensus.cc:2393] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 23: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:37.967923 20328 raft_consensus.cc:2468] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:38.006184 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:38.001905 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.984150 28014 raft_consensus.cc:3055] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:38.007849 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:38.017841 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.021132 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:38.022094 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.023002 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.024269 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.024927 20251 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 11.
I20260709 12:20:38.026067 20254 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:38.027129 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.004598 27964 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.032652 27756 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.034860 27756 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:38.036170 27939 consensus_meta.cc:287] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 12:20:38.036643 27939 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:38.037581 28010 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.637s	user 0.005s	sys 0.006s
I20260709 12:20:38.044991 21041 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:38.031363 27926 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.002s
I20260709 12:20:38.044862 21038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53126 (request call id 1716) took 1182 ms. Trace:
W20260709 12:20:38.055461 20220 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.743s (SENT)
I20260709 12:20:38.060532 21038 rpcz_store.cc:276] 0709 12:20:36.862637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.864420 (+  1783us) service_pool.cc:224] Handling call
0709 12:20:38.044638 (+1180218us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400665654. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:38.044798 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540566784}
W20260709 12:20:38.061609 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.064077 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:38.064838 20255 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:38.070713 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 310600us
W20260709 12:20:38.029862 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55949.1us
W20260709 12:20:38.087800 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 224870us
W20260709 12:20:38.089202 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.159s (SENT)
I20260709 12:20:38.013721 28014 raft_consensus.cc:740] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:38.048458 28008 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.646s	user 0.000s	sys 0.003s
I20260709 12:20:38.072950 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:38.102077 27805 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:38.106416 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.060009 27928 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.117152 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.036105 27925 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 12:20:38.094641 20144 leader_election.cc:400] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:38.075533 27926 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:38.102267 28017 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:38.118877 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.038909 27929 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:38.095584 27939 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:38.131775 20144 leader_election.cc:403] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:20:38.132529 21035 raft_consensus.cc:1240] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 21. Current term is 22. Ops: []
W20260709 12:20:38.144487 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 59012.3us
I20260709 12:20:38.119248 20255 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:20:38.142921 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.116907 27771 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:38.152683 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.132696 28016 raft_consensus.cc:993] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:20:38.157262 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.158934 20253 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 24. Current term is 25. Ops: []
I20260709 12:20:38.149519 27939 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:38.163671 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.165597 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.164574 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.128335 27925 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:38.160424 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:38.168452 21007 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.141707 27929 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:38.135465 28017 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:38.155176 27771 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:38.164927 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.169413 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1414) took 1148 ms. Trace:
W20260709 12:20:38.153781 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 226602us
I20260709 12:20:38.161496 28036 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.161687 27964 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:38.176736 28012 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 12:20:38.176833 27928 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:38.177304 27924 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:38.166826 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1415) took 1145 ms. Trace:
I20260709 12:20:38.237138 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.125996 27774 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.237185 20180 rpcz_store.cc:276] 0709 12:20:37.021439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.438554 (+417115us) service_pool.cc:224] Handling call
0709 12:20:37.438870 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:37.445435 (+  6565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:37.445469 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:37.463529 (+ 18060us) log.cc:844] Serialized 26 byte log entry
0709 12:20:37.743881 (+280352us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:38.155048 (+411167us) log.cc:844] Serialized 14 byte log entry
0709 12:20:38.166495 (+ 11447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.166570 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.166612 (+    42us) raft_consensus.cc:1685] finished
0709 12:20:38.166623 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.166720 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5866,"prepare.queue_time_us":209002,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":1533,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":46601,"thread_start_us":651014,"threads_started":2,"wal-append.queue_time_us":465864}
I20260709 12:20:38.212803 21034 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:38.198563 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.211305 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.182773 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:38.243126 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.243257 20252 raft_consensus.cc:3060] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:20:38.182394 20249 raft_consensus.cc:1240] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:38.142115 27976 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.225000 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.161465 28037 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:38.232501 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.223711 20177 rpcz_store.cc:276] 0709 12:20:37.021173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.428023 (+406850us) service_pool.cc:224] Handling call
0709 12:20:37.428401 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:37.462323 (+ 33922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:37.462365 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:37.463001 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:20:37.636434 (+173433us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:37.762400 (+125966us) log.cc:844] Serialized 14 byte log entry
0709 12:20:37.765883 (+  3483us) log.cc:844] Serialized 14 byte log entry
0709 12:20:38.167329 (+401446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:38.167415 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:38.169164 (+  1749us) raft_consensus.cc:1685] finished
0709 12:20:38.169182 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:38.169344 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20767,"prepare.queue_time_us":503531,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":87353,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":30890,"thread_start_us":597388,"threads_started":3,"wal-append.queue_time_us":259515}
I20260709 12:20:38.235654 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.223055 27771 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:38.214676 27926 raft_consensus.cc:2804] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:38.261569 27926 raft_consensus.cc:697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.262555 27926 consensus_queue.cc:237] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.237223 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.266278 20252 raft_consensus.cc:2468] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:20:38.233385 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.238818 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.267933 20256 raft_consensus.cc:2393] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 23: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:38.239899 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:38.225790 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:38.245134 21035 raft_consensus.cc:2410] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:20:38.252770 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.254408 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.255813 27924 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.167821 27925 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.256011 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.241675 27756 raft_consensus.cc:1081] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Signalling peer 8aef67aa330543a191ab5ab5dc30e84c to start an election
I20260709 12:20:38.284029 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.282512 20255 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:38.237538 28019 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:20:38.167521 27783 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:38.290531 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 50761.4us
I20260709 12:20:38.285123 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:38.293990 20144 connection.cc:256] RPC call timeout handler was delayed by -2.9392514899998332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 12:20:38.295094 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.295094 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:38.296113 20328 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 24: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:38.296846 20144 connection.cc:256] RPC call timeout handler was delayed by -2.9392514899998332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 12:20:38.300454 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:38.301396 20295 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:38.238108 28013 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:20:38.295182 28035 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.238410 28036 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:38.174504 28014 consensus_queue.cc:260] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.303664 28039 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:38.316205 28036 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:38.320951 20219 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:38.322304 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:38.323089 20178 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
W20260709 12:20:38.323410 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 167026us
I20260709 12:20:38.317345 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:38.324873 20177 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:38.325596 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:38.331105 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:38.323377 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:38.332000 20180 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 12.
W20260709 12:20:38.300473 20144 connection.cc:256] RPC call timeout handler was delayed by -2.8852514899997459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 12:20:38.336202 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:38.327486 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:38.339805 20178 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.339984 20247 raft_consensus.cc:2376] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19. Re-sending same reply.
I20260709 12:20:38.352490 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:38.353495 20176 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
W20260709 12:20:38.355849 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.313532 28039 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:38.314007 28031 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:38.365018 20144 connection.cc:256] RPC call timeout handler was delayed by -2.8852514899997459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 12:20:38.317261 28014 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:38.367821 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 277512us
W20260709 12:20:38.389564 20144 connection.cc:256] RPC call timeout handler was delayed by -2.82135148999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 12:20:38.390162 20144 connection.cc:256] RPC call timeout handler was delayed by -2.82135148999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 12:20:38.390192 21008 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.788s (SENT)
W20260709 12:20:38.391381 20144 connection.cc:256] RPC call timeout handler was delayed by -2.7538514899997608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:20:38.391979 20144 connection.cc:256] RPC call timeout handler was delayed by -2.7538514899997608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:20:38.392603 20144 connection.cc:256] RPC call timeout handler was delayed by -2.7493514899997535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:20:38.393201 20144 connection.cc:256] RPC call timeout handler was delayed by -2.7493514899997535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:20:38.393659 20144 connection.cc:256] RPC call timeout handler was delayed by -2.7232514899999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:20:38.394122 20144 connection.cc:256] RPC call timeout handler was delayed by -2.7232514899999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 12:20:38.394570 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6647514899998441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 12:20:38.394961 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6647514899998441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 12:20:38.395450 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6449514899998121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:20:38.395944 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6449514899998121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:20:38.396351 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6260514899997816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:20:38.396876 20144 connection.cc:256] RPC call timeout handler was delayed by -2.6260514899997816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 12:20:38.370949 20178 raft_consensus.cc:2468] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:38.327710 28017 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:38.425082 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.390872 21008 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:38.311118 28035 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:38.404558 27968 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.843s	user 0.004s	sys 0.009s
W20260709 12:20:38.426927 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 3.130s (SENT)
I20260709 12:20:38.433976 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:38.310206 27925 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.388083 28039 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.440716 27771 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.407361 27805 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:38.435837 20179 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:38.313982 27924 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.449719 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:38.453929 20175 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.428280 27942 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:38.452358 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:38.467497 20247 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:20:38.450863 20144 connection.cc:256] RPC call timeout handler was delayed by -2.594551489999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:20:38.468497 20144 connection.cc:256] RPC call timeout handler was delayed by -2.594551489999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:20:38.468906 20144 connection.cc:256] RPC call timeout handler was delayed by -2.5936514899999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 12:20:38.469237 20144 connection.cc:256] RPC call timeout handler was delayed by -2.5936514899999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 12:20:38.469630 20144 connection.cc:256] RPC call timeout handler was delayed by -2.5360514899998634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 12:20:38.469987 20144 connection.cc:256] RPC call timeout handler was delayed by -2.5054514899998139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:20:38.470296 20144 connection.cc:256] RPC call timeout handler was delayed by -2.483851489999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 12:20:38.470600 20144 connection.cc:256] RPC call timeout handler was delayed by -2.483851489999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 12:20:38.470968 20144 connection.cc:256] RPC call timeout handler was delayed by -2.4091514899998856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 12:20:38.456717 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:38.457818 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.472843 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.458925 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.471308 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2597514899998714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23270000000000002s for a response
W20260709 12:20:38.475524 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7449514899999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2899s for a response
W20260709 12:20:38.475930 20144 connection.cc:256] RPC call timeout handler was delayed by -1.7449514899999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2899s for a response
W20260709 12:20:38.476298 20144 connection.cc:256] RPC call timeout handler was delayed by -1.69635148999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2953s for a response
W20260709 12:20:38.476656 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5964514899999358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3064s for a response
W20260709 12:20:38.476972 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5595514899998761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3105s for a response
W20260709 12:20:38.482239 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.464049 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 137094us
I20260709 12:20:38.491663 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:20:38.493662 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.494777 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.499418 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.501718 20179 raft_consensus.cc:2468] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:38.503187 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:38.501916 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.504619 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.505764 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.506394 20323 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.507638 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.508548 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.510586 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.505420 20176 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 16.
I20260709 12:20:38.451395 27774 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:38.515146 21007 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:38.518530 20330 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:38.519496 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:38.515924 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 182864us
I20260709 12:20:38.526693 20175 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:38.534166 20247 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:20:38.536248 27964 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:38.536341 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.543413 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:38.546200 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.444053 27968 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:38.550381 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:38.551046 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 81642.7us
W20260709 12:20:38.551198 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 162388us
I20260709 12:20:38.551467 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.491225 27925 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.496541 27976 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:38.524690 28048 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:20:38.522140 27928 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:38.510608 28038 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:20:38.572292 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.563153 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:38.565994 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:38.550818 28047 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:20:38.548120 27747 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:38.587827 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.558347 27939 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:38.593281 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:38.560856 28032 raft_consensus.cc:2804] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:38.587533 20323 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:38.557586 28031 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:38.566571 28072 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:20:38.602694 28060 consensus_queue.cc:1059] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
W20260709 12:20:38.610411 28051 log.cc:927] Time spent T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:20:38.609961 28056 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:20:38.603046 28022 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:38.614380 28072 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:38.614773 28072 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.615103 28072 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:38.615882 28069 raft_consensus.cc:3055] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:38.616291 28069 raft_consensus.cc:740] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:38.617081 28069 consensus_queue.cc:260] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.618358 28069 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:38.587916 27928 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:38.611469 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.619872 27928 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:38.620105 28067 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:38.620663 28067 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:38.583984 28038 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:38.595953 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.609414 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:38.622618 20325 raft_consensus.cc:2393] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 12: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:38.621619 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.623199 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 128510us
W20260709 12:20:38.623618 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.563639 28015 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:20:38.638772 20294 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:38.639659 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.595398 28042 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 12:20:38.585878 27942 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:38.648644 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.589766 28016 raft_consensus.cc:2764] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:20:38.667872 20325 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.652849 20144 leader_election.cc:400] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21.
I20260709 12:20:38.668933 20144 leader_election.cc:403] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:20:38.653645 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.590498 27747 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.673125 20179 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:38.670071 20323 raft_consensus.cc:2393] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:38.674723 20179 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:38.675012 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.566005 27756 consensus_queue.cc:1048] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 12:20:38.632848 28038 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:38.666971 27942 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:38.589955 27964 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 12:20:38.584100 27774 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:20:38.596668 28017 consensus_queue.cc:1059] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:20:38.646183 28032 raft_consensus.cc:697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.646638 28055 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:38.589723 27976 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:20:38.690614 20327 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 23: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:38.604936 28023 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.078s
I20260709 12:20:38.687740 27942 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:38.702072 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 135015us
I20260709 12:20:38.709718 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:38.712745 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 158661us
I20260709 12:20:38.692600 28055 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:38.715716 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:38.702276 28016 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:38.714586 21007 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:38.728708 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86255.6us
I20260709 12:20:38.694289 28068 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:38.735334 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 96658.9us
I20260709 12:20:38.701858 28078 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:38.712054 28015 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.736841 20294 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:38.741041 20325 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:38.746515 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.746860 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:38.747363 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:38.748657 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:38.748486 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.753788 21035 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:38.756477 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:38.748486 28058 log.cc:927] Time spent T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 12:20:38.758037 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.749018 27752 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:38.693660 28067 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.754175 28015 raft_consensus.cc:2804] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:38.752161 28068 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:38.773877 27747 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.756577 27926 consensus_queue.cc:1059] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:20:38.783012 28073 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:38.785930 28073 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.785996 27747 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:38.710613 28031 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:38.780560 28059 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:20:38.752641 28082 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.759128 27968 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:38.775727 27752 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:38.796209 28089 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.775353 27924 consensus_queue.cc:1048] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:20:38.810082 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:38.794039 28071 log.cc:927] Time spent T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:20:38.784730 28068 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.786209 27964 raft_consensus.cc:3055] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:38.792836 28073 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.790146 27939 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21.
I20260709 12:20:38.747840 28032 consensus_queue.cc:237] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.827875 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:38.837373 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:38.792797 28083 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
W20260709 12:20:38.825677 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 164934us
I20260709 12:20:38.830147 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:38.840647 21035 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:38.831645 28075 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:20:38.819520 27968 raft_consensus.cc:993] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:20:38.790001 28015 raft_consensus.cc:697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.842595 20295 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.807432 27928 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:38.849483 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 95241.7us
W20260709 12:20:38.849623 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 135234us
I20260709 12:20:38.833863 28078 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.864225 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:38.880738 20325 raft_consensus.cc:3060] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:20:38.866122 28085 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:20:38.868198 27783 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:38.759806 28055 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:38.873196 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.875111 20323 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:20:38.877147 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.878382 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.829772 27964 raft_consensus.cc:740] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:38.828925 28068 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:38.862540 27752 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:38.826390 28072 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:38.889599 28081 raft_consensus.cc:2764] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
W20260709 12:20:38.905063 28094 log.cc:927] Time spent T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260709 12:20:38.905575 28039 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:38.863526 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.872054 21035 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:38.892961 27783 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:38.851549 28035 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:38.908774 28035 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:38.908865 27783 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:38.909852 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46430.3us
I20260709 12:20:38.894165 27964 consensus_queue.cc:260] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.913462 27964 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:38.888804 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 46965.9us
I20260709 12:20:38.903349 27928 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:38.895386 28093 raft_consensus.cc:2804] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:38.899142 27752 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:38.917424 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 54756.5us
I20260709 12:20:38.895750 28095 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.919049 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:38.893396 28015 consensus_queue.cc:237] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.901824 28072 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:38.931814 28095 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:38.934559 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:38.923643 20325 raft_consensus.cc:2468] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:20:38.883803 28089 raft_consensus.cc:1081] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:20:38.945485 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:38.931186 27942 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:38.970192 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.997725 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.994074 20219 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:39.023869 20219 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:38.917147 27881 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 12:20:38.998272 28013 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.997090 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:39.069149 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.945960 28093 raft_consensus.cc:697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:39.000262 20325 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:39.072263 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 47408.5us
I20260709 12:20:39.000550 28035 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.134330 20254 raft_consensus.cc:1275] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:20:39.136412 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 135658us
I20260709 12:20:39.136734 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:39.137560 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.071027 27805 raft_consensus.cc:3055] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:39.007196 28081 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:39.004956 27928 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:39.088829 28036 raft_consensus.cc:993] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
W20260709 12:20:39.139364 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 274688us
I20260709 12:20:39.071334 28065 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:39.023276 28067 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:39.150943 28069 consensus_meta.cc:287] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.000s
I20260709 12:20:39.144224 27805 raft_consensus.cc:740] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:39.163702 28089 raft_consensus.cc:1081] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:39.160120 28065 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:39.153945 27928 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.178190 28038 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.186237 28099 consensus_queue.cc:1059] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.180s
I20260709 12:20:39.187427 28038 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.187851 28099 raft_consensus.cc:3055] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:39.188331 27942 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:39.189077 28092 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
W20260709 12:20:39.190429 28096 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:20:39.190836 28082 consensus_queue.cc:1048] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:39.170915 28093 consensus_queue.cc:237] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.193787 28073 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.196054 28066 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:39.196331 28073 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:39.196867 28066 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:39.198112 28066 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:39.201555 28080 log.cc:927] Time spent T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.445s	user 0.007s	sys 0.000s
I20260709 12:20:39.177713 28068 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.205616 28068 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:39.173125 28064 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.266s
W20260709 12:20:39.214391 28022 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 12:20:39.222723 28039 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:39.172578 28101 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.218s
I20260709 12:20:39.226876 28055 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:39.159795 28067 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.242650 28067 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:39.233866 28100 log.cc:927] Time spent T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:20:39.244266 28101 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:20:39.244867 28101 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:39.246061 28101 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.235970 28095 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:39.252647 28065 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.261138 28101 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:39.188424 28099 raft_consensus.cc:740] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:39.262984 28099 consensus_queue.cc:260] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.264739 28099 raft_consensus.cc:3060] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:39.157895 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 239754us
W20260709 12:20:39.375275 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.377991 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.382295 27771 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:39.384738 20254 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:39.385267 21038 raft_consensus.cc:1240] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:39.385700 21035 raft_consensus.cc:1240] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:39.387574 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:39.391392 28017 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.392526 28017 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.188709 27805 consensus_queue.cc:260] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.232677 27928 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.371419 20295 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:39.458257 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.460924 28022 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:39.462911 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:39.463699 27783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.013s
I20260709 12:20:39.464018 28101 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:39.466816 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 329241us
I20260709 12:20:39.467536 20322 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:39.468261 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.468999 20325 raft_consensus.cc:1275] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:39.469926 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:39.472134 27939 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:39.476226 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 105530us
I20260709 12:20:39.480741 28017 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.483742 20327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:39.505220 20327 raft_consensus.cc:606] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:39.505450 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.506393 28101 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.484930 27925 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:39.485086 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 114147us
W20260709 12:20:39.488205 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.488060 28022 raft_consensus.cc:2804] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:39.488459 27805 raft_consensus.cc:3060] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:39.493683 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.495898 28108 consensus_queue.cc:1059] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:39.497272 27881 consensus_queue.cc:1059] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:39.499076 21039 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:39.498986 28081 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:39.502543 27783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.000s	sys 0.014s
I20260709 12:20:39.507114 27939 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.507182 28101 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.531443 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:39.531885 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:39.544332 20323 raft_consensus.cc:606] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.545960 20323 raft_consensus.cc:614] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:39.534062 28022 raft_consensus.cc:697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:39.548797 28067 raft_consensus.cc:3055] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:39.551905 27939 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:39.556133 28015 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:39.558800 28015 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:39.560020 27928 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:39.560534 28013 raft_consensus.cc:3055] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:39.560676 27928 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:39.561122 28013 raft_consensus.cc:740] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:20:39.562019 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.566154 28107 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:39.566975 28107 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.568027 27975 raft_consensus.cc:3055] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:39.568506 27975 raft_consensus.cc:740] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:39.569708 28107 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.569725 27975 consensus_queue.cc:260] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.571801 27975 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:39.572009 20327 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:39.574323 20326 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:39.575965 20326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43354 (request call id 1777) took 1078 ms. Trace:
I20260709 12:20:39.576334 20326 rpcz_store.cc:276] 0709 12:20:38.497798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.497997 (+   199us) service_pool.cc:224] Handling call
0709 12:20:38.500990 (+  2993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:39.574868 (+1073878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.575709 (+   841us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000866d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:39.575894 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467022592}
I20260709 12:20:39.551237 28067 raft_consensus.cc:740] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:39.562569 27928 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.583348 28067 consensus_queue.cc:260] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.583745 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:39.584637 27928 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.584642 20326 raft_consensus.cc:606] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.585028 28067 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:39.588311 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 64911.3us
I20260709 12:20:39.588657 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:39.588572 28022 consensus_queue.cc:237] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.589562 20326 raft_consensus.cc:606] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.590101 20326 raft_consensus.cc:614] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:39.592692 21039 raft_consensus.cc:1240] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:39.594417 28062 consensus_queue.cc:1048] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:39.596242 20326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:39.596388 28081 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.597010 20326 raft_consensus.cc:606] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.597781 20326 raft_consensus.cc:614] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:39.603933 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54673.5us
I20260709 12:20:39.605369 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:39.607923 28031 raft_consensus.cc:2764] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:20:39.608255 20295 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:39.589564 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.610190 28105 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:39.610946 28105 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:39.613296 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.612756 28105 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.617024 27939 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:39.617444 28101 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:39.618224 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 76302.1us
I20260709 12:20:39.617954 28089 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:39.618898 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:39.619297 27771 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:39.619313 27925 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:39.631031 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.631492 28066 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:39.632722 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.632637 27964 consensus_meta.cc:287] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.719s	user 0.019s	sys 0.005s
I20260709 12:20:39.633301 20248 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:39.638006 28114 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.658104 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:39.658957 20247 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 25.
I20260709 12:20:39.667441 20219 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:39.562583 28013 consensus_queue.cc:260] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.681973 27925 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:39.648152 28108 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:20:39.647994 28015 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.640446 27975 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:39.686622 21008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.761s (SENT) [suppressed 24 similar messages]
I20260709 12:20:39.697422 28036 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.698025 28036 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.655853 28066 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:39.696136 28107 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:39.719709 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 108998us
I20260709 12:20:39.709272 28015 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.724203 27975 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:39.754703 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 105274us
I20260709 12:20:39.751936 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:39.773465 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:39.780443 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.795431 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.796092 28055 consensus_meta.cc:287] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.015s
I20260709 12:20:39.803606 27774 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:39.804292 28083 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:39.805470 20255 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:20:39.805217 28083 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.803740 20247 raft_consensus.cc:2393] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 24: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:39.777688 27747 consensus_meta.cc:287] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.901s	user 0.020s	sys 0.004s
I20260709 12:20:39.810482 20144 leader_election.cc:400] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19.
I20260709 12:20:39.777612 28078 raft_consensus.cc:2764] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:20:39.814363 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:39.815338 20253 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:39.815917 28015 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:39.800266 28036 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:39.822448 27923 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.847713 20256 raft_consensus.cc:1275] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:39.856074 27923 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:39.840745 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 183312us
I20260709 12:20:39.867444 27975 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.875499 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:39.859275 27923 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.817817 28081 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:39.882383 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69775.7us
I20260709 12:20:39.886000 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:39.892233 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:39.883803 20219 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:39.911520 20250 raft_consensus.cc:2368] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24.
W20260709 12:20:39.921397 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.932243 20178 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:39.941190 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.944046 28065 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:39.946091 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 199366us
I20260709 12:20:39.947132 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:39.942905 28032 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:20:39.949868 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a633082b519c485f8ea5b7f711895275"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:39.950155 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:39.950750 28114 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:39.951860 28114 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:39.958981 28099 consensus_meta.cc:287] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.694s	user 0.015s	sys 0.005s
I20260709 12:20:39.959996 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:39.961885 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:39.962800 20177 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.939893 28066 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.973906 28078 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:39.974745 28078 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:39.977478 28078 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:39.979286 20327 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 12:20:39.979737 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 143456us
I20260709 12:20:39.979130 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:39.983919 28083 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:39.996678 20330 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:39.997733 20178 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:39.998746 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:40.003429 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.010529 21043 raft_consensus.cc:1240] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:40.010782 21041 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:40.014074 28078 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.945643 28081 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.015229 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.016201 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.017813 20322 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:40.017884 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:40.018847 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:40.020284 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 47488us
I20260709 12:20:40.022646 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:40.023716 27783 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:40.028592 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:40.029431 20180 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:40.027222 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:40.036126 20177 raft_consensus.cc:2468] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 17.
I20260709 12:20:40.036649 27783 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:40.038304 28081 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:40.035784 28066 consensus_queue.cc:1059] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:20:40.037662 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:40.041085 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.041572 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.041805 20322 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 25.
I20260709 12:20:40.034397 28078 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:40.044754 20323 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:40.044371 28078 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.049294 28066 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.050215 20171 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.050282 21039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
 from {username='slave'} at 127.0.0.1:53126
W20260709 12:20:40.050876 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.050947 21039 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.051486 21039 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.054023 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:40.054507 20171 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:40.049966 28066 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.060448 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:40.063943 20253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:53430
I20260709 12:20:40.064610 20253 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.065050 20253 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:40.066887 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:40.068184 27747 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.068588 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:40.069337 20252 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.068961 27747 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.063969 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:40.081378 20256 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:40.047719 28078 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:40.086580 21008 leader_election.cc:336] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.043s (SENT)
I20260709 12:20:40.099290 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:40.099763 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.100399 20323 raft_consensus.cc:2393] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 19: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:40.079380 28065 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:20:40.107465 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.118932 28022 consensus_queue.cc:1059] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:40.113277 20326 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:40.113979 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:40.108361 28130 log.cc:927] Time spent T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:40.120187 28036 raft_consensus.cc:3055] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:40.085951 21039 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.128028 20256 raft_consensus.cc:2468] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:40.128461 20180 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:40.128815 20252 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:20:40.084785 28081 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:40.129971 28036 raft_consensus.cc:740] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:40.132776 20171 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.134480 21039 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:40.135994 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.138207 28066 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:40.139884 20248 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:40.146607 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:40.149881 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 112399us
I20260709 12:20:40.151878 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.152045 20171 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:40.147734 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:40.153908 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:39.942021 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:40.156453 28036 consensus_queue.cc:260] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.158437 28036 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:40.164335 20326 raft_consensus.cc:1275] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:20:40.164203 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:40.165716 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.158764 20249 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:40.145848 27747 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:40.174876 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.171891 21041 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:40.176839 27964 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:40.178455 21007 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:40.183163 20325 raft_consensus.cc:1275] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:40.181671 28062 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.005s
I20260709 12:20:40.188778 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.191525 27926 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.190093 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:40.192593 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:40.196761 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.199540 20330 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:40.202670 20256 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:40.204595 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.206148 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:40.192095 27926 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.207026 20073 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 12 to 4, term changed from 17 to 16, leader changed from <none> to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68), VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) added. New cstate: current_term: 16 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:40.209429 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:40.210242 20251 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:40.196203 28065 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:40.211081 28065 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.209522 27926 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:40.225080 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.224241 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:40.210264 20073 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:40.211447 28065 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:40.177520 27964 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.234333 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.200721 27747 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:40.227888 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:40.239189 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:40.237967 20323 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:20:40.245340 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.250277 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.228192 28032 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:40.266546 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.268661 20078 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 211) took 10282 ms. Trace:
I20260709 12:20:40.268946 28062 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:40.268765 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:40.272256 28013 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:40.278602 20219 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:40.280539 28108 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:40.280992 27805 consensus_queue.cc:1059] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:40.292621 20325 raft_consensus.cc:3055] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:40.227005 28078 raft_consensus.cc:2764] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:20:40.291079 20330 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:40.293635 20325 raft_consensus.cc:740] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:40.295459 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.295949 28108 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:40.242465 27747 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.296320 27805 raft_consensus.cc:3055] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:40.299502 28108 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:40.308200 28108 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.284197 28032 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.291343 28062 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.235904 27926 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.080s
I20260709 12:20:40.327008 20253 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.303829 28107 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:40.300076 27747 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:40.338222 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 155342us
I20260709 12:20:40.305016 27805 raft_consensus.cc:740] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:20:40.350494 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.354545 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.330104 28032 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:40.388746 20248 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:40.336905 28062 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:40.389300 20326 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:40.340449 28067 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.405262 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 126762us
W20260709 12:20:40.412173 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.521s (SENT)
I20260709 12:20:40.412983 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:40.411103 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:40.421751 28157 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.423585 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:40.435290 28144 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:20:40.434930 28157 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.437649 28157 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:40.437403 28131 consensus_queue.cc:1048] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.133s
I20260709 12:20:40.435423 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.438730 20326 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:40.441354 28108 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:40.432999 20144 leader_election.cc:400] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21.
I20260709 12:20:40.444862 20144 leader_election.cc:403] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:20:40.445171 28135 consensus_queue.cc:1048] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 12:20:40.446647 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.447755 28081 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Leader election lost for term 20. Reason: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21.
I20260709 12:20:40.448091 27964 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:40.449261 28140 log.cc:927] Time spent T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:20:40.452718 20330 raft_consensus.cc:2393] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:20:40.442157 28139 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 12:20:40.464391 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.465371 20178 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:40.447759 28061 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:20:40.476847 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 135681us
I20260709 12:20:40.479537 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:40.481726 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.485291 20330 raft_consensus.cc:2393] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 17: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:40.485391 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.488353 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.471050 28061 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.496838 20179 raft_consensus.cc:1240] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:40.457103 28067 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:40.509060 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 45705.8us
I20260709 12:20:40.460974 27923 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:20:40.510196 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:40.286355 20078 rpcz_store.cc:276] 0709 12:20:29.986173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.986373 (+   200us) service_pool.cc:224] Handling call
0709 12:20:40.268292 (+10281919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:37.855258 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:37.855947 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:37.855992 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:20:37.856016 (+    24us) tablet.cc:662] Decoding operations
0709 12:20:37.857946 (+  1930us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:37.858021 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:37.858060 (+    39us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:20:37.875411 (+ 17351us) tablet.cc:701] Row locks acquired
0709 12:20:37.875431 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:20:37.875641 (+   210us) write_op.cc:270] Start()
0709 12:20:37.875791 (+   150us) write_op.cc:276] Timestamp: P: 1783599637875567 usec, L: 0
0709 12:20:37.875816 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:20:37.985444 (+109628us) log.cc:844] Serialized 8222 byte log entry
0709 12:20:38.620852 (+635408us) op_driver.cc:464] REPLICATION: finished
0709 12:20:38.796529 (+175677us) write_op.cc:301] APPLY: starting
0709 12:20:38.796639 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:39.186364 (+389725us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:39.186476 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:39.200167 (+ 13691us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:39.200689 (+   522us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:20:39.200771 (+    82us) write_op.cc:312] APPLY: finished
0709 12:20:39.201383 (+   612us) log.cc:844] Serialized 188 byte log entry
0709 12:20:39.229427 (+ 28044us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:39.229748 (+   321us) write_op.cc:454] Released schema lock
0709 12:20:39.229847 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:39.235614 (+  5767us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:39.235661 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":155259,"apply.run_cpu_time_us":30630,"apply.run_wall_time_us":447470,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92033,"num_ops":21,"prepare.queue_time_us":316992,"prepare.run_cpu_time_us":16834,"prepare.run_wall_time_us":248136,"raft.queue_time_us":331916,"raft.run_cpu_time_us":6005,"raft.run_wall_time_us":90408,"replication_time_us":744842,"thread_start_us":560717,"threads_started":4,"wal-append.queue_time_us":188775,"wal-append.run_cpu_time_us":84113,"wal-append.run_wall_time_us":2026858}]]}
W20260709 12:20:40.548142 28146 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:20:40.514297 27928 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.547534 28095 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 12:20:40.556250 20174 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:40.561980 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.557844 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.508941 28061 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:40.484123 27975 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:20:40.564431 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.560142 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:40.564311 20295 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:40.574617 27923 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:40.576462 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:40.583998 20179 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:40.555655 28055 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:40.588531 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76223.8us
I20260709 12:20:40.591156 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.596899 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:40.597958 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:40.589960 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:40.605058 20180 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:40.590088 20250 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:40.610265 21038 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:40.583554 28131 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:40.614194 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.493232 27805 consensus_queue.cc:260] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:40.618661 28152 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:20:40.619021 27805 raft_consensus.cc:3060] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:40.621606 21042 raft_consensus.cc:1240] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:40.597507 28105 raft_consensus.cc:2804] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:40.569527 27928 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.630200 20177 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:40.629076 28155 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:20:40.656663 28067 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:40.657675 28039 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:40.660894 20325 consensus_queue.cc:260] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.662431 20325 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.666788 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.614953 28131 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.667554 20171 raft_consensus.cc:2376] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14. Re-sending same reply.
I20260709 12:20:40.673524 27928 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:40.608328 28055 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:40.669797 28150 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.004s
W20260709 12:20:40.671373 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.680814 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.695204 21035 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:40.671897 28131 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:40.706254 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:40.714794 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 86703.5us
W20260709 12:20:40.723234 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.728077 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:40.728848 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 273646us
W20260709 12:20:40.734234 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.735229 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.753275 20171 raft_consensus.cc:2468] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:40.674891 28055 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.756011 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.756951 20175 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:40.793093 20177 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:40.759644 28039 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:40.805068 28039 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.807655 28081 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:40.808321 28081 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.810472 28081 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:40.800606 28013 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.001s
I20260709 12:20:40.811447 28078 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.812340 28078 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.814206 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:40.814622 28078 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:40.819761 20249 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:40.822332 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.732532 28065 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:40.831120 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 418978us
I20260709 12:20:40.829214 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.833417 28105 raft_consensus.cc:697] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:40.842943 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:40.743328 28062 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:40.846124 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.848703 20177 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
W20260709 12:20:40.840408 28036 consensus_meta.cc:287] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.003s
I20260709 12:20:40.859903 20326 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
W20260709 12:20:40.865501 28161 log.cc:927] Time spent T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
W20260709 12:20:40.867012 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.855647 28062 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:40.849269 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:40.871712 20325 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:40.889391 20179 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:20:40.874948 28032 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.896529 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:40.840842 28169 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.900403 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.901546 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83376.5us
I20260709 12:20:40.823170 28061 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.911648 20179 raft_consensus.cc:1275] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:40.899183 28157 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:40.898869 28081 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.933396 20220 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.670s (SENT)
I20260709 12:20:40.936137 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:43428
I20260709 12:20:40.938913 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:40.942904 27805 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.943539 27805 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:40.946053 27805 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:40.970745 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:40.929528 28157 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:40.940027 27747 consensus_meta.cc:287] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 12:20:40.976236 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:40.971988 28157 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.968966 28105 consensus_queue.cc:237] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.015525 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.016310 20171 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:40.909190 28169 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:40.977610 20179 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:41.009372 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 66944.6us
I20260709 12:20:41.015671 28099 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:41.010643 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.013212 21041 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:41.024044 21007 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:41.061967 20179 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13.
I20260709 12:20:41.021129 27805 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:40.950314 28081 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.073596 20171 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 23.
I20260709 12:20:41.077006 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.071974 28180 raft_consensus.cc:2804] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:41.095319 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 72925.8us
I20260709 12:20:41.098565 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.022635 27747 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.104902 20253 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:41.108278 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.204s (SENT)
I20260709 12:20:41.108815 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.112728 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.113394 20171 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:41.114827 20173 raft_consensus.cc:1240] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:20:41.115100 20180 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:41.116057 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.116757 20180 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19. Re-sending same reply.
I20260709 12:20:41.117764 20174 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:41.118085 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.118762 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.116114 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.119467 20179 raft_consensus.cc:2368] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:41.119889 20173 raft_consensus.cc:2393] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 21: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:41.121888 20171 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:41.122728 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.123375 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.123732 20179 raft_consensus.cc:1240] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:41.124625 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 206832us
W20260709 12:20:41.127226 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.127869 20220 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.684s (SENT)
I20260709 12:20:41.128260 20220 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.129097 28095 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:41.026996 28099 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.124644 20177 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:41.136891 20253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53430 (request call id 3291) took 1048 ms. Trace:
I20260709 12:20:41.137303 20253 rpcz_store.cc:276] 0709 12:20:40.060427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.063779 (+  3352us) service_pool.cc:224] Handling call
0709 12:20:41.099768 (+1035989us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4c00311c00. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd91c4a20 00007f5dd91d5a29 00007f5dd91d613f 00007f5dd919a2ab 00007f5dd91c7f3c 00007f5dd91c83fe 00007f5dd945588b 00007f5ddae54495 00007f5ddaea530f 00007f5ddaeefa55 00007f5ddfebfcd0
0709 12:20:41.108294 (+  8526us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":5797,"spinlock_wait_cycles":30451968}
I20260709 12:20:41.147565 28162 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.152398 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.126197 27926 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:41.154636 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60914.3us
I20260709 12:20:41.158327 20255 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:41.148138 28162 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.151623 27925 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:41.166322 20220 leader_election.cc:336] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.852s (SENT)
I20260709 12:20:41.142014 28065 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:41.157485 28108 consensus_meta.cc:287] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
I20260709 12:20:41.131016 28039 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:20:41.165076 28032 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:41.172901 28176 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:20:41.173090 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.173950 20172 raft_consensus.cc:2376] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13. Re-sending same reply.
I20260709 12:20:41.174901 28175 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:41.175457 28175 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.175926 28175 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:41.176112 28162 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:41.179332 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.172247 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.170030 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.160821 28062 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.189049 20251 raft_consensus.cc:1275] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:20:41.203644 20251 pending_rounds.cc:85] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 13
I20260709 12:20:41.211098 20177 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:41.180657 28061 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 26 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:41.210592 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 113768us
I20260709 12:20:41.207554 20251 pending_rounds.cc:107] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:20:41.192473 28032 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:41.208630 28173 log.cc:927] Time spent T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:20:41.217686 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.213413 20251 raft_consensus.cc:2889] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:41.163744 27926 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:41.221073 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 210570us
I20260709 12:20:41.225153 20174 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:41.206691 28108 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:41.237460 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 71166.1us
I20260709 12:20:41.204542 28062 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.239305 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.219692 28180 raft_consensus.cc:697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:41.222970 28166 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.245802 20180 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:20:41.231760 28169 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.249445 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.221161 28032 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.253419 20176 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:41.253597 28187 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:41.253965 28184 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:20:41.254122 28187 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.256505 28187 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.258325 28062 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.259486 28190 tablet_replica.cc:333] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:20:41.262837 27926 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.263765 28157 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.265895 28157 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:41.268810 28081 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.270421 28099 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:41.251116 28039 consensus_queue.cc:1048] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:20:41.251729 28166 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.274317 28166 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:41.275377 28180 consensus_queue.cc:237] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:41.279284 28131 consensus_meta.cc:287] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 12:20:41.279794 28131 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:41.289268 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.289908 28032 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:41.291543 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.283733 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:41.293344 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.283800 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.296113 20176 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 18: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:41.296152 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.878s (SENT)
I20260709 12:20:41.296691 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:41.297448 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45758.1us
W20260709 12:20:41.300464 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.302390 20294 leader_election.cc:400] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24.
I20260709 12:20:41.302690 20294 leader_election.cc:403] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:20:41.283676 28099 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.301034 28169 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.301977 27975 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:41.311681 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
W20260709 12:20:41.313382 28178 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 12:20:41.315099 28108 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:41.282047 28131 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.332710 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.320998 20256 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.323601 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.324263 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:41.324512 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.324724 28169 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.326093 28190 raft_consensus.cc:2243] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:41.326622 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.330546 20249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40218 (request call id 2030) took 1063 ms. Trace:
I20260709 12:20:41.321813 27975 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.333914 20174 raft_consensus.cc:2376] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20. Re-sending same reply.
W20260709 12:20:41.317366 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.338099 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.339223 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:41.346304 20328 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.340183 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.340687 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.341161 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.341987 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.347311 20180 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
W20260709 12:20:41.348097 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.229s (SENT)
I20260709 12:20:41.348613 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.344012 20249 rpcz_store.cc:276] 0709 12:20:40.266995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.267148 (+   153us) service_pool.cc:224] Handling call
0709 12:20:41.330326 (+1063178us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54002ddf54. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:41.330453 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214628224}
I20260709 12:20:41.352780 28174 raft_consensus.cc:993] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:41.353296 28174 raft_consensus.cc:1081] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:41.360705 20328 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:41.361371 28193 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24.
I20260709 12:20:41.362042 28190 raft_consensus.cc:2272] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:41.362723 28169 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.365083 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.367837 20256 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
W20260709 12:20:41.368270 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85160.4us
I20260709 12:20:41.369108 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:41.370636 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.372031 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:41.380817 20251 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.372045 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:41.381021 20249 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:41.326644 28175 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:41.376034 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 55058.7us
I20260709 12:20:41.346226 27975 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:41.375798 28015 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:41.381443 20248 raft_consensus.cc:3060] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.322644 28099 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:41.387319 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.395617 20180 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:41.397715 21007 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:41.401008 20294 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.402930 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.402426 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.411203 21007 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:41.413020 20220 leader_election.cc:336] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.879s (SENT)
I20260709 12:20:41.412043 27774 raft_consensus.cc:2804] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:41.414868 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69093.2us
I20260709 12:20:41.415709 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:41.417678 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.420137 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.420729 20177 raft_consensus.cc:2376] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 23. Re-sending same reply.
I20260709 12:20:41.421693 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.427019 20248 raft_consensus.cc:2468] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:41.414114 28083 raft_consensus.cc:2804] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:41.418211 28055 raft_consensus.cc:2804] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:41.434433 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:41.436609 20327 raft_consensus.cc:3055] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:41.436945 20327 raft_consensus.cc:740] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:41.437758 20327 consensus_queue.cc:260] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.438745 20327 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.435675 28083 raft_consensus.cc:697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:41.421461 27774 raft_consensus.cc:697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:41.440907 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:41.441274 20251 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:41.441561 20329 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:41.446127 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.446916 20177 raft_consensus.cc:2376] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 13. Re-sending same reply.
I20260709 12:20:41.444360 21007 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:41.452183 28099 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.444710 28055 raft_consensus.cc:697] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:41.453539 28055 consensus_queue.cc:237] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.454299 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.455003 20173 raft_consensus.cc:3060] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.444375 28105 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:41.456087 28105 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:41.456988 28105 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.459533 28190 ts_tablet_manager.cc:1916] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:41.459856 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:41.472275 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.429343 28108 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:41.463053 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.460776 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.463909 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.500733 20174 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:41.464666 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.501778 20177 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:41.465021 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.470842 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:41.459930 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60653.1us
I20260709 12:20:41.462260 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.462599 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.460641 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.503906 20179 raft_consensus.cc:2376] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17. Re-sending same reply.
I20260709 12:20:41.500378 20322 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 in current term 26: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:41.464840 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:41.511973 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 67696.9us
I20260709 12:20:41.520380 20175 raft_consensus.cc:2368] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
W20260709 12:20:41.526942 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 105308us
I20260709 12:20:41.461191 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.530444 20329 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 23.
I20260709 12:20:41.531235 20327 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:41.534551 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.536006 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:41.536021 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.536279 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.538127 20173 raft_consensus.cc:2468] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:41.538818 20177 raft_consensus.cc:2368] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 13. Current term is 14.
I20260709 12:20:41.539041 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.540401 20177 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 12:20:41.540791 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:41.537917 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.544603 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.545542 20251 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:41.481846 27747 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:41.554137 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.548753 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.547102 20219 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:41.473155 28175 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 26 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:41.559780 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134225us
I20260709 12:20:41.555063 20175 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 13.
I20260709 12:20:41.562038 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.529839 28015 raft_consensus.cc:2804] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:41.572528 20179 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:41.574112 20219 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:41.466331 28168 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:20:41.579346 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.580063 20171 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:41.584494 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:41.585105 21043 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:41.554900 28108 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:41.592072 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.566380 28099 raft_consensus.cc:2804] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:41.575765 28081 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.599097 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.469682 28083 consensus_queue.cc:237] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.601040 20178 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:41.531884 28193 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:20:41.602762 20251 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:41.598228 21042 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
W20260709 12:20:41.592516 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 61690.9us
W20260709 12:20:41.605456 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54712.3us
I20260709 12:20:41.585517 28013 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:41.465392 27774 consensus_queue.cc:237] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.549114 27975 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.585687 28015 raft_consensus.cc:697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:41.577965 28169 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:41.597916 28179 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:41.615725 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.627455 20249 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:41.631489 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:41.644484 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.644714 20179 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:20:41.649869 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.651021 20179 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:41.652540 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.655913 28169 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.656796 28039 consensus_queue.cc:1048] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:20:41.659868 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.660415 20171 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:41.662621 20171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:41.662971 20175 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:41.663137 20171 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:41.663539 20171 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:41.668053 28196 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:20:41.616854 28099 raft_consensus.cc:697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:41.673470 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:41.673007 20171 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.673081 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:41.660513 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:41.628801 28013 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:41.609140 28081 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.686771 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:41.654296 28156 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:41.707008 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.700464 21043 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 23.
W20260709 12:20:41.699553 20220 leader_election.cc:336] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.599s (SENT)
I20260709 12:20:41.710487 20174 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:20:41.711627 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.712996 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.713981 20174 raft_consensus.cc:2410] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:20:41.675698 28065 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.718021 20220 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.718840 20171 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:41.720963 28207 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.721549 28207 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.722512 28013 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.726055 28081 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.726744 28081 raft_consensus.cc:476] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:41.657548 28015 consensus_queue.cc:237] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.715140 28108 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:41.733440 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.736078 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.736781 21039 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:41.738440 20247 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:41.740061 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.741752 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.742017 27975 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:41.743541 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.746920 27968 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:20:41.715693 28156 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.739866 28099 consensus_queue.cc:237] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.751417 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.694932 27747 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:41.753887 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.763111 20171 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
W20260709 12:20:41.764719 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 104295us
I20260709 12:20:41.702765 28061 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:41.768191 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.769308 21043 raft_consensus.cc:2393] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 14: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:41.767701 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.773110 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.773566 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.774183 20178 raft_consensus.cc:3060] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:41.776156 21038 raft_consensus.cc:2368] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
W20260709 12:20:41.784456 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.788033 20218 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.796391 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.771375 28061 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.799206 28061 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:41.799598 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.800120 28156 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.800256 20175 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:41.801214 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
W20260709 12:20:41.801786 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 102275us
I20260709 12:20:41.774271 27747 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:41.804775 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.804563 27747 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:41.805692 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:41.806252 20256 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.808192 20252 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:41.808552 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.809288 20253 raft_consensus.cc:2368] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20.
I20260709 12:20:41.814937 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.801795 20175 raft_consensus.cc:3060] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:41.815682 20248 raft_consensus.cc:2368] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
W20260709 12:20:41.803407 20220 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.964s (SENT)
I20260709 12:20:41.755421 20172 raft_consensus.cc:2468] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:41.818640 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.819169 20172 raft_consensus.cc:3060] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.770282 27975 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:41.826383 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.826983 20171 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:41.827234 21007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.832265 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:41.754092 28065 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:41.778587 28169 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:41.844362 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.845139 20253 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 26: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:41.840219 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:41.845640 20174 raft_consensus.cc:3060] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.854169 20256 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:41.858350 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:41.821839 28081 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:41.863379 20178 raft_consensus.cc:2468] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:41.870723 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.867746 21007 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:41.880501 20172 raft_consensus.cc:2468] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:41.881013 20248 raft_consensus.cc:2393] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:41.882560 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.883719 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.889703 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.892009 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:41.892697 20178 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14.
I20260709 12:20:41.893239 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:41.898902 21008 leader_election.cc:336] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.761s (SENT)
I20260709 12:20:41.899507 21008 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:41.918941 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.864480 28089 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:41.937348 20171 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:41.939030 20171 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:41.939790 28166 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:20:41.886827 28191 raft_consensus.cc:2804] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:41.942094 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:41.959599 20247 raft_consensus.cc:2410] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:20:41.959882 20144 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.952929 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.863114 28185 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
W20260709 12:20:41.968653 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69812.4us
I20260709 12:20:41.969775 20172 raft_consensus.cc:1240] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:41.973932 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.897714 28207 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:41.977252 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:41.979197 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:41.980470 20174 raft_consensus.cc:2468] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:41.982208 20073 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 210) took 27932 ms (client timeout 15000 ms). Trace:
I20260709 12:20:41.895769 28193 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:20:41.984711 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:41.971489 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2278846440001416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:20:41.989058 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2170846440001242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:20:41.989495 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2170846440001242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 12:20:41.989884 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2071846440001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:20:41.990245 20144 connection.cc:256] RPC call timeout handler was delayed by -2.2071846440001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:20:41.990612 20144 connection.cc:256] RPC call timeout handler was delayed by -2.1252846439999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:20:41.990989 20144 connection.cc:256] RPC call timeout handler was delayed by -2.0505846440000823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:20:41.991356 20144 connection.cc:256] RPC call timeout handler was delayed by -2.0487846440000794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:20:41.992727 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9920846439999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:20:41.993109 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9641846439999426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 12:20:41.993472 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9623846439999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:20:41.993844 20144 connection.cc:256] RPC call timeout handler was delayed by -1.9623846439999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:20:41.994216 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8264846439999474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:20:41.994560 20144 connection.cc:256] RPC call timeout handler was delayed by -1.8165846440001587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 12:20:41.994933 20144 connection.cc:256] RPC call timeout handler was delayed by -1.741884644000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:20:41.995324 20144 connection.cc:256] RPC call timeout handler was delayed by -1.741884644000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:20:41.996659 20144 connection.cc:256] RPC call timeout handler was delayed by -1.6644846440001402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 12:20:41.997067 20144 connection.cc:256] RPC call timeout handler was delayed by -1.648284644000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 12:20:41.997443 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5717846439999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:20:41.997818 20144 connection.cc:256] RPC call timeout handler was delayed by -1.5717846439999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:20:41.998198 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1019846440001402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2751s for a response
W20260709 12:20:41.998514 20144 connection.cc:256] RPC call timeout handler was delayed by -1.1019846440001402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2751s for a response
I20260709 12:20:41.960762 28156 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:42.001349 20174 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:42.004382 21043 raft_consensus.cc:2393] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 19: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:41.962244 28175 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:42.022322 20219 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.977368 28191 raft_consensus.cc:697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:42.046509 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:41.943912 28081 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:42.048602 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 245226us
I20260709 12:20:42.049358 20172 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:20:42.049399 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.144s (SENT)
I20260709 12:20:42.050343 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:41.982745 20073 rpcz_store.cc:269] 0709 12:20:14.029679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.032224 (+  2545us) service_pool.cc:224] Handling call
0709 12:20:14.078017 (+ 45793us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b54002d0190. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd40b2 00007f5de0d4d759 00007f5de0ce5a76 00007f5de0cb6d58 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc
0709 12:20:41.962290 (+27884273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:40.398926 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:40.399992 (+  1066us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:40.400068 (+    76us) write_op.cc:435] Acquired schema lock
0709 12:20:40.400116 (+    48us) tablet.cc:662] Decoding operations
0709 12:20:40.400782 (+   666us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:40.400928 (+   146us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:40.400972 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:40.401673 (+   701us) tablet.cc:701] Row locks acquired
0709 12:20:40.401740 (+    67us) write_op.cc:260] PREPARE: finished
0709 12:20:40.401980 (+   240us) write_op.cc:270] Start()
0709 12:20:40.402195 (+   215us) write_op.cc:276] Timestamp: P: 1783599640401883 usec, L: 0
0709 12:20:40.402248 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:20:40.461741 (+ 59493us) log.cc:844] Serialized 982 byte log entry
0709 12:20:40.816430 (+354689us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800279ee0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7e0b3f3 00007f5dd7e0d7c1 00007f5dd7e0d779 00007f5dd7e0d709 00007f5dd7e0d6d1 00007f5dd7e0c9cd 0000000000388634 0000000000388479 00007f5dd7dee83a
0709 12:20:41.191624 (+375194us) op_driver.cc:464] REPLICATION: finished
0709 12:20:41.279986 (+ 88362us) write_op.cc:301] APPLY: starting
0709 12:20:41.280102 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:41.369689 (+ 89587us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:41.369730 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:41.371181 (+  1451us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:41.371530 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:20:41.373392 (+  1862us) write_op.cc:312] APPLY: finished
0709 12:20:41.403739 (+ 30347us) log.cc:844] Serialized 33 byte log entry
0709 12:20:41.417716 (+ 13977us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:41.421221 (+  3505us) write_op.cc:454] Released schema lock
0709 12:20:41.428948 (+  7727us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:41.475993 (+ 47045us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:41.476050 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":555559,"reported_tablets":36,"spinlock_wait_cycles":13247232,"child_traces":[["op",{"apply.queue_time_us":75495,"apply.run_cpu_time_us":6644,"apply.run_wall_time_us":171320,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":127095,"prepare.run_cpu_time_us":48845,"prepare.run_wall_time_us":227638,"raft.queue_time_us":313478,"raft.run_cpu_time_us":17589,"raft.run_wall_time_us":94814,"replication_time_us":760538,"spinlock_wait_cycles":30240000,"thread_start_us":477392,"threads_started":4,"wal-append.queue_time_us":217271}]]}
I20260709 12:20:42.062057 28095 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:42.085191 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:42.062493 21039 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:42.100437 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 51875.5us
I20260709 12:20:42.028177 28175 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.059930 28135 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:42.067266 28212 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:42.118956 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 92714.4us
W20260709 12:20:42.122664 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 73297us
W20260709 12:20:42.132874 20220 leader_election.cc:336] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.229s (SENT)
I20260709 12:20:42.133388 20220 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.164077 21039 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:42.164673 28081 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:42.166368 28175 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:42.136556 28191 consensus_queue.cc:237] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.131501 28212 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.134081 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.161537 20177 raft_consensus.cc:2955] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:42.219797 20323 raft_consensus.cc:1240] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:42.223838 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:42.224756 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 101337us
I20260709 12:20:42.227277 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:42.202862 28108 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:42.228541 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.225649 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:42.232402 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.242660 20321 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 26: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:42.244467 20175 raft_consensus.cc:2468] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:42.242993 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:42.245960 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.246209 20326 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:42.246565 20326 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:42.248850 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 126715us
I20260709 12:20:42.254648 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:42.226624 27747 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.266800 20175 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 13.
I20260709 12:20:42.269507 21008 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.202068 28105 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:20:42.232290 28065 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:42.246487 28081 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:42.311755 28217 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:20:42.312572 28213 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:20:42.318143 20175 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:42.326200 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:42.247355 28166 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 12:20:42.331131 28214 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:20:42.321316 27975 consensus_queue.cc:1048] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
W20260709 12:20:42.335125 28061 consensus_meta.cc:287] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 12:20:42.314302 28224 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:20:42.339627 28212 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:42.317036 28053 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:42.335579 28061 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.355211 20173 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:20:42.358865 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:42.360299 20249 raft_consensus.cc:2368] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15.
I20260709 12:20:42.368229 20253 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:42.352499 28228 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:42.347640 28013 consensus_queue.cc:1059] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:20:42.359869 28061 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:42.362214 28212 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:42.378473 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.382516 20329 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:42.379606 28228 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.400323 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:42.405395 20144 leader_election.cc:400] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:20:42.405859 20144 leader_election.cc:403] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:42.378113 28135 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:42.410348 28081 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:20:42.423687 28135 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.426770 28135 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:42.403851 28212 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:42.402279 28228 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:42.406701 27975 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:42.438500 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 60144.4us
I20260709 12:20:42.441190 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:42.441809 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 126057us
I20260709 12:20:42.453733 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.462870 20220 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.434688 28212 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:42.464227 28013 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:42.464737 27975 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:42.465960 20220 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:42.440165 28208 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:42.443220 28032 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:20:42.443305 28053 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:20:42.469656 28212 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:42.472988 28081 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:42.492024 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:42.492779 21040 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 17.
I20260709 12:20:42.483851 28190 ts_tablet_manager.cc:1929] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:20:42.499949 28190 log.cc:1199] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 85fa447fc35d4f88ab7c85630749ec78: Deleting WAL directory at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/wals/cb4da77a6bb24e4f94abb2f4bd8a7f9e
I20260709 12:20:42.503674 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:42.503952 28190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43428 (request call id 0) took 1614 ms. Trace:
I20260709 12:20:42.504392 28190 rpcz_store.cc:276] 0709 12:20:40.915742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.935673 (+ 19931us) service_pool.cc:224] Handling call
0709 12:20:41.258872 (+323199us) ts_tablet_manager.cc:1151] Deleting tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e
0709 12:20:41.258997 (+   125us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:42.087395 (+828398us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:42.475481 (+388086us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:42.503866 (+ 28385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40614,"tablet-delete.queue_time_us":313447,"thread_start_us":276912,"threads_started":1}
I20260709 12:20:42.488998 28105 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.506678 28105 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.509029 28105 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:42.504402 21034 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:42.513242 28228 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.483481 28061 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:42.515844 28061 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:42.516254 28061 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:42.520757 21042 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
W20260709 12:20:42.519935 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 54105.3us
I20260709 12:20:42.522804 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:42.522984 28223 log.cc:927] Time spent T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.210s	user 0.004s	sys 0.000s
I20260709 12:20:42.523766 28013 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:42.524259 28227 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 12:20:42.525410 28013 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:42.526551 20180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4237) took 1003 ms. Trace:
I20260709 12:20:42.526960 20180 rpcz_store.cc:276] 0709 12:20:41.523303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.565729 (+ 42426us) service_pool.cc:224] Handling call
0709 12:20:41.566074 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.887631 (+321557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.887693 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:41.898023 (+ 10330us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.208594 (+310571us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:42.208634 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.208697 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.523629 (+314932us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:42.526239 (+  2610us) raft_consensus.cc:1685] finished
0709 12:20:42.526259 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.526484 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2484,"raft.queue_time_us":82492,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2803,"spinlock_wait_cycles":8179456,"thread_start_us":537470,"threads_started":2,"wal-append.queue_time_us":361330}
I20260709 12:20:42.530079 28099 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:42.530673 28099 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.532047 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.533022 28099 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:42.538229 20326 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.539274 20326 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:42.540565 20323 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:42.524271 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:20:42.562070 21008 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.130s (SENT)
I20260709 12:20:42.549536 28061 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.549965 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.552241 20321 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:20:42.557040 20253 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:42.562537 21008 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.573357 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.560230 20323 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:42.591769 21034 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:42.515399 28228 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:42.603863 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
W20260709 12:20:42.605083 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 175988us
I20260709 12:20:42.605572 20219 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:42.605974 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:42.606678 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:42.607342 21039 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:42.607283 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 83103.6us
I20260709 12:20:42.608289 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:42.610878 28212 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.612491 27975 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:42.623274 21034 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:20:42.623652 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:42.602612 20323 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.641184 21039 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
W20260709 12:20:42.643101 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 45831.3us
I20260709 12:20:42.601552 28189 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:42.646911 20323 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:42.621193 28095 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:42.630676 28081 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:42.645288 28245 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:42.672530 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74015.3us
W20260709 12:20:42.686266 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 78098.8us
I20260709 12:20:42.674580 28170 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 12:20:42.693392 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:42.694762 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.674649 28099 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:42.673228 28095 raft_consensus.cc:697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:42.697203 28249 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:42.698979 28234 log.cc:927] Time spent T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:20:42.707192 20253 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:42.707876 20247 raft_consensus.cc:1240] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:42.715859 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 92320.2us
I20260709 12:20:42.718179 20171 raft_consensus.cc:3055] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:42.718600 20171 raft_consensus.cc:740] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:42.719645 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 104603us
I20260709 12:20:42.724182 21040 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:42.726030 20326 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 23.
I20260709 12:20:42.726516 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:42.747470 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:42.727243 20180 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:42.701540 28212 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:42.749316 20178 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:42.754575 28256 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:42.755088 28256 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:42.755510 28256 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:42.760277 27805 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:42.761219 27975 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:42.765318 20178 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:42.765694 20178 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:42.750895 20171 consensus_queue.cc:260] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.762733 27975 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.776019 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:42.780393 28179 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:42.781102 20176 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:42.766426 20178 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.784193 20178 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:42.783764 20075 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 17 to 20, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 20 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.785948 20075 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:42.787678 28095 consensus_queue.cc:237] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.789028 28179 consensus_queue.cc:1059] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:42.790673 28179 raft_consensus.cc:3055] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:42.791059 28179 raft_consensus.cc:740] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:42.792047 28179 consensus_queue.cc:260] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.793458 28179 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:42.778921 20171 raft_consensus.cc:3060] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:42.809088 20323 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:42.810618 20171 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:20:42.811079 20171 pending_rounds.cc:85] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 12
I20260709 12:20:42.811306 20171 pending_rounds.cc:107] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:20:42.811558 20171 raft_consensus.cc:2889] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:42.793394 20075 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 14 to 16, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 16 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:42.816365 20219 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:42.816561 28254 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:42.824167 27975 raft_consensus.cc:2804] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:42.824833 27975 raft_consensus.cc:697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:42.826265 27975 consensus_queue.cc:237] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.778067 28081 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:20:42.830765 27968 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:20:42.863010 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 115641us
W20260709 12:20:42.870723 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 176024us
I20260709 12:20:42.871912 20220 leader_election.cc:400] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:42.872257 20220 leader_election.cc:403] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:42.873574 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:42.878058 20176 raft_consensus.cc:2468] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 14.
I20260709 12:20:42.878564 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.838462 28061 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:42.901547 28208 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:42.918582 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.908398 28252 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 12. Current term is 13.
I20260709 12:20:42.927642 20220 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:42.902244 28255 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:42.935760 27975 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:20:42.936573 27975 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.936059 28255 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.937043 27975 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:42.939007 28255 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:42.943754 20253 raft_consensus.cc:1275] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:20:43.021729 20253 pending_rounds.cc:85] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 10
I20260709 12:20:43.022045 20253 pending_rounds.cc:107] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:20:43.022332 20253 raft_consensus.cc:2889] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:43.023880 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:42.939131 27975 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:42.948565 28243 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.274s	user 0.000s	sys 0.003s
I20260709 12:20:42.949031 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:43.027064 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:43.029752 20252 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:43.031291 20252 raft_consensus.cc:1275] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:20:42.950978 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:43.034936 20256 raft_consensus.cc:2393] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 26: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
I20260709 12:20:42.954512 28216 raft_consensus.cc:3055] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:43.035753 28216 raft_consensus.cc:740] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:43.036862 28216 consensus_queue.cc:260] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:43.037603 20252 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:43.038389 28216 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:42.957669 28257 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:20:42.964167 20251 raft_consensus.cc:1275] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:42.900640 28099 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:42.967787 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:42.974288 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.975709 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:42.975581 28039 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:20:42.982421 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 108974us
I20260709 12:20:43.043833 20252 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:20:43.044363 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:42.982898 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59575.6us
I20260709 12:20:43.045130 20252 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:42.924902 20075 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 8 to 9, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 9 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:43.052541 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:43.046340 20252 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:42.987854 28108 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:43.057372 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:43.058138 28175 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:43.058521 28175 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.058841 28175 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:43.005182 20179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 4252) took 1396 ms. Trace:
I20260709 12:20:43.061642 20179 rpcz_store.cc:276] 0709 12:20:41.608971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.943356 (+334385us) service_pool.cc:224] Handling call
0709 12:20:41.977986 (+ 34630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.084406 (+106420us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:42.360875 (+276469us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.595352 (+234477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.595407 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:42.595453 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.947804 (+352351us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:43.004954 (+ 57150us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000bf754. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:43.005007 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.005121 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":470793,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":2585,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":20077,"spinlock_wait_cycles":247030912,"thread_start_us":446046,"threads_started":2,"wal-append.queue_time_us":284987}
W20260709 12:20:43.007725 28258 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:20:43.070305 28083 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:43.072223 28241 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:43.073559 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.075259 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:43.084251 28241 raft_consensus.cc:2764] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:20:43.019982 20321 raft_consensus.cc:1275] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:43.085882 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:43.033072 28168 consensus_queue.cc:1048] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:43.033869 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:42.950802 20250 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:43.094569 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:43.097832 28207 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:43.032275 28256 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:42.964468 20177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60784 (request call id 1433) took 1497 ms. Trace:
I20260709 12:20:43.108449 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:43.111531 20177 rpcz_store.cc:276] 0709 12:20:41.467007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.548681 (+ 81674us) service_pool.cc:224] Handling call
0709 12:20:41.817703 (+269022us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:41.824503 (+  6800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.824532 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:41.863543 (+ 39011us) log.cc:844] Serialized 527 byte log entry
0709 12:20:42.083775 (+220232us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:42.326515 (+242740us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.436983 (+110468us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.437276 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.437363 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:42.522290 (+ 84927us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:42.525315 (+  3025us) raft_consensus.cc:1685] finished
0709 12:20:42.525336 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.964269 (+438933us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400319cd0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef78ad 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:42.964385 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3004,"prepare.queue_time_us":264718,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":78141,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":24302,"spinlock_wait_cycles":610681472,"thread_start_us":222287,"threads_started":2,"wal-append.queue_time_us":360025}
I20260709 12:20:43.114904 21039 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:43.116441 20219 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:43.126113 20248 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:43.126318 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:43.137065 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66955.4us
I20260709 12:20:43.143954 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:43.161754 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.162472 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75910.3us
W20260709 12:20:43.162459 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 128737us
I20260709 12:20:43.137507 28108 raft_consensus.cc:2804] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:43.130105 28207 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:43.151383 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 87098.8us
I20260709 12:20:43.040596 28099 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:43.162854 28089 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.143872 28256 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:43.162671 28245 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:43.241680 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.225601 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81742.1us
I20260709 12:20:43.246176 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:43.226832 20294 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.269212 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:43.269903 20323 raft_consensus.cc:606] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.270491 20295 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:43.213694 27928 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:20:43.221457 28053 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
W20260709 12:20:43.272635 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 45983.4us
I20260709 12:20:43.264955 28208 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:43.224706 28108 raft_consensus.cc:697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:43.282788 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:43.248289 28185 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:20:43.289011 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.290076 28168 consensus_queue.cc:1048] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:43.247848 28189 consensus_queue.cc:1048] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:20:43.288036 28188 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:43.275501 28105 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:20:43.275208 28036 raft_consensus.cc:2804] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:43.428508 28272 log.cc:927] Time spent T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:20:43.297546 28032 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:43.435907 28032 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:43.437101 28032 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:43.438723 28032 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:43.439366 28175 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:43.441843 28265 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:20:43.315987 28208 raft_consensus.cc:2764] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:20:43.299872 28055 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
W20260709 12:20:43.446969 20175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.018s	sys 0.026s
W20260709 12:20:43.447314 20175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.018s	sys 0.026s
I20260709 12:20:43.295305 28039 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
W20260709 12:20:43.453480 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 170774us
W20260709 12:20:43.487462 20220 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.520s (SENT)
I20260709 12:20:43.488399 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:43.471560 21008 leader_election.cc:336] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.630s (SENT)
I20260709 12:20:43.489918 21008 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.474239 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:43.502137 28256 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:43.503280 20220 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.559s (SENT)
I20260709 12:20:43.504298 20220 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.507489 27805 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:43.512290 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
W20260709 12:20:43.495692 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 213917us
W20260709 12:20:43.527812 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 234918us
W20260709 12:20:43.538293 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.420657 28170 consensus_queue.cc:1048] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.189s
I20260709 12:20:43.447016 28175 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:43.467661 28241 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:43.493598 28245 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:43.515470 28083 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:43.494132 28208 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:43.515697 28207 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:43.547534 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:43.528237 28099 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.443969 28108 consensus_queue.cc:237] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:43.585093 28224 raft_consensus.cc:993] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:43.585635 28224 raft_consensus.cc:1081] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:43.575081 28252 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.563418 28245 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:43.604501 28207 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:43.572605 28208 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:43.671662 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.573088 28099 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:43.644201 28036 raft_consensus.cc:697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:43.661166 28207 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:43.645920 28252 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:43.717494 28036 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:43.718075 28207 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:43.738380 28273 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.307s	user 0.004s	sys 0.002s
I20260709 12:20:43.744628 28245 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:43.747754 28252 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:43.750100 21008 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.882s (SENT)
I20260709 12:20:43.756394 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.757218 28208 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:43.764995 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 217833us
W20260709 12:20:43.767262 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.999s (SENT)
I20260709 12:20:43.769749 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.779032 20323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:43.779731 20323 raft_consensus.cc:606] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.763410 28053 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:43.824414 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 57195.3us
W20260709 12:20:43.825536 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.819530 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44118.3us
W20260709 12:20:43.837112 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 324893us
I20260709 12:20:43.778627 28208 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.812502 28241 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.838989 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:43.845626 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.846550 20177 raft_consensus.cc:2410] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:20:43.847899 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.822569 28281 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.831449 28179 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:43.851958 21038 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:43.862135 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.864804 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.866418 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.868382 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:43.869138 20180 raft_consensus.cc:3060] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.870694 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.872083 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:43.872766 20171 raft_consensus.cc:3060] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:43.874092 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.844658 28208 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:43.877424 28208 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:43.878438 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.879555 20179 raft_consensus.cc:2410] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:43.884856 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.881249 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.888566 20175 raft_consensus.cc:2410] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:43.892340 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:43.892933 20176 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:20:43.896557 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52481us
I20260709 12:20:43.942636 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:43.943666 20172 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:43.954823 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.065s (SENT)
I20260709 12:20:43.955518 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:43.990520 20171 raft_consensus.cc:2468] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:43.860479 28245 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:43.995146 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:43.997901 20171 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:20:44.005334 20180 raft_consensus.cc:2468] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:44.006995 20174 raft_consensus.cc:1240] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:44.008358 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 53592.7us
I20260709 12:20:43.892696 28291 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.020104 20176 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
W20260709 12:20:44.015465 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 116057us
I20260709 12:20:44.021214 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:44.021379 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 188771us
I20260709 12:20:44.022087 20175 raft_consensus.cc:2410] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:20:43.849370 28241 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:44.010663 28278 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:20:44.030182 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.038702 20174 raft_consensus.cc:2376] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15. Re-sending same reply.
I20260709 12:20:43.882690 28281 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.040748 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:44.044678 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.045003 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.044519 20176 raft_consensus.cc:2410] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:44.046029 20180 raft_consensus.cc:2368] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20.
I20260709 12:20:44.014168 28179 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:44.033290 28207 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.013073 28245 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:44.053309 20175 raft_consensus.cc:1275] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:44.054313 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.036871 28156 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:44.055217 21006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.055970 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.057616 20177 raft_consensus.cc:2376] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21. Re-sending same reply.
I20260709 12:20:44.063429 28099 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.066744 20172 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 23.
I20260709 12:20:44.064189 28281 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.054477 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.079820 20180 raft_consensus.cc:2376] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23. Re-sending same reply.
I20260709 12:20:44.081544 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.082264 20180 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19. Re-sending same reply.
I20260709 12:20:44.073990 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.087172 20176 raft_consensus.cc:2376] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19. Re-sending same reply.
I20260709 12:20:44.078755 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.091471 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.096400 20176 raft_consensus.cc:1275] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:44.097440 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
W20260709 12:20:44.095875 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 107180us
I20260709 12:20:44.099612 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.100188 20175 raft_consensus.cc:2376] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19. Re-sending same reply.
I20260709 12:20:44.029055 28291 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.077491 28131 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.127902 20174 raft_consensus.cc:1275] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:44.095283 20171 raft_consensus.cc:1275] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:44.135167 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.135329 20321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:44.136459 20172 raft_consensus.cc:2410] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:20:44.136495 20321 raft_consensus.cc:606] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.138200 20175 raft_consensus.cc:1275] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:20:44.129315 28285 log.cc:927] Time spent T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 12:20:44.140486 28294 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:20:44.141273 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.141844 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.141990 20180 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:44.142555 20171 raft_consensus.cc:2376] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 14. Re-sending same reply.
I20260709 12:20:44.143570 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.143868 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.144170 20174 raft_consensus.cc:2376] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20. Re-sending same reply.
I20260709 12:20:44.144511 20171 raft_consensus.cc:2376] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19. Re-sending same reply.
I20260709 12:20:44.146019 20176 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:44.094796 28156 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:44.145866 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 94318.7us
I20260709 12:20:44.149108 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.149762 20172 raft_consensus.cc:2376] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21. Re-sending same reply.
W20260709 12:20:44.145382 28296 log.cc:927] Time spent T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:20:44.160768 20180 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:44.105669 28207 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.133231 28131 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.164551 28307 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:44.198763 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.203087 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.205263 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:44.206120 20180 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:44.210493 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.212109 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.213014 20256 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 13.
I20260709 12:20:44.215085 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.144816 28245 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:44.225440 28300 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:20:44.230597 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.235443 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.237402 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.238886 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.239954 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:44.240556 20325 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:44.241235 20329 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:44.241559 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.253108 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.256531 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.257165 20328 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:44.220886 28309 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.260901 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:44.242842 28302 log.cc:927] Time spent T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.168s	user 0.001s	sys 0.001s
I20260709 12:20:44.242676 28185 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.207435 28307 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:44.272698 20143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.277776 21041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d"
dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
mode: GRACEFUL
new_leader_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40288
I20260709 12:20:44.278473 21041 raft_consensus.cc:606] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Received request to transfer leadership to TS e929b30888874ed59248f1229cecd3c6
I20260709 12:20:44.260700 28306 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:20:44.288671 20324 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:20:44.290099 28314 log.cc:927] Time spent T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:44.292486 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.293129 20173 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 27.
I20260709 12:20:44.294006 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.294584 20173 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:44.296465 20330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:44.297070 20330 raft_consensus.cc:606] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.297382 20330 raft_consensus.cc:614] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:44.299537 28292 log.cc:927] Time spent T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:20:44.301275 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.307943 20324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753"
dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
mode: GRACEFUL
new_leader_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:57336
I20260709 12:20:44.308745 20324 raft_consensus.cc:606] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Received request to transfer leadership to TS f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.267762 28309 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.310369 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:20:44.312841 20180 raft_consensus.cc:2468] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:44.272054 28185 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.316030 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.316066 21008 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.288473 28208 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.323602 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.327168 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:44.328059 27747 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:44.330394 27747 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:44.330468 28241 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.330875 27747 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.331350 27747 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.332309 28291 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:44.332875 28156 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:44.335671 28307 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:44.311046 28320 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.328949 28053 consensus_queue.cc:1048] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:20:44.336504 28320 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.337383 28208 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.338505 20176 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:44.339155 28320 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.339613 28208 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.340495 28207 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.326251 28179 consensus_queue.cc:1048] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:20:44.310844 28298 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.341375 28298 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.322615 28180 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.342581 20176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:44.343159 20176 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:44.343590 20176 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.326417 28135 consensus_queue.cc:1048] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:20:44.345604 28131 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.347002 28309 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:44.347260 28267 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.918s	user 0.007s	sys 0.000s
I20260709 12:20:44.348690 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53126 (request call id 1765) took 1580 ms. Trace:
I20260709 12:20:44.349831 28131 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:44.349023 21040 rpcz_store.cc:276] 0709 12:20:42.768325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.768494 (+   169us) service_pool.cc:224] Handling call
0709 12:20:42.768921 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.769368 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.769400 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.805309 (+ 35909us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.198718 (+393409us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:43.198780 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.198871 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:44.343150 (+1144279us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:44.348374 (+  5224us) raft_consensus.cc:1685] finished
0709 12:20:44.348397 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:44.348605 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1066,"raft.queue_time_us":2560,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2262,"spinlock_wait_cycles":9244544,"thread_start_us":333470,"threads_started":1,"wal-append.queue_time_us":440125}
I20260709 12:20:44.352566 28131 consensus_queue.cc:1048] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:20:44.327926 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 84782.6us
I20260709 12:20:44.352955 28185 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:44.364945 28276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.010s	sys 0.016s
W20260709 12:20:44.365442 28276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.010s	sys 0.016s
I20260709 12:20:44.360724 28298 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.372823 20330 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:20:44.361462 28241 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.377071 28241 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.362279 28208 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.378159 28208 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.380491 28208 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.380728 28309 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.381313 28309 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.387144 20171 pending_rounds.cc:85] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 9
I20260709 12:20:44.387543 20171 pending_rounds.cc:107] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:20:44.387867 20171 raft_consensus.cc:2889] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.380513 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:44.391721 20176 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.386422 28207 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.379349 28241 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.397471 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:44.383455 28309 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.400357 20295 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:44.404428 20176 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.396660 28255 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:44.407871 21041 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:44.408633 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.412941 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.413542 20176 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:44.393735 28254 consensus_queue.cc:1059] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:20:44.393955 27975 consensus_queue.cc:1059] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:20:44.402451 28207 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.406684 28055 raft_consensus.cc:2804] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:44.403264 28256 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:20:44.472363 21041 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:44.411743 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:44.481119 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 68228.1us
I20260709 12:20:44.410846 28309 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:44.409113 28255 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.480756 28208 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.473019 28135 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.484238 28320 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.484951 28241 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:44.489601 28245 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.492973 28180 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.491950 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:44.500044 28179 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:44.501988 28325 log.cc:927] Time spent T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:20:44.505710 28255 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:44.514140 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 102455us
I20260709 12:20:44.494691 27975 raft_consensus.cc:3055] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:44.490875 28328 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.489264 28254 consensus_queue.cc:1243] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer 85fa447fc35d4f88ab7c85630749ec78 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:44.516805 20144 leader_election.cc:400] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20.
I20260709 12:20:44.525259 20144 leader_election.cc:403] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.526574 20144 leader_election.cc:400] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 13. Current term is 14.
I20260709 12:20:44.527685 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:44.529644 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:44.532735 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:44.538676 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48494.5us
I20260709 12:20:44.489759 27747 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.540462 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:44.509572 28099 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.498718 28245 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.515950 28179 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.535817 28298 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:20:44.551730 28099 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.578125 28099 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:44.578958 20281 heartbeater.cc:646] Failed to heartbeat to 127.18.132.126:44843 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.18.132.126:44843 timed out after 15.000s (SENT)
I20260709 12:20:44.533392 28328 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.546599 28332 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:44.582798 28328 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.493407 28208 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:44.585346 28208 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.506232 28180 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.587128 28099 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:44.587675 28180 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.516213 27975 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:44.589023 27975 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.590359 27975 raft_consensus.cc:3060] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:44.493772 28135 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.588225 20220 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.592185 28108 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.593089 28165 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:44.593300 28135 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.593508 28165 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:44.494333 28320 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.593719 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.594412 28165 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.494405 28241 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:44.558451 28301 log.cc:927] Time spent T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.368s	user 0.003s	sys 0.000s
I20260709 12:20:44.560998 28256 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:44.564198 28329 log.cc:927] Time spent T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:44.595506 28320 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.550302 28282 raft_consensus.cc:993] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:44.607544 28256 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.597349 28108 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:44.608407 28282 raft_consensus.cc:1081] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:44.596983 28295 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:44.606205 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.567963 20179 raft_consensus.cc:1275] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:20:44.609859 28256 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.568209 28216 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.612277 28216 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.600492 27747 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.534286 28309 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 19. Current term is 20.
I20260709 12:20:44.541347 28327 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.570669 28207 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.526437 28254 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.616129 28284 raft_consensus.cc:993] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:44.616748 28284 raft_consensus.cc:1081] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:44.616293 28254 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.619022 28254 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.572525 28245 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.574774 28179 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.609894 28295 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.620805 28287 raft_consensus.cc:3055] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:44.611501 28241 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.621141 28216 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:44.621292 28287 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:44.587709 28099 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.623682 28216 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:44.623246 28287 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.620836 28295 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:44.625267 28287 raft_consensus.cc:3060] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:44.625598 28099 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.633653 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:44.634393 21041 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.635965 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:44.636448 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.636617 21038 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:44.637936 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:44.652199 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.649819 20220 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.653159 20247 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:44.663954 21041 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:44.665541 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.566416 28255 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.676566 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.676923 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.677091 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.677863 20324 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:20:44.681505 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:44.676102 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 143486us
I20260709 12:20:44.684675 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.691063 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.693349 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:44.694888 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.675213 27975 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:44.700364 20220 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:44.691504 28095 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:44.690426 28216 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:44.713095 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.712561 28254 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:20:44.717489 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.711287 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.713059 28252 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:44.692839 20144 leader_election.cc:400] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15.
I20260709 12:20:44.730098 20144 leader_election.cc:403] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.736012 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.737031 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.737327 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.744871 20250 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:20:44.745306 20250 pending_rounds.cc:85] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 8
I20260709 12:20:44.745571 20250 pending_rounds.cc:107] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:20:44.745842 20250 raft_consensus.cc:2889] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:44.748281 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:44.749758 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 57130.7us
I20260709 12:20:44.702975 28339 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:44.750913 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:44.754484 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.754614 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:44.730840 28298 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:44.752456 28332 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15.
I20260709 12:20:44.744696 28252 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:44.770747 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:44.780529 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.783041 28252 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.785427 28108 consensus_queue.cc:1048] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:44.785921 28344 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:44.746599 28055 raft_consensus.cc:697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:44.801147 28055 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.802139 28345 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:44.761842 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 74005.2us
I20260709 12:20:44.791489 28256 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:20:44.789456 28295 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.820176 28237 raft_consensus.cc:493] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:44.823343 28281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.018s	sys 0.038s
I20260709 12:20:44.861738 28341 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:44.862136 28281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.019s	sys 0.038s
W20260709 12:20:44.863515 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 92873.7us
I20260709 12:20:44.864442 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:44.865754 20144 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:44.867861 28207 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:44.867923 28332 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:44.868381 28207 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.868822 28207 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:44.868692 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.870718 21038 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:20:44.872789 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:44.874811 28135 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:20:44.875221 28135 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.875638 28135 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:44.877661 28255 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:44.879552 28343 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:44.868732 28332 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:44.883195 28332 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:44.884238 28332 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:44.891315 28345 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:44.887653 28295 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:44.896185 20219 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:44.898535 28099 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:44.900010 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:44.902241 20174 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:44.851557 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:44.860013 28347 log.cc:927] Time spent T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:20:44.918128 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:44.918784 21039 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
W20260709 12:20:44.849375 28312 log.cc:927] Time spent T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.606s	user 0.004s	sys 0.001s
I20260709 12:20:44.913686 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.915915 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.916716 21008 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:44.920703 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.921319 20256 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:44.923928 20175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:44.924598 20175 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:44.925061 20175 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:44.933597 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:44.934132 20179 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:44.934541 21039 raft_consensus.cc:2468] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 17.
W20260709 12:20:44.936412 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 84943.2us
I20260709 12:20:44.937122 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.939248 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.944729 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:44.946949 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.948992 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:44.862323 28341 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:44.957131 20180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:44.957764 20180 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:44.958196 20180 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:44.959182 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:44.965255 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.021210 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.021461 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:45.023139 21039 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.021170 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.031136 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.031930 21043 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 25.
W20260709 12:20:45.033717 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 81987.9us
W20260709 12:20:45.035866 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 75535.9us
I20260709 12:20:45.032138 20175 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:44.954630 28053 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:45.045090 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.049381 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.049703 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.049980 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.051538 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.053211 20179 raft_consensus.cc:1275] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:44.956720 28349 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:45.088198 20175 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.089077 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.098832 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.089448 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.089953 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.093093 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.101598 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.102772 20175 raft_consensus.cc:2393] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:45.104486 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:45.104866 20172 raft_consensus.cc:1240] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:44.862134 28237 raft_consensus.cc:515] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.026543 28241 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:45.110698 28354 log.cc:927] Time spent T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:44.964980 28341 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:45.112283 20171 raft_consensus.cc:2393] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 19: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:45.113121 20172 raft_consensus.cc:1275] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:20:45.103250 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 137737us
I20260709 12:20:45.090879 20180 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.037981 28256 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.044020 28095 raft_consensus.cc:493] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.047163 28053 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:45.096037 28349 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:45.140410 21039 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:45.141197 20321 raft_consensus.cc:1240] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:20:45.136868 28256 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:45.165652 28351 log.cc:927] Time spent T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:20:45.166471 20178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 3970) took 1298 ms. Trace:
I20260709 12:20:45.139019 28053 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:45.166865 20178 rpcz_store.cc:276] 0709 12:20:43.868243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.869151 (+   908us) service_pool.cc:224] Handling call
0709 12:20:43.869520 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:44.006665 (+137145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.006695 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.007190 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.136898 (+129708us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:44.189702 (+ 52804us) log.cc:844] Serialized 14 byte log entry
0709 12:20:44.846702 (+657000us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b18002b99c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5dd7dd92a6 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db
0709 12:20:44.848556 (+  1854us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:44.872068 (+ 23512us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18002b99c0. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5de0cd3ab1 00007f5de0ce0281 00007f5ddaaa04bc 00007f5dd7dee48b 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e08455 00007f5ddaef0060 00007f5ddaf02716 00007f5ddaf13287
0709 12:20:44.872221 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.872300 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.166213 (+293913us) raft_consensus.cc:1685] finished
0709 12:20:45.166248 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.166398 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24349,"prepare.queue_time_us":105998,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":125218,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":37794,"spinlock_wait_cycles":59191040,"thread_start_us":323535,"threads_started":4,"wal-append.queue_time_us":170765}
W20260709 12:20:45.171720 28359 log.cc:927] Time spent T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:20:45.172319 28340 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.173062 28289 consensus_queue.cc:1059] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 12:20:45.174225 28326 raft_consensus.cc:3055] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:45.174598 28326 raft_consensus.cc:740] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:45.175621 28349 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.175519 28326 consensus_queue.cc:260] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.177026 28326 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.180966 20180 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:45.185305 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.142024 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 82457.4us
I20260709 12:20:45.137729 28095 raft_consensus.cc:515] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:45.200536 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 161496us
W20260709 12:20:45.216714 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.224793 28099 consensus_queue.cc:1048] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:45.125996 28241 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.237118 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.194526 27805 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.246735 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:45.249114 20173 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:45.248409 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:45.249738 20330 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:45.250661 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.250737 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.251739 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.252146 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.252864 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:45.250911 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.253218 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.258672 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.256068 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.243844 28287 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.233069 28284 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:20:45.268400 27805 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.310556 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.339851 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.302419 28053 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.311363 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.312541 20254 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:45.313331 28131 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.304347 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.315090 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.325706 28095 leader_election.cc:290] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.257359 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:45.337393 20330 raft_consensus.cc:2468] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:45.221150 28349 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.361881 28349 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.339352 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:45.308216 28355 log.cc:927] Time spent T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:20:45.346652 20173 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
W20260709 12:20:45.346676 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 89396.9us
I20260709 12:20:45.337975 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.349761 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.299696 28311 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.353350 28341 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.348075 27975 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.353402 28241 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.340525 28287 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.357642 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:45.358302 28237 leader_election.cc:290] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.333164 28216 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.394795 28216 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.389209 28332 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.396919 28216 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.370585 28135 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.378666 21034 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 19.
I20260709 12:20:45.385905 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.400810 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.401738 28287 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.390625 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.404181 21043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.392782 28311 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.407076 28298 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.413718 28311 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.407320 28332 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:20:45.404990 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.403498 27805 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.414992 21036 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:45.409693 21039 raft_consensus.cc:1240] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 27. Current term is 28. Ops: []
I20260709 12:20:45.405871 21037 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:45.409056 21038 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:45.381484 28349 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:45.347311 28207 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:45.401993 28360 log.cc:927] Time spent T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:20:45.409057 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:45.418586 21038 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:45.411265 21035 raft_consensus.cc:1240] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:45.421003 28349 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:45.429989 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 50542.6us
I20260709 12:20:45.367842 28131 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.458454 20177 raft_consensus.cc:1240] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:45.450721 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:45.467463 21035 raft_consensus.cc:3060] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:45.469275 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.404229 28348 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.474752 20247 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:20:45.484052 20247 pending_rounds.cc:85] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 12
I20260709 12:20:45.484403 20247 pending_rounds.cc:107] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:20:45.484702 20247 raft_consensus.cc:2889] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:45.405503 28309 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.420264 20322 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:45.445452 28349 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:45.416486 27975 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.483120 28179 raft_consensus.cc:476] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:45.515381 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99f5ffbc4fe542b3996e60bb26ee1c35" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.520792 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.498121 28165 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.528120 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.520249 28345 raft_consensus.cc:993] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: : Instructing follower f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:45.510566 28245 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:45.525893 28170 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:45.535483 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 133566us
I20260709 12:20:45.541868 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.539966 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.552426 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.530586 28313 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.537364 28224 raft_consensus.cc:1081] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Signalling peer f5c544fad8874e818acaad733a9d14f1 to start an election
I20260709 12:20:45.573657 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.578555 27805 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:45.584120 27805 consensus_queue.cc:1048] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:45.587780 20220 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.587904 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:45.589607 20256 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:45.591878 27805 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.601394 20256 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 22.
W20260709 12:20:45.602397 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.619940 20220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.620793 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.621718 28261 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.606865 28135 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 28 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.607615 28207 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.624681 28261 raft_consensus.cc:476] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Not starting pre-election -- already a leader
I20260709 12:20:45.608848 27975 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.609555 28341 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.611155 28131 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:45.562466 28170 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.631183 28170 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.613911 28053 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:45.553241 28245 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.632241 20176 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:45.632467 28358 log.cc:927] Time spent T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 12:20:45.633824 28245 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.575580 28313 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.634747 20171 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:20:45.631454 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.636209 28313 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.637645 28295 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:45.636451 20219 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:45.627240 20220 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.641647 20173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674ae039bae9486b8fa77a2493757981"
dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:20:45.643478 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.644253 20328 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:45.644675 20177 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:45.644758 21035 raft_consensus.cc:2468] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:45.646447 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.647178 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:45.647758 20256 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:45.655738 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.658986 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:45.659472 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:45.667320 21041 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:45.668605 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:45.667092 20256 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:45.673623 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.678149 20173 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:45.691380 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebc8da2a63b4daeb972508fd248a6f2" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.677066 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.693981 20173 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.681599 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:45.661201 27975 raft_consensus.cc:2804] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:45.694435 20324 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 18.
I20260709 12:20:45.703765 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.706014 20144 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:45.705204 20173 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.717533 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:45.718179 20330 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 26.
I20260709 12:20:45.677202 28255 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:45.677292 28216 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:45.714318 20295 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:45.690613 28095 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.693042 28207 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:45.706233 28245 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.712702 28379 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:45.736099 28379 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:45.736545 28379 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:45.728506 28338 raft_consensus.cc:2804] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:45.667665 28341 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 12:20:45.717954 28241 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:45.739879 20323 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:45.740387 28241 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:45.739909 28338 raft_consensus.cc:697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:45.741665 28241 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.722800 28309 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:20:45.706818 28311 consensus_queue.cc:1048] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:20:45.744457 28175 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:45.741946 28338 consensus_queue.cc:237] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.746503 28291 consensus_queue.cc:1059] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:45.747727 28306 raft_consensus.cc:3055] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:45.748106 28306 raft_consensus.cc:740] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:45.643790 28295 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:45.751240 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 44235.9us
I20260709 12:20:45.726621 28207 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:45.754755 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.757143 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:45.757469 28245 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.760106 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.755686 28207 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.769892 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.775125 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.749003 28306 consensus_queue.cc:260] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.777815 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.782361 28391 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:45.783366 28391 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:45.756336 28237 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:45.785171 28281 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:45.785665 28281 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:45.768962 28298 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:45.787068 28298 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.787621 28298 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.801649 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3888) took 1066 ms. Trace:
I20260709 12:20:45.802049 20321 rpcz_store.cc:276] 0709 12:20:44.734912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.735039 (+   127us) service_pool.cc:224] Handling call
0709 12:20:44.754383 (+ 19344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.162474 (+408091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.801407 (+638933us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54002b6454. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef8e01 00007f5ddaef783e 00007f5ddfebc419 00007f5dd9433bd4 00007f5dd9433b62 00007f5dd9433a91 00007f5dd9433a0c 00007f5dd9432cc2 00007f5dd923348c 00007f5dd92328c6
0709 12:20:45.801597 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884275968}
I20260709 12:20:45.786840 28281 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.815802 20323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43354 (request call id 1847) took 1140 ms. Trace:
I20260709 12:20:45.816193 20323 rpcz_store.cc:276] 0709 12:20:44.675365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.676830 (+  1465us) service_pool.cc:224] Handling call
0709 12:20:45.807525 (+1130695us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000870d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:45.815702 (+  8177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442144512}
I20260709 12:20:45.817356 28306 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:45.821947 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.827001 28374 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.774875 28245 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.841995 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.845606 21008 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:45.855387 28156 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.796058 28341 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.764529 28349 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:45.864990 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 87288.4us
I20260709 12:20:45.800532 28256 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.867785 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.836135 27975 raft_consensus.cc:697] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:45.854954 28374 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:20:45.876068 21036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:45.872619 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.879040 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:45.885049 28349 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:45.886750 28295 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.879668 28341 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:45.889156 28391 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:45.894390 28207 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.900349 27975 consensus_queue.cc:237] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.873162 28245 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.907649 28241 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:45.908457 28241 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.916070 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:45.927479 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.977561 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.918691 28207 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:45.921136 28245 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:45.919649 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:46.004506 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 85005.1us
I20260709 12:20:45.963110 28379 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.005532 28332 consensus_queue.cc:1059] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:45.950111 28361 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.683s	user 0.001s	sys 0.004s
W20260709 12:20:45.982065 20294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.008330 28307 raft_consensus.cc:493] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:46.009022 28307 raft_consensus.cc:515] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:45.947175 28375 raft_consensus.cc:993] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: : Instructing follower e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:20:46.010051 28156 raft_consensus.cc:1081] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Signalling peer e929b30888874ed59248f1229cecd3c6 to start an election
I20260709 12:20:46.004612 28245 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:46.012307 28291 raft_consensus.cc:493] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:46.012849 28291 raft_consensus.cc:515] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.014839 28291 leader_election.cc:290] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.011202 28307 leader_election.cc:290] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.017221 20322 raft_consensus.cc:1240] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:46.017382 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:45.984826 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:45.963442 28241 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:46.005692 28170 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:46.006440 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.006543 28395 raft_consensus.cc:3055] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:46.020511 28395 raft_consensus.cc:740] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.020412 28170 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.021510 28395 consensus_queue.cc:260] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.022598 28170 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.022769 28395 raft_consensus.cc:3060] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:46.025024 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.026343 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:46.028836 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:46.001725 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 248439us
I20260709 12:20:46.029565 28281 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:46.031981 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.032629 20322 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:46.033265 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.006593 28332 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:46.035845 28332 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:45.997843 28298 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.037958 28332 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:46.009280 21040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53112 (request call id 1904) took 1202 ms. Trace:
I20260709 12:20:46.038556 21040 rpcz_store.cc:276] 0709 12:20:44.807071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.807282 (+   211us) service_pool.cc:224] Handling call
0709 12:20:44.807681 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:44.808101 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.808140 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.808668 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.101558 (+292890us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:45.101603 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.101674 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.399902 (+298228us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4800200358. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddfe21aa1 00007f5ddfe18b37 00007f5ddfe189ca 00007f5ddff1026f 00007f5ddff0ff37 00007f5ddff2455c 00007f5ddff24508 00007f5ddff24488 00007f5ddff24443 00007f5ddff236ec 00007f5ddee4da96
0709 12:20:45.949796 (+549894us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b24002f0108. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7c919c4 00007f5dd7c8facb 00007f5dd7e4adc9 00007f5dd7e4aa55 00007f5dd7e4a09d 00007f5ddaa7c10e 00007f5ddaa9388c 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221
0709 12:20:46.009062 (+ 59266us) raft_consensus.cc:1685] finished
0709 12:20:46.009089 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.009225 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2055,"raft.run_cpu_time_us":4108,"raft.run_wall_time_us":589030,"spinlock_wait_cycles":35901696,"thread_start_us":267603,"threads_started":1,"wal-append.queue_time_us":370202}
I20260709 12:20:46.043731 20322 raft_consensus.cc:2468] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:20:46.044581 20173 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:46.056867 28379 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.064415 20172 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:46.064620 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:46.065351 20175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:46.066433 20173 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:45.937939 21034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53128 (request call id 1108) took 1004 ms. Trace:
I20260709 12:20:46.068573 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.069156 20323 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:46.069458 20323 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.064553 20251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d"
dest_uuid: "e929b30888874ed59248f1229cecd3c6"
 from {username='slave'} at 127.0.0.1:40218
I20260709 12:20:46.070351 20323 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.078630 20323 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:46.072378 20327 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:46.076740 20175 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:46.067662 21034 rpcz_store.cc:276] 0709 12:20:44.933036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.933717 (+   681us) service_pool.cc:224] Handling call
0709 12:20:45.937715 (+1003998us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54006617d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:45.937842 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962900352}
I20260709 12:20:46.006994 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:46.080782 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 73885.4us
I20260709 12:20:46.081723 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:46.080719 20251 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:46.096793 20251 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:46.082952 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.083412 28332 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:46.086529 20294 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.087498 20174 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:46.039222 28298 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:46.095031 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.100636 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:46.099051 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:46.122299 20255 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
I20260709 12:20:46.133637 28298 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:46.134331 28298 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.119427 28207 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:46.140072 28207 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.140975 28207 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.143733 28284 consensus_queue.cc:1059] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:20:46.144151 28297 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:46.144932 28284 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:46.145377 28297 raft_consensus.cc:3055] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:20:46.145820 28297 raft_consensus.cc:740] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.145962 28284 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:46.146425 28284 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.147720 28237 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:46.148098 28237 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.148934 28237 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.150090 28291 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:46.150435 28237 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.153723 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.155807 28170 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:46.157613 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.158236 28170 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:46.158617 28170 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.159411 28170 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.160631 28170 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:46.161504 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:46.162829 20321 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 22.
I20260709 12:20:46.163096 20175 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:20:46.146831 28297 consensus_queue.cc:260] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 27.22, Last appended by leader: 22, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.164274 28297 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:46.165822 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.135383 28298 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.166733 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:46.168592 20178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:46.169582 20174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:46.170022 20323 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 21.
I20260709 12:20:46.173094 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:46.173962 20176 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
I20260709 12:20:46.176226 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:46.177075 20171 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 27 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:20:46.179102 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:46.180855 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:46.182277 20294 leader_election.cc:304] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.185700 20172 raft_consensus.cc:2368] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20.
W20260709 12:20:46.187248 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 88295.1us
I20260709 12:20:46.189865 20219 leader_election.cc:304] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:46.190428 20176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:46.191216 20255 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:46.193924 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.195107 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.196031 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.198215 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:46.198777 20250 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.198683 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.212554 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:46.204284 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:46.217558 21041 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:20:46.219218 21008 leader_election.cc:400] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20.
I20260709 12:20:46.219616 21008 leader_election.cc:403] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.221395 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:46.221962 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.209501 20251 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.212754 28349 raft_consensus.cc:2764] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:20:46.226222 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.226743 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.228575 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.230427 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:46.231775 21041 raft_consensus.cc:2393] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:46.229257 20252 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:46.234057 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.204085 28326 raft_consensus.cc:2749] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:46.230756 20078 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 22 to 25, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 25 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.241922 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.245105 21041 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:46.245784 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 56014.4us
I20260709 12:20:46.246677 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:46.217576 28311 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:46.250065 20078 catalog_manager.cc:5697] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.250031 20220 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:46.254879 20078 catalog_manager.cc:5697] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.224833 28385 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:46.224658 28083 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:20:46.202427 28185 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.041s
I20260709 12:20:46.147253 28284 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.243733 28241 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:46.266453 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:46.269008 20251 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.224920 28306 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:20:46.252940 28254 raft_consensus.cc:2749] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:46.273475 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:46.274024 21041 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:46.252157 28311 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:46.267526 20075 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 323) took 16691 ms (client timeout 15000 ms). Trace:
I20260709 12:20:46.260331 20078 catalog_manager.cc:5697] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 21, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 21 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.273715 20220 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:46.260537 28385 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.284277 20078 catalog_manager.cc:5697] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.281875 20144 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:46.290364 28255 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:46.290822 28255 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.291203 28255 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:46.270053 28216 raft_consensus.cc:2764] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:20:46.299817 20078 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.275053 28095 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:46.279268 27805 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:46.304190 20078 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 26 to 27, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 27 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.268256 28291 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:20:46.313402 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.321975 20323 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:46.263257 28332 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:20:46.317325 20078 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.329562 20078 catalog_manager.cc:5697] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:46.280074 28374 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563) with higher term. Message: Invalid argument: T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c for earlier term 19. Current term is 20.
I20260709 12:20:46.284942 28311 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:46.289152 28241 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:46.304262 28339 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:46.279150 28379 consensus_queue.cc:1059] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
W20260709 12:20:46.281746 20075 rpcz_store.cc:269] 0709 12:20:29.575956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.578573 (+  2617us) service_pool.cc:224] Handling call
0709 12:20:29.741759 (+163186us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54002d0190. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7dd3b71 00007f5dd7dd40b2 00007f5de0d4d759 00007f5de0ce5a76 00007f5de0cb6d58 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc
0709 12:20:46.267450 (+16525691us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:43.127089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:43.128653 (+  1564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:43.128712 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:20:43.128740 (+    28us) tablet.cc:662] Decoding operations
0709 12:20:43.129796 (+  1056us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:43.129910 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:43.129961 (+    51us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:43.244524 (+114563us) tablet.cc:701] Row locks acquired
0709 12:20:43.249184 (+  4660us) write_op.cc:260] PREPARE: finished
0709 12:20:43.267632 (+ 18448us) write_op.cc:270] Start()
0709 12:20:43.273471 (+  5839us) write_op.cc:276] Timestamp: P: 1783599643265126 usec, L: 0
0709 12:20:43.275406 (+  1935us) op_driver.cc:348] REPLICATION: starting
0709 12:20:43.427840 (+152434us) log.cc:844] Serialized 1697 byte log entry
0709 12:20:44.280291 (+852451us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5ddaa9220b
0709 12:20:44.699305 (+419014us) op_driver.cc:464] REPLICATION: finished
0709 12:20:44.811461 (+112156us) write_op.cc:301] APPLY: starting
0709 12:20:44.811554 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:44.884686 (+ 73132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:44.884710 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:45.393841 (+509131us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:45.394084 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:20:45.394126 (+    42us) write_op.cc:312] APPLY: finished
0709 12:20:45.394414 (+   288us) log.cc:844] Serialized 49 byte log entry
0709 12:20:45.394591 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.394703 (+   112us) write_op.cc:454] Released schema lock
0709 12:20:45.394750 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:45.395248 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:45.395282 (+    34us) write_op.cc:454] Released schema lock
0709 12:20:45.941057 (+545775us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaef532a 00007f5ddae7af14 00007f5ddae7aec3 00007f5ddae7ae38 00007f5ddae7adf3 00007f5ddae7a0dc 00007f5ddaea3e16 00007f5ddae8bcbb 00007f5ddae7639d 00007f5ddae79d75
Metrics: {"mutex_wait_us":1191,"reported_tablets":48,"spinlock_wait_cycles":28748544,"child_traces":[["op",{"apply.queue_time_us":109900,"apply.run_cpu_time_us":11255,"apply.run_wall_time_us":583768,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":76015,"prepare.run_cpu_time_us":31830,"prepare.run_wall_time_us":1239389,"raft.queue_time_us":187358,"raft.run_cpu_time_us":13568,"raft.run_wall_time_us":1289278,"replication_time_us":1404349,"spinlock_wait_cycles":15712256,"thread_start_us":1118536,"threads_started":4,"wal-append.queue_time_us":937204}]]}
I20260709 12:20:46.281952 28099 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 12:20:46.331601 20078 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.289660 28385 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:46.347215 20078 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 19, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.351346 20078 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 21 to 22, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 22 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.353446 20078 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 19, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.359517 20078 catalog_manager.cc:5697] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.361172 20078 catalog_manager.cc:5697] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 17, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.362627 20078 catalog_manager.cc:5697] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 21, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 21 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.364239 20078 catalog_manager.cc:5697] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:46.366843 20078 catalog_manager.cc:5697] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.346709 28241 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.371184 20078 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.372923 20078 catalog_manager.cc:5697] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:46.375195 20078 catalog_manager.cc:5697] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 21, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 21 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.375833 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:46.378616 28338 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:46.379001 28338 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:46.379418 28338 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:46.382944 28307 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:20:46.383350 28307 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.392566 28309 raft_consensus.cc:3055] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:46.393090 28309 raft_consensus.cc:740] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.393982 28309 consensus_queue.cc:260] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.395264 28309 raft_consensus.cc:3060] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:46.397888 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:46.376106 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 155108us
I20260709 12:20:46.398451 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:46.399259 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:46.400084 28403 log.cc:927] Time spent T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 12:20:46.399963 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.400576 20330 raft_consensus.cc:1240] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:20:46.398967 28385 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.401880 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:46.402458 28284 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.404457 28338 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.441223 28338 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.404922 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
W20260709 12:20:46.409485 28404 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:20:46.410740 20250 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:46.422247 20078 catalog_manager.cc:5697] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 16 to 17, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.426494 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:46.448567 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:46.427747 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.452962 20078 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.452955 20327 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 14.
I20260709 12:20:46.431272 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.432454 28216 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.415057 28311 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.473464 20326 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:20:46.433607 28385 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:46.436156 28241 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.456097 20328 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:46.458875 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.480620 20328 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:46.464581 20330 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:46.472429 28366 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:46.459002 20078 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 14, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:46.458457 21007 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:46.481827 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.478470 28216 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.485070 20078 catalog_manager.cc:5697] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:46.415146 28255 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.472523 28332 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:46.491267 20144 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.495929 28207 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:46.484539 28395 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:46.333033 20323 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:46.496098 28385 raft_consensus.cc:2804] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:46.501967 28245 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:46.517835 20251 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:46.519390 20322 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 15.
I20260709 12:20:46.524511 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.528175 20251 raft_consensus.cc:1240] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:46.521420 20328 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.547724 20328 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.537133 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:46.552088 20294 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:46.554701 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d32aa1a8cf46979742c1fb0beb8b2c" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.558640 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812122fe309946b0a0eebf7bc2214d12" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.560396 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.507321 28379 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:20:46.562929 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.564918 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:46.567862 28188 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:46.572585 20328 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:46.573165 28255 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 27 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:46.550997 28245 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.575167 28245 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.540143 28385 raft_consensus.cc:697] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
W20260709 12:20:46.588317 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 369207us
I20260709 12:20:46.580374 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.559999 28295 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:46.604791 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 97081.1us
I20260709 12:20:46.609979 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.610654 20328 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:46.613067 20219 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:46.614733 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:46.616581 20171 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:46.589051 28291 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:46.660828 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 162226us
I20260709 12:20:46.642926 28298 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:46.675302 20328 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 27.
I20260709 12:20:46.669313 28298 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:46.720455 28411 log.cc:927] Time spent T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:20:46.652945 28095 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:46.729580 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 58702.1us
I20260709 12:20:46.733646 20180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:46.734654 20180 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:46.736119 20324 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:46.754676 28309 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:46.641736 28255 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:20:46.759038 20180 raft_consensus.cc:2468] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:20:46.767405 20173 raft_consensus.cc:1275] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 12:20:46.767987 20173 pending_rounds.cc:85] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 10
I20260709 12:20:46.768298 20173 pending_rounds.cc:107] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 12:20:46.768600 20173 raft_consensus.cc:2889] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:46.770460 20179 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:20:46.773902 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1"
I20260709 12:20:46.774744 20177 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:46.788075 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:46.729043 28385 consensus_queue.cc:237] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.792657 20144 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:46.799870 28374 consensus_queue.cc:1059] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:46.755481 28309 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.802181 28307 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.803158 28207 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:46.803824 28207 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.804664 28309 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.805305 28348 raft_consensus.cc:3055] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:46.805716 28348 raft_consensus.cc:740] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:46.806316 28207 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.807097 28207 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:46.806603 28348 consensus_queue.cc:260] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.793566 28095 raft_consensus.cc:697] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:46.808246 28207 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.808712 28095 consensus_queue.cc:237] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.809325 28207 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.813880 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
W20260709 12:20:46.814682 28412 log.cc:927] Time spent T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:20:46.816226 28421 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:46.816812 28421 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:46.817776 28421 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.670528 28410 consensus_queue.cc:1059] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.124s
I20260709 12:20:46.824502 21041 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:46.828843 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.830168 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:46.831727 21040 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:46.835358 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 248922us
I20260709 12:20:46.787351 20177 raft_consensus.cc:2410] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for term 27 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:20:46.841743 20254 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:20:46.843099 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:46.843750 20294 leader_election.cc:304] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.845331 20294 leader_election.cc:304] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:46.846733 20329 raft_consensus.cc:1240] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:46.879608 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.880558 21039 raft_consensus.cc:3055] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:46.881007 21039 raft_consensus.cc:740] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:46.882296 21037 raft_consensus.cc:1240] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:46.882148 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:46.883107 20328 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:46.884895 20321 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:20:46.887604 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:46.834420 28216 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:46.891655 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 160974us
I20260709 12:20:46.838920 28332 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.894572 28332 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:46.890774 28306 raft_consensus.cc:2749] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:46.846498 28339 consensus_queue.cc:1059] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:20:46.894155 21008 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:46.834506 28395 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:20:46.888823 28340 raft_consensus.cc:2749] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:20:46.926322 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 52215.1us
I20260709 12:20:46.846151 28256 consensus_queue.cc:1048] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:20:46.972086 28298 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:46.916536 28216 raft_consensus.cc:3055] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:46.912029 28429 raft_consensus.cc:2804] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:46.979930 28083 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:47.006256 28429 raft_consensus.cc:697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:47.014027 28429 consensus_queue.cc:237] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:46.992194 28216 raft_consensus.cc:740] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:47.025457 28339 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:47.005517 28083 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:47.030970 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 162139us
I20260709 12:20:47.036430 20329 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:47.037595 28083 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:47.044631 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:47.047174 28298 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:47.045557 20248 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:47.052881 20173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:47.060200 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:47.043435 28216 consensus_queue.cc:260] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.064056 28216 raft_consensus.cc:3060] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:47.064150 28332 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:47.028312 28339 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.069303 28339 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:47.083788 21039 consensus_queue.cc:260] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.086195 21039 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:47.086141 28332 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:47.108738 28440 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:20:47.111423 21039 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 19.
I20260709 12:20:47.102696 28298 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:20:47.108552 28332 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:47.123997 28332 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:47.142776 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:47.144215 20177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:47.148293 20248 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:47.150229 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:47.150242 20254 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:47.151037 20324 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 27.
I20260709 12:20:47.151754 28281 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:47.152690 28309 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:47.157500 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:47.159636 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:47.158162 20254 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 27.
I20260709 12:20:47.160847 28426 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:47.163415 28426 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:47.165550 28426 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:47.166222 28349 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:47.166793 28349 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.168496 28379 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:47.168916 28379 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:47.169301 28379 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:47.172588 28309 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:47.173035 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:47.174281 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:47.176939 28311 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:47.193185 20248 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:47.200565 20247 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:20:47.209528 20221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.209686 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:47.206808 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:47.214854 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49853.6us
I20260709 12:20:47.188059 28298 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.188463 28309 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:20:47.237771 28379 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.240290 28379 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:47.241768 28348 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:47.248242 20179 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:20:47.249001 20172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:47.258406 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:47.195243 28438 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:47.223891 28309 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.215736 28421 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:20:47.259331 28345 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:47.268231 20293 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.246057 28298 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:47.270666 28309 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:20:47.285567 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51448.9us
I20260709 12:20:47.266335 28340 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:20:47.284853 28349 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:47.287595 28395 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:20:47.324549 28332 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.301725 28298 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:47.340792 28446 log.cc:927] Time spent T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
W20260709 12:20:47.343659 28445 log.cc:927] Time spent T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.207s	user 0.003s	sys 0.000s
I20260709 12:20:47.352458 28332 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:47.352664 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 455174us
I20260709 12:20:47.358997 28307 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:47.366868 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:47.372248 28375 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:20:47.377430 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:47.391706 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:47.397125 20324 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:20:47.399992 21008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.405303 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51646.7us
I20260709 12:20:47.406605 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:47.406965 28099 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:20:47.407552 28099 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:47.408551 28099 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:47.410876 28188 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:20:47.419080 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:47.421675 21034 raft_consensus.cc:1275] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:20:47.423857 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 199639us
I20260709 12:20:47.424292 21040 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:47.431907 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:47.436556 20251 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:47.437649 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:47.437960 20324 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:20:47.440471 20324 raft_consensus.cc:1240] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:47.443393 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:47.444628 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:47.447109 21039 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:47.447268 20328 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:47.445159 20219 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:47.452342 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:47.444023 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:47.453438 20324 raft_consensus.cc:2393] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 15: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
W20260709 12:20:47.495712 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50645us
I20260709 12:20:47.497008 20178 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 12:20:47.497466 20178 pending_rounds.cc:85] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting all ops after (but not including) 16
I20260709 12:20:47.497699 20178 pending_rounds.cc:107] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:20:47.497939 20178 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.506232 21037 raft_consensus.cc:1275] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:20:47.506947 28375 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:47.507678 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:47.507512 28375 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.509078 28453 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.509624 28453 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:47.509650 28348 consensus_queue.cc:1059] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:47.510560 28453 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.510435 28375 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:47.511724 27747 raft_consensus.cc:3055] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:47.512142 27747 raft_consensus.cc:740] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:47.513109 27747 consensus_queue.cc:260] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.514273 27747 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:47.518659 28156 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:47.521219 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:47.511581 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:47.523444 20073 catalog_manager.cc:5697] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.524828 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:47.525774 21040 raft_consensus.cc:2393] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:47.525367 20073 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:47.537464 20330 raft_consensus.cc:1275] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:47.539719 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:47.543792 20329 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:47.545667 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:47.551858 20171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:47.553050 20176 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:20:47.562227 20251 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:47.524922 28438 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:20:47.532325 28379 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:47.524607 27805 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:47.543712 28375 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:47.551468 28245 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:20:47.534752 28309 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:47.555639 28339 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:20:47.568681 28340 consensus_queue.cc:1048] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:20:47.608996 28413 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
W20260709 12:20:47.634730 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 99373.4us
I20260709 12:20:47.617863 28441 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:20:47.676805 20219 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:47.681813 28309 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:47.709050 20219 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:20:47.711907 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 149759us
I20260709 12:20:47.724093 28379 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:47.724788 28379 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.727227 28379 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:47.733976 20325 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 26.
I20260709 12:20:47.714785 28255 consensus_queue.cc:1048] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:20:47.712708 28216 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.747931 28340 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.765137 28454 log.cc:927] Time spent T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 12:20:47.765767 28375 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:47.759311 28444 log.cc:927] Time spent T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.203s	user 0.003s	sys 0.002s
I20260709 12:20:47.759939 28437 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:47.767633 28340 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.772569 28340 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:47.773253 28465 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.773799 28465 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:47.776078 28465 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:47.783815 28437 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:47.784816 28437 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:47.760918 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 203061us
I20260709 12:20:47.804512 20179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 29 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "f5c544fad8874e818acaad733a9d14f1" is_pre_election: true
I20260709 12:20:47.804854 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:47.805716 20329 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 20.
I20260709 12:20:47.806833 20179 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 27.
W20260709 12:20:47.837270 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 273893us
I20260709 12:20:47.841179 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:47.844892 20179 raft_consensus.cc:1240] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Rejecting Update request from peer 8aef67aa330543a191ab5ab5dc30e84c for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:47.818909 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:47.852063 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:47.852443 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:47.858569 28428 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:47.860652 20254 raft_consensus.cc:1275] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 12:20:47.861166 20254 pending_rounds.cc:85] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Aborting all ops after (but not including) 17
I20260709 12:20:47.861474 20254 pending_rounds.cc:107] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:20:47.861763 20254 raft_consensus.cc:2889] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.866417 21039 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:20:47.866086 21007 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:47.896471 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 126003us
I20260709 12:20:47.900818 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 
I20260709 12:20:47.911504 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:47.914171 21037 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:47.878813 28207 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:20:47.903499 28413 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:47.909780 28186 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:20:47.957367 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 45958.7us
I20260709 12:20:47.959684 28186 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.979770 28186 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:47.988940 28186 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:47.991164 28186 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 29 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:20:47.997560 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
I20260709 12:20:47.997790 20325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42162 (request call id 2523) took 1595 ms. Trace:
I20260709 12:20:47.998255 20325 rpcz_store.cc:276] 0709 12:20:46.402522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.404667 (+  2145us) service_pool.cc:224] Handling call
0709 12:20:47.997579 (+1592912us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540015e0d4. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae61571 00007f5ddaefc2fa 00007f5ddfebdb17 00007f5dd94386d4 00007f5dd9438662 00007f5dd9438591 00007f5dd943850c 00007f5dd94377c2 00007f5dd923348c 00007f5dd92328c6 00007f5dd923226f
0709 12:20:47.997709 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2921665792}
W20260709 12:20:48.008313 28457 log.cc:927] Time spent T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.399s	user 0.005s	sys 0.000s
I20260709 12:20:48.009228 28241 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:48.010135 28395 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:48.010509 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:47.951766 28428 consensus_queue.cc:1048] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:20:47.963035 28379 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.952131 28429 consensus_queue.cc:1059] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
W20260709 12:20:48.038473 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 91701.1us
I20260709 12:20:47.970010 28375 consensus_queue.cc:1048] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
I20260709 12:20:48.016450 28395 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:20:48.032176 28448 log.cc:927] Time spent T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:20:48.062098 20220 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 35 similar messages]
I20260709 12:20:48.050220 28465 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
W20260709 12:20:48.089733 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 137326us
I20260709 12:20:48.089496 20073 catalog_manager.cc:5697] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.098485 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:48.100518 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 29 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:48.110687 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 29 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:48.110360 21037 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 28.
W20260709 12:20:48.115917 28476 log.cc:927] Time spent T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:20:48.116246 28282 raft_consensus.cc:493] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:48.116803 28282 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.069586 28395 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:48.118996 28282 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:48.119881 28395 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.112823 28410 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.121476 28410 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.098897 28188 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.109417 28349 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:48.156219 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 46008us
I20260709 12:20:48.182261 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:48.182950 20323 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:48.110690 28465 raft_consensus.cc:515] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.195262 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:48.207131 28465 leader_election.cc:290] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:48.198745 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 283013us
I20260709 12:20:48.177282 28410 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.261376 20323 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:48.261773 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:48.262415 20325 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:48.272380 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:48.156813 28188 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.248271 28430 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:48.158094 28349 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.297995 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:48.327495 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 265433us
I20260709 12:20:48.335496 20325 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 28.
I20260709 12:20:48.279415 28430 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.352248 28430 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.352941 28188 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:48.339710 28437 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:48.342397 28349 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:48.349661 28482 log.cc:927] Time spent T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.189s	user 0.003s	sys 0.000s
I20260709 12:20:48.315528 28438 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:20:48.373353 27747 raft_consensus.cc:3055] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:48.373924 27747 raft_consensus.cc:740] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:48.386077 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.384939 28349 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.385346 28472 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.546675 28430 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.548231 21034 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:48.548583 28437 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:48.549116 28437 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.550546 28430 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.554487 28375 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.554615 27747 consensus_queue.cc:260] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.555097 28375 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.557085 27747 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.557962 28156 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.558511 28156 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.561040 28156 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:48.563413 28375 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.564553 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.569793 28437 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.572301 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.573127 20073 catalog_manager.cc:5697] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 16 to 19, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 19 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.574998 20073 catalog_manager.cc:5697] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.581435 20073 catalog_manager.cc:5697] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.583118 20073 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 17 to 22, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 22 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.588259 28437 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.590435 20073 catalog_manager.cc:5697] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 4 to 12, term changed from 16 to 18, VOTER 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) evicted. New cstate: current_term: 18 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.594112 20073 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:48.605942 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 331082us
W20260709 12:20:48.620318 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 66544.6us
W20260709 12:20:48.543794 28256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.012s	sys 0.040s
W20260709 12:20:48.624447 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.633188 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4b4e64b7f442968c110b5d746e4b14" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:48.599267 28481 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
W20260709 12:20:48.639823 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 313572us
I20260709 12:20:48.464779 28349 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.588845 20078 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 313) took 7183 ms. Trace:
I20260709 12:20:48.466317 28472 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.647801 28438 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:48.649192 28487 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:20:48.656927 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:48.659168 28256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.013s	sys 0.040s
I20260709 12:20:48.664518 20078 rpcz_store.cc:276] 0709 12:20:41.405226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.405459 (+   233us) service_pool.cc:224] Handling call
0709 12:20:48.588731 (+7183272us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:46.877950 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:46.878553 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:46.878597 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:20:46.878616 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:46.880790 (+  2174us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:46.880877 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:46.880903 (+    26us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:20:46.886001 (+  5098us) tablet.cc:701] Row locks acquired
0709 12:20:46.886021 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:20:46.886175 (+   154us) write_op.cc:270] Start()
0709 12:20:46.886311 (+   136us) write_op.cc:276] Timestamp: P: 1783599646886123 usec, L: 0
0709 12:20:46.886331 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:46.887103 (+   772us) log.cc:844] Serialized 9848 byte log entry
0709 12:20:47.113263 (+226160us) op_driver.cc:464] REPLICATION: finished
0709 12:20:47.244963 (+131700us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5dd7dee0ac 00007f5de0c489a9 00007f5dd7e0a69b 00007f5dd7e0893f 00007f5dd7e0ac02 00007f5dde92eef0
0709 12:20:47.305498 (+ 60535us) write_op.cc:301] APPLY: starting
0709 12:20:47.305602 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:47.357991 (+ 52389us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:47.358016 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:47.409287 (+ 51271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:47.409677 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 12:20:47.409723 (+    46us) write_op.cc:312] APPLY: finished
0709 12:20:47.410196 (+   473us) log.cc:844] Serialized 220 byte log entry
0709 12:20:47.416471 (+  6275us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.418080 (+  1609us) write_op.cc:454] Released schema lock
0709 12:20:47.418161 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:47.500378 (+ 82217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.521388 (+ 21010us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67074,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":191954,"apply.run_cpu_time_us":31548,"apply.run_wall_time_us":144946,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108777,"num_ops":25,"prepare.queue_time_us":306957,"prepare.run_cpu_time_us":60950,"prepare.run_wall_time_us":151278,"raft.queue_time_us":33093,"raft.run_cpu_time_us":17622,"raft.run_wall_time_us":178740,"replication_time_us":226742,"spinlock_wait_cycles":53411072,"thread_start_us":569478,"threads_started":4,"wal-append.queue_time_us":183307,"wal-append.run_cpu_time_us":10453,"wal-append.run_wall_time_us":1345515}]]}
I20260709 12:20:48.672490 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:48.651971 20073 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.658828 28207 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.675185 20073 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:48.663952 28245 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:48.689726 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.689445 20073 catalog_manager.cc:5697] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:48.693946 20073 catalog_manager.cc:5697] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:48.685799 28441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.006s
I20260709 12:20:48.667863 28241 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:48.704171 28492 log.cc:927] Time spent T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:20:48.705418 28488 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:20:48.669533 28438 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.716403 28438 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:48.718902 28484 log.cc:927] Time spent T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:48.729296 28349 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.692893 28207 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.733234 28207 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:48.695930 28245 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.735826 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:48.737186 28493 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 12:20:48.738032 28245 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.688712 28469 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:20:48.700773 28441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.010s	sys 0.006s
I20260709 12:20:48.678730 28452 consensus_queue.cc:1059] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:20:48.741873 28241 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:48.753512 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.758368 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 121725us
W20260709 12:20:48.760673 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134149us
I20260709 12:20:48.762856 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.764530 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.769284 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.745591 28469 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 28 LEADER]: Becoming Leader. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:48.766316 20220 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.796393 20220 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:48.801779 21040 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:20:48.806222 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.820622 28421 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:48.821261 28207 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:48.821920 20219 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:48.821820 28207 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.824033 28497 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:48.825174 28095 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:48.821277 28421 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:48.826412 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.830224 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.830938 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.831533 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.834950 20220 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:48.835722 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.851441 28224 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.852147 28332 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:48.852258 28224 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.852895 28332 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.854777 28224 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:48.855381 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:48.856102 20321 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.856390 20294 leader_election.cc:304] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:48.857028 28473 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:48.857585 28473 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.859051 28499 raft_consensus.cc:2749] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:48.852910 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:48.851359 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:48.864552 28472 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:48.865077 20329 raft_consensus.cc:2393] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 26: Already voted for candidate f5c544fad8874e818acaad733a9d14f1 in this term.
I20260709 12:20:48.771602 28379 raft_consensus.cc:3055] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:48.866993 28379 raft_consensus.cc:740] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:48.867169 28282 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:48.867856 28282 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.868005 28379 consensus_queue.cc:260] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.869395 28379 raft_consensus.cc:3060] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.871452 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:48.872112 20322 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.873004 20325 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 27. Current term is 28. Ops: []
I20260709 12:20:48.855288 28224 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.881038 20329 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:48.884106 20321 raft_consensus.cc:2468] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:48.885236 21034 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:48.886077 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:48.886077 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:48.892271 20323 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:48.894567 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:48.898540 20328 raft_consensus.cc:1240] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:48.888103 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 82304.2us
I20260709 12:20:48.904209 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:48.908878 20295 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:48.909865 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:48.915046 20322 raft_consensus.cc:2468] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:48.916422 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:48.917057 20328 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:20:48.909410 20295 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:48.926523 21007 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:48.933135 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:48.935258 28413 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:48.936131 28428 raft_consensus.cc:2804] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:48.936758 28428 raft_consensus.cc:697] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:48.937820 28428 consensus_queue.cc:237] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:48.942036 21034 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:20:48.945298 28207 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:48.946151 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.946884 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.947273 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:48.947544 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.948269 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.948398 28186 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:20:48.948931 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.949584 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:48.950198 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.950349 28332 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:48.952958 28241 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:48.955595 20329 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:48.930251 28474 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:48.957974 28474 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.960419 28474 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:48.963213 28499 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.963759 28499 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:48.950846 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.900122 28282 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:48.978628 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:48.989764 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:48.915745 28156 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:48.892554 28224 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:48.999837 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:49.007679 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:49.010877 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:49.014446 20328 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Refusing update from remote peer f5c544fad8874e818acaad733a9d14f1: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:20:48.984229 28395 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:49.023007 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.034225 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.016431 28207 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
W20260709 12:20:49.053228 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.014191 28421 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.016672 28441 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:49.017072 28452 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:49.065243 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:49.102562 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:49.093755 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.124387 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 108604us
I20260709 12:20:49.059592 28245 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:49.126714 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.131114 20295 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:49.032909 28437 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 12:20:49.031320 28395 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.024889 28469 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.075269 28441 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.065227 28207 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.081184 28452 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.158485 28474 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:20:49.139320 28245 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:49.155887 20295 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:49.224886 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:49.226109 28480 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:49.226320 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76434.6us
W20260709 12:20:49.227344 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.228241 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.229043 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.229789 20295 consensus_peers.cc:597] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:49.173962 28241 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:49.233911 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.279359 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48902.7us
W20260709 12:20:49.280248 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.280931 20295 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:49.281591 20295 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:49.282156 20295 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:49.240060 28473 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:49.266505 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 234529us
W20260709 12:20:49.231609 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 149393us
I20260709 12:20:49.284436 20219 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:49.284742 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:49.197184 28474 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:49.295601 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:49.240408 28516 log.cc:927] Time spent T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:49.309203 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.305954 28524 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:49.319356 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:49.237246 28395 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.305612 28518 raft_consensus.cc:493] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:49.297043 28480 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:49.285389 28241 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.298208 28095 raft_consensus.cc:2804] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:49.308009 28522 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:49.309643 28499 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.313692 28224 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:49.319269 28485 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.357151 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 72475.5us
I20260709 12:20:49.333897 28340 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:49.380997 28515 log.cc:927] Time spent T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:20:49.382025 28526 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:49.382682 28526 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.401726 28256 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:49.402475 28256 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.359242 28438 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:49.355202 28473 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:49.385376 28499 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.371358 28095 raft_consensus.cc:697] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:49.386508 28395 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:49.388924 28332 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:49.446774 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.355511 28522 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.354909 28474 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.376641 28485 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.448593 28531 raft_consensus.cc:493] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:49.462762 28519 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:20:49.344169 28518 raft_consensus.cc:515] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.441576 28438 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.524165 20325 consensus_queue.cc:237] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.441020 28473 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.463816 28207 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.443058 28499 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.465194 28395 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:49.464252 28452 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.451807 28332 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:49.527829 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.490658 28441 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.530045 28527 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:49.530275 28542 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:49.555477 28452 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.600613 28379 consensus_meta.cc:287] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.728s	user 0.015s	sys 0.000s
W20260709 12:20:49.620090 28532 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:20:49.621124 28518 leader_election.cc:290] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.557703 28395 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.528759 28531 raft_consensus.cc:515] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.623934 28473 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.625460 28438 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:49.635341 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 217130us
I20260709 12:20:49.636901 28522 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.666955 28428 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:49.669342 28474 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:49.670210 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:49.678500 28245 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.638379 28366 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.688818 28366 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.690352 21039 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:49.638439 28485 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.612165 28452 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.694900 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.694980 28526 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.695837 20256 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 23.
W20260709 12:20:49.637871 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.669040 28428 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.697355 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:49.699234 28428 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.699431 28536 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.699904 28428 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:49.700356 28428 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.700083 28536 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.700757 28428 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:49.702621 28536 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:49.705026 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.705883 20256 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:49.654067 28256 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.709267 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:49.717837 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:49.718701 28410 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:49.719172 28410 raft_consensus.cc:493] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.719745 28395 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.718588 28531 leader_election.cc:290] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.548904 28095 consensus_queue.cc:237] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.694916 28499 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.705479 28332 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.597538 28527 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.757575 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:49.758569 20328 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:20:49.776418 28536 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:49.777158 28536 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:49.778919 28452 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.780830 28536 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.782744 28241 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.782637 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:49.798457 28366 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.753659 28410 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:49.802906 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 125062us
I20260709 12:20:49.805395 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:49.806850 28188 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:49.807066 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:49.807327 28188 raft_consensus.cc:493] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.807783 28188 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:49.825265 27747 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.844364 27747 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:49.845567 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.852491 28527 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:49.601670 28542 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:49.894520 28542 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.875443 20323 raft_consensus.cc:1275] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:20:49.872434 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:49.481478 28421 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.442s
I20260709 12:20:49.950594 27747 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:49.962252 28385 consensus_queue.cc:1048] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:20:49.993098 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:49.999701 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 29 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.000911 20328 raft_consensus.cc:2393] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 29: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:50.003037 28366 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:50.061894 27747 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.062888 27747 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.082221 28428 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.087430 28188 raft_consensus.cc:515] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.117621 27747 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.085155 28410 raft_consensus.cc:515] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.138177 28188 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:50.157910 28410 leader_election.cc:290] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:50.147724 28428 leader_election.cc:290] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.209883 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.216795 28473 raft_consensus.cc:493] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:50.218380 28473 raft_consensus.cc:515] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.222774 28473 leader_election.cc:290] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:50.284322 20219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.021s	sys 0.032s
W20260709 12:20:50.292461 20295 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.028s	sys 0.032s
W20260709 12:20:50.298868 20219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.022s	sys 0.032s
W20260709 12:20:50.303011 20295 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.029s	sys 0.033s
W20260709 12:20:50.315486 28224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.027s	sys 0.044s
W20260709 12:20:50.321013 28282 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.009s
W20260709 12:20:50.325631 20220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.151s	sys 0.217s
W20260709 12:20:50.326007 28282 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.010s
W20260709 12:20:50.326263 20220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.151s	sys 0.217s
W20260709 12:20:50.315974 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 749738us
W20260709 12:20:50.327996 28400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.004s	sys 0.003s
W20260709 12:20:50.328552 28400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.005s	sys 0.003s
W20260709 12:20:50.335371 20144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.000s	sys 0.016s
W20260709 12:20:50.335860 20144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.001s	sys 0.016s
W20260709 12:20:50.336272 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 959921us
I20260709 12:20:50.340520 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:50.342029 21040 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 25: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:50.343667 28216 raft_consensus.cc:493] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.344666 28216 raft_consensus.cc:515] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.349318 28385 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.350379 28385 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.351773 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 784340us
W20260709 12:20:50.325902 20325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.001s	sys 0.009s
W20260709 12:20:50.321030 28224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.028s	sys 0.044s
I20260709 12:20:50.315752 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:50.357816 28522 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.321614 27975 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.362008 20256 raft_consensus.cc:3060] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:20:50.362143 28522 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.362902 27975 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.364082 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.365576 28522 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.358029 20325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.002s	sys 0.009s
I20260709 12:20:50.367986 28504 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.368997 28504 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.321162 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:50.370435 20248 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:20:50.366127 27975 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.384081 28511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.011s	sys 0.009s
W20260709 12:20:50.382755 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 45376.8us
I20260709 12:20:50.393925 28410 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:50.395146 28410 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.405540 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.408272 28550 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.005s	sys 0.012s
W20260709 12:20:50.410044 28550 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.005s	sys 0.013s
W20260709 12:20:50.402889 28511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.011s	sys 0.010s
I20260709 12:20:50.421561 28536 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:50.422833 28536 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.424058 28547 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.020s	sys 0.030s
W20260709 12:20:50.428130 28547 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.020s	sys 0.030s
W20260709 12:20:50.431836 20321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.022s	sys 0.031s
I20260709 12:20:50.429620 28216 leader_election.cc:290] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.447804 28469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.006s	sys 0.022s
W20260709 12:20:50.448506 28469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.006s	sys 0.022s
I20260709 12:20:50.451733 28428 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.453080 28428 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.464082 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.468674 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:50.469918 20325 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 25: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:50.473268 28536 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.461205 20321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.023s	sys 0.031s
I20260709 12:20:50.444451 28504 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.484356 28216 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.496543 28216 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.498309 27747 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:50.485683 28536 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:50.503041 28556 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.503635 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:50.507787 21041 raft_consensus.cc:2368] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 24. Current term is 25.
I20260709 12:20:50.499017 28185 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:50.511978 28554 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.520251 27747 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.524183 28216 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.521986 28095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.023s	sys 0.024s
I20260709 12:20:50.515336 28504 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.517014 28523 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.531858 27975 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
W20260709 12:20:50.539198 28095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.025s	sys 0.026s
I20260709 12:20:50.526403 28556 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.555372 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:50.559729 21034 raft_consensus.cc:2368] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:50.559121 28523 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.543553 28216 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.553848 28410 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.563319 28156 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.567757 28474 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.567665 28156 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.568637 28474 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.548352 28185 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.561364 28428 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:50.550557 27975 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.548475 28536 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.552093 28522 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.570434 28156 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.556593 28554 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.597774 28185 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:50.580554 28385 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.576282 28410 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:50.580739 28504 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.615150 27747 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:50.620806 27747 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.621553 27747 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.609521 28216 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.627556 20321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42166 (request call id 3939) took 1066 ms. Trace:
I20260709 12:20:50.626689 28536 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.652436 28556 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.652480 28550 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.653972 28554 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.635640 28474 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.625141 28522 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.634871 28095 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.671033 28095 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.673846 28095 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.646144 20321 rpcz_store.cc:276] 0709 12:20:49.559066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.560183 (+  1117us) service_pool.cc:224] Handling call
0709 12:20:49.587259 (+ 27076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.588146 (+   887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.588182 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.588728 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:20:50.531500 (+942772us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:50.533761 (+  2261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.542221 (+  8460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.589953 (+ 47732us) raft_consensus.cc:1685] finished
0709 12:20:50.589974 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.625333 (+ 35359us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33082,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"thread_start_us":868584,"threads_started":1,"wal-append.queue_time_us":937883}
I20260709 12:20:50.688249 28421 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.689286 28421 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.697084 27747 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.698236 28523 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.650059 28410 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.654389 28550 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.726791 20256 raft_consensus.cc:2468] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 25.
I20260709 12:20:50.722992 28216 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:50.732821 27975 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.749716 20248 raft_consensus.cc:2468] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:50.760818 28522 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.754722 28550 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.753925 28421 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:50.753615 28216 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:50.770002 28504 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:50.771724 28410 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:50.776973 28569 log.cc:927] Time spent T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.231s	user 0.003s	sys 0.001s
W20260709 12:20:50.782686 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 173751us
I20260709 12:20:50.788645 28216 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
I20260709 12:20:50.791447 28216 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563)
I20260709 12:20:50.795727 28540 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.800315 28540 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.792913 20295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.815641 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.816550 20325 raft_consensus.cc:2368] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 24. Current term is 25.
I20260709 12:20:50.816381 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.818470 28502 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.819064 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.819329 28502 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.826009 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.826565 28400 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.827127 28400 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.829660 28400 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:50.796092 28552 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:50.832118 28552 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:50.834573 28552 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:50.836812 28502 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:50.837462 28540 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:50.856509 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 99962us
I20260709 12:20:50.863068 20328 raft_consensus.cc:1275] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:50.867460 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.870263 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.871819 20256 raft_consensus.cc:1240] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:50.876974 20219 leader_election.cc:400] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 24. Current term is 25.
I20260709 12:20:50.877373 20219 leader_election.cc:403] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:50.878129 28216 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 24. Current term is 25.
I20260709 12:20:50.879863 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:50.881481 21008 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.796s (SENT)
I20260709 12:20:50.881626 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.882380 20328 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 21.
I20260709 12:20:50.883348 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.885057 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.887367 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.887706 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.888018 20323 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
I20260709 12:20:50.888535 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.888810 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.888991 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.889452 20328 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 28.
I20260709 12:20:50.889683 20325 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 14.
I20260709 12:20:50.890419 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.892005 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.893944 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.897127 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.905367 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.905941 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:50.879885 20219 leader_election.cc:400] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:50.907441 20219 leader_election.cc:403] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:50.882058 21008 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:50.912606 27747 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.912747 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:50.917033 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.918381 20254 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 25: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:50.920799 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:50.930766 21009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.938338 21007 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:50.943336 27747 raft_consensus.cc:2804] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:50.943524 21007 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:50.943960 27747 raft_consensus.cc:697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:50.945380 27747 consensus_queue.cc:237] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:50.947789 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 68145.8us
I20260709 12:20:50.947933 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.949128 28410 raft_consensus.cc:2804] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:50.949697 28410 raft_consensus.cc:697] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:50.950678 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.952561 20250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58bdb95474c4f788fec380b260dc1be" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:50.949595 20247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.953409 20250 raft_consensus.cc:2393] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 25: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:50.954725 28550 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 21. Current term is 22.
I20260709 12:20:50.951068 28410 consensus_queue.cc:237] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:50.959131 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.960734 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.965955 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:50.969595 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.971653 28502 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 6 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:50.993515 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:50.993218 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:50.999203 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:50.999822 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.010001 21041 raft_consensus.cc:2468] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5c544fad8874e818acaad733a9d14f1 in term 20.
I20260709 12:20:51.012234 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.018832 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.031029 20219 leader_election.cc:400] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) with higher term. Message: Invalid argument: T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e929b30888874ed59248f1229cecd3c6 for earlier term 24. Current term is 25.
I20260709 12:20:51.032413 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.034961 27975 consensus_queue.cc:1048] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:51.034096 21035 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 6 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:51.054181 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.034091 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.035655 21039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.052254 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.053126 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.056044 20249 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:20:51.054750 20326 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:51.069324 21042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.069350 28550 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:51.072516 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.073168 20326 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 22.
I20260709 12:20:51.069414 28552 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.074860 28552 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.075291 20219 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.076685 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.077195 28552 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.070798 28550 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.077577 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.078022 28550 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:51.078387 20296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.079107 28504 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:51.079584 28504 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.079982 28504 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:51.082530 28216 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:20:51.083043 28216 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.083494 28216 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:51.084316 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.091496 21037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.092948 27975 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:51.104878 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 2.131s (SENT)
I20260709 12:20:51.103696 20325 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:51.120714 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.123198 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e43fd47bc14908b8da11134e6fd1d6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.104985 27975 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.128863 27975 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:51.141240 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.142583 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.143496 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:51.148177 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 85336.8us
I20260709 12:20:51.150279 21008 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:51.166389 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 69352.5us
I20260709 12:20:51.167129 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.168459 20326 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
I20260709 12:20:51.202090 27975 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.196058 28421 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:51.205009 27975 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.204916 28421 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.206144 28428 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:20:51.166658 28216 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.207384 28421 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:51.218097 20295 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.225178 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.225375 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.226238 28502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43428 (request call id 1) took 1767 ms. Trace:
I20260709 12:20:51.226703 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.228156 20295 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.226644 28502 rpcz_store.cc:276] 0709 12:20:49.459388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.459583 (+   195us) service_pool.cc:224] Handling call
0709 12:20:49.595863 (+136280us) log.cc:844] Serialized 501 byte log entry
0709 12:20:51.226086 (+1630223us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":740594,"threads_started":1,"wal-append.queue_time_us":810032}
I20260709 12:20:51.233884 20254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.234429 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.234727 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.237967 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.239748 28421 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.240510 28421 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.241343 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.242863 28421 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.249635 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d92f1167e6425dbdcc7276bd1de9b7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.243921 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.250890 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.252596 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.253268 20253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.253963 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.255924 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:51.256067 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 112654us
I20260709 12:20:51.259888 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.261397 28504 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.264873 28504 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.273197 20073 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 212) took 7546 ms. Trace:
I20260709 12:20:51.272929 28550 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.277014 28216 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 29 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.273667 20073 rpcz_store.cc:276] 0709 12:20:43.726701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.728515 (+  1814us) service_pool.cc:224] Handling call
0709 12:20:44.430775 (+702260us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400369054. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5ddae62090 00007f5ddaf00f3a 00007f5de0cb6e9c 00007f5de0db504e 00007f5ddf2762a4 00007f5ddf276232 00007f5ddf276161 00007f5ddf2760dc 00007f5ddf275392 00007f5dd923348c 00007f5dd92328c6
0709 12:20:51.272937 (+6842162us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:48.951511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:48.952248 (+   737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:48.952294 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:20:48.952315 (+    21us) tablet.cc:662] Decoding operations
0709 12:20:48.953622 (+  1307us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:48.953728 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:48.953756 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:20:48.954974 (+  1218us) tablet.cc:701] Row locks acquired
0709 12:20:48.954998 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:20:48.955169 (+   171us) write_op.cc:270] Start()
0709 12:20:48.955289 (+   120us) write_op.cc:276] Timestamp: P: 1783599648955108 usec, L: 0
0709 12:20:48.955313 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:49.055398 (+100085us) log.cc:844] Serialized 5133 byte log entry
0709 12:20:49.622147 (+566749us) op_driver.cc:464] REPLICATION: finished
0709 12:20:50.450060 (+827913us) write_op.cc:301] APPLY: starting
0709 12:20:50.450294 (+   234us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:50.801315 (+351021us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:50.801447 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:50.896526 (+ 95079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:50.896937 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:20:50.896995 (+    58us) write_op.cc:312] APPLY: finished
0709 12:20:50.897546 (+   551us) log.cc:844] Serialized 121 byte log entry
0709 12:20:51.021973 (+124427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:51.080379 (+ 58406us) write_op.cc:454] Released schema lock
0709 12:20:51.080482 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:51.081371 (+   889us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:51.081416 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1412170,"reported_tablets":30,"spinlock_wait_cycles":1417393024,"child_traces":[["op",{"apply.queue_time_us":827393,"apply.run_cpu_time_us":51981,"apply.run_wall_time_us":631336,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58545,"num_ops":13,"prepare.queue_time_us":242066,"prepare.run_cpu_time_us":76918,"prepare.run_wall_time_us":366373,"raft.queue_time_us":212504,"raft.run_cpu_time_us":51720,"raft.run_wall_time_us":843168,"replication_time_us":666636,"thread_start_us":1422210,"threads_started":5,"wal-append.queue_time_us":504218,"wal-append.run_cpu_time_us":26891,"wal-append.run_wall_time_us":1157377}]]}
W20260709 12:20:51.280109 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.280944 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:51.281710 21008 leader_election.cc:336] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.289377 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f2bc2263db420a815ba46efc7bf818" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.290294 20256 raft_consensus.cc:2393] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 22: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
W20260709 12:20:51.304589 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:51.299295 28552 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:51.312079 20294 leader_election.cc:304] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:51.313458 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 141780us
I20260709 12:20:51.314129 20256 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 29 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 28. Current term is 29. Ops: []
I20260709 12:20:51.314630 28553 raft_consensus.cc:2749] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:20:51.315367 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.323391 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.319061 28502 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:51.325683 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.325817 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4da77a6bb24e4f94abb2f4bd8a7f9e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.327612 28421 raft_consensus.cc:493] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.328169 28421 raft_consensus.cc:515] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.332432 28421 leader_election.cc:290] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.334059 28428 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:51.334908 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 116832us
W20260709 12:20:51.335649 20295 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.336086 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.340092 28552 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:51.341182 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.343372 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.343883 20075 catalog_manager.cc:5697] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 18 to 19, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 19 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.345314 28572 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:51.356972 20075 catalog_manager.cc:5697] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 20 to 22, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 22 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.361657 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:20:51.363476 28400 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.364243 28400 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.364574 28502 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:51.358631 28550 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.367166 28502 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.346347 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:51.375512 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:51.363538 20075 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:51.371415 28502 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:51.383173 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:51.396416 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:51.401046 28400 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.401265 20313 tablet_service.cc:1558] Processing DeleteTablet for tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e with delete_type TABLET_DATA_TOMBSTONED (TS 85fa447fc35d4f88ab7c85630749ec78 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:43428
I20260709 12:20:51.402673 28366 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:51.403079 28366 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.403448 28366 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.401121 28385 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:51.406247 28385 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:51.406649 28385 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:51.401611 28185 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.407948 28185 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.410585 28185 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.319399 28589 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.413715 20075 catalog_manager.cc:5697] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 20 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 21 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.414770 28589 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.415697 20075 catalog_manager.cc:5697] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:51.417982 20075 catalog_manager.cc:5697] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.424494 20075 catalog_manager.cc:5697] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.428134 28571 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:51.430954 28571 raft_consensus.cc:493] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.431348 28571 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.416934 28589 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.394730 28428 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:51.436184 28428 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:51.436715 28428 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:51.466847 28590 raft_consensus.cc:493] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.467629 28590 raft_consensus.cc:515] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } }
W20260709 12:20:51.471307 20146 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.474917 20063 catalog_manager.cc:5028] TS 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): tablet cb4da77a6bb24e4f94abb2f4bd8a7f9e (table test-workload [id=de5952fc08474ab1a16a9522bfe34b08]) successfully deleted
I20260709 12:20:51.469277 28421 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.483541 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937144b407c548958468c2b27f8cd054" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.484427 20321 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:51.480499 28571 raft_consensus.cc:515] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.483300 28421 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.496007 28421 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.496816 28421 raft_consensus.cc:493] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.497648 28421 raft_consensus.cc:515] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.472577 28589 raft_consensus.cc:493] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:51.498027 28590 leader_election.cc:290] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.506666 28421 leader_election.cc:290] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.506963 28589 raft_consensus.cc:515] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.507736 28571 leader_election.cc:290] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.509805 20321 raft_consensus.cc:2468] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 15.
I20260709 12:20:51.478965 28428 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.508567 20075 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 21 to 23, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 23 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.523191 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.524403 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.549530 20329 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:51.525198 28590 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.551893 28590 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.525967 28421 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:51.526330 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.554046 20323 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.487228 28366 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.506639 28385 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.561040 28589 leader_election.cc:290] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.584824 28589 raft_consensus.cc:493] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:51.585412 28589 raft_consensus.cc:515] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.585826 28385 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.586881 21035 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:51.563714 20075 catalog_manager.cc:5697] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:51.580600 20295 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.575467 20323 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 22.
W20260709 12:20:51.560000 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 156895us
I20260709 12:20:51.578171 20219 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.576936 28428 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.580385 28366 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:51.592129 20295 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.603793 20075 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 15 to 17, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 17 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.605226 20329 raft_consensus.cc:2468] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 29.
W20260709 12:20:51.605623 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46188.2us
I20260709 12:20:51.604504 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.564383 28590 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:51.613865 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 77787.5us
I20260709 12:20:51.607945 20075 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:51.608088 28550 raft_consensus.cc:2804] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:51.648913 28550 raft_consensus.cc:697] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:51.649996 28550 consensus_queue.cc:237] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.607827 28553 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:51.630782 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:51.641909 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.613925 28594 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 12:20:51.642681 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 30 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.653234 21038 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 28.
I20260709 12:20:51.643836 20326 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:20:51.643739 28590 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:51.654348 28590 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.656322 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:51.646514 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.644485 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:51.657074 20325 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.657635 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:51.587484 28421 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.619786 28540 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:51.659200 28540 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:51.647223 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.656718 28590 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.659710 28540 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:51.661494 20252 raft_consensus.cc:1275] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:51.663020 28589 leader_election.cc:290] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.656412 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d378f8e2f934dcc8adcad8d5c71b573" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.667845 20323 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.675616 20256 raft_consensus.cc:1275] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:20:51.679416 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:51.684428 28573 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:51.685946 28573 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:51.686378 28573 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:51.688573 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.688987 28385 consensus_queue.cc:1048] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:51.689954 28366 raft_consensus.cc:2749] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:51.670639 28571 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:20:51.698822 28540 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:51.704540 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81077.6us
W20260709 12:20:51.712860 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 186050us
I20260709 12:20:51.718844 20323 raft_consensus.cc:2468] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:51.720082 20325 raft_consensus.cc:2468] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:51.724251 21041 raft_consensus.cc:1240] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Rejecting Update request from peer e929b30888874ed59248f1229cecd3c6 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:51.722021 21007 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
W20260709 12:20:51.726502 20295 leader_election.cc:336] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.726960 20295 leader_election.cc:304] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.723497 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:51.728773 21007 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:51.729946 20248 raft_consensus.cc:2955] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 6 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:51.740638 27747 raft_consensus.cc:2804] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:51.741225 28306 raft_consensus.cc:2749] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:51.741050 28504 consensus_queue.cc:1059] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:51.742388 28216 raft_consensus.cc:3055] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:51.742723 20321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.743100 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d963e0e1da434f887fc330570683e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.743824 20322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.744364 20330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.742278 20326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc4c01fd2da34b0e9fb9ba3d8b2bd4c8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.741276 27747 raft_consensus.cc:697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:51.745929 20321 raft_consensus.cc:1240] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 28. Current term is 29. Ops: []
I20260709 12:20:51.742842 28216 raft_consensus.cc:740] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:51.739372 28185 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:20:51.748638 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.747251 27747 consensus_queue.cc:237] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.730571 28571 raft_consensus.cc:2804] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:51.753325 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.756142 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.757311 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599fe0ac57224f249385f1d6243cb41a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.758435 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.752332 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:51.764873 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.765679 28540 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:51.766659 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:51.767534 28589 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:51.769304 28594 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:51.768748 20075 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:51.750285 28185 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.752586 28385 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:51.731369 28410 consensus_queue.cc:1048] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 12:20:51.761466 28571 raft_consensus.cc:697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:51.751998 28216 consensus_queue.cc:260] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.774438 20075 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:51.785791 20075 catalog_manager.cc:5697] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:51.788177 28571 consensus_queue.cc:237] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.722913 28573 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.790882 28573 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:51.795956 28590 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:51.774142 28185 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:20:51.804774 28216 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:51.805644 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76509.4us
W20260709 12:20:51.806398 20295 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.806808 20295 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.825215 20255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:51.826310 20255 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 23: Already voted for candidate e929b30888874ed59248f1229cecd3c6 in this term.
W20260709 12:20:51.833328 20295 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:51.834370 20295 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.834748 20295 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.820986 28421 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:51.839433 28598 consensus_queue.cc:1059] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:20:51.840036 28502 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:51.858659 28598 raft_consensus.cc:3055] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:51.859129 28598 raft_consensus.cc:740] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:51.860123 28598 consensus_queue.cc:260] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:51.861610 28598 raft_consensus.cc:3060] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.862907 28185 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:51.865631 28185 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:51.873225 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 104464us
I20260709 12:20:51.879151 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 30 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:51.881135 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 46797.3us
I20260709 12:20:51.881703 21041 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 28 FOLLOWER]: Advancing to term 30
W20260709 12:20:51.894714 20295 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.895247 20295 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.886353 28400 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:51.914064 20219 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.916765 20219 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:51.917073 28552 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:20:51.930493 20295 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.921494 28216 raft_consensus.cc:2804] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:20:51.933851 20295 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:51.950423 20295 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.950965 20295 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:51.931959 28573 raft_consensus.cc:2804] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:20:51.965871 20295 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:51.961859 28605 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:51.963631 28306 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:52.038167 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 59241.6us
W20260709 12:20:52.041113 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 50496.5us
W20260709 12:20:52.064250 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.086387 21041 raft_consensus.cc:2468] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 30.
W20260709 12:20:52.087307 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 102207us
W20260709 12:20:52.116943 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 77898.6us
I20260709 12:20:52.062932 28216 raft_consensus.cc:697] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 29 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:52.063949 28573 raft_consensus.cc:697] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
W20260709 12:20:52.373571 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 255708us
W20260709 12:20:52.411060 28612 log.cc:927] Time spent T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.282s	user 0.008s	sys 0.000s
I20260709 12:20:52.420768 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.373891 28594 consensus_queue.cc:1059] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.048s
W20260709 12:20:52.485136 18961 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 20205)
I20260709 12:20:52.505666 28594 raft_consensus.cc:3055] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:20:52.537554 28598 consensus_meta.cc:287] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: Time spent flushing consensus metadata: real 0.674s	user 0.016s	sys 0.004s
I20260709 12:20:52.499670 28216 consensus_queue.cc:237] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:52.537150 28594 raft_consensus.cc:740] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:52.554359 28156 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:52.513926 28573 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:52.564002 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 152809us
I20260709 12:20:52.555174 28156 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:52.582710 20145 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:52.604255 20324 raft_consensus.cc:1275] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:20:52.601737 20295 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:52.605293 28604 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:52.607182 20295 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:52.615644 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.617638 28502 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:52.626315 20324 raft_consensus.cc:1275] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:20:52.627224 20295 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:52.637974 20324 raft_consensus.cc:1275] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:52.648754 28156 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:52.649115 28366 consensus_queue.cc:1048] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:52.655421 20294 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:52.657963 28553 raft_consensus.cc:2804] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:20:52.658514 28553 raft_consensus.cc:697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 30 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:52.569919 28594 consensus_queue.cc:260] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:52.660720 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.660992 28620 consensus_queue.cc:1048] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:52.661578 28594 raft_consensus.cc:3060] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:20:52.667841 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 52371us
I20260709 12:20:52.669145 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.640188 28385 consensus_queue.cc:1048] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:20:52.684082 28636 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:52.685281 28421 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:52.687673 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 81888.9us
W20260709 12:20:52.695910 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.727s (SENT)
W20260709 12:20:52.688076 28504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.003s	sys 0.021s
W20260709 12:20:52.701689 28504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.004s	sys 0.021s
I20260709 12:20:52.703749 28617 raft_consensus.cc:493] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:52.704378 28617 raft_consensus.cc:515] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:52.706624 28617 leader_election.cc:290] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:52.710062 21008 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:52.711992 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.715472 28421 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:52.713526 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.659448 28553 consensus_queue.cc:237] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 27.22, Last appended by leader: 22, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:52.726503 28156 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:52.724107 20144 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:52.729081 28635 log.cc:927] Time spent T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.001s
I20260709 12:20:52.729565 28421 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:52.740604 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.741788 28421 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:52.760995 27747 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:52.761623 27747 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:52.781926 27747 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:52.783120 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:52.785251 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 44778.9us
I20260709 12:20:52.786384 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.783910 20327 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 26.
I20260709 12:20:52.788307 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:52.789155 27747 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:52.789556 27747 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:52.789970 27747 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:52.796142 28421 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:52.796808 20144 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.797861 28421 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:52.798544 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.819056 28421 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:52.846737 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 48327.5us
I20260709 12:20:52.847615 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.847918 27747 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:52.855327 28421 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:52.855711 27747 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 27 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:52.856942 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:52.857700 20325 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:52.858834 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:52.866055 20325 raft_consensus.cc:2468] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 27.
I20260709 12:20:52.867166 21007 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:52.867838 28421 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:52.868669 28631 raft_consensus.cc:2804] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:20:52.869218 28631 raft_consensus.cc:697] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:52.870149 28631 consensus_queue.cc:237] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:52.895834 20220 leader_election.cc:336] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.563s (SENT)
I20260709 12:20:52.896441 20220 leader_election.cc:304] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:52.900339 28216 raft_consensus.cc:2749] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:52.947256 28216 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.947891 28216 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:52.956108 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.960577 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:52.960731 28216 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:52.962236 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:52.962917 21041 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 23.
I20260709 12:20:52.964143 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:52.965525 28216 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:52.966111 28216 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.966445 28216 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:52.965476 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5260534c5dcb4fe0a840162b4eb6d460" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:52.968631 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.970000 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff822ba5f5ad4f8c87f6018de9072cfb" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:52.977644 28216 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:52.979508 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:52.980489 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:52.981132 28216 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 election: Requested vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:52.982024 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "766b995bcec04c62a05a9d91c572f494" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.983316 21041 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:52.984213 28655 log.cc:927] Time spent T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:52.985540 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.987123 20251 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:52.985540 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979d38c94754ec998f38fd4e97c3ab9" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 27 index: 22 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:52.989531 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:52.989949 21041 raft_consensus.cc:2368] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 28. Current term is 30.
I20260709 12:20:52.992463 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd163d5722084caaae2c38bdcf1e7698" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:52.995358 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:52.997714 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e89e7906a9724d15951ec300ab3095b6" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:53.022951 28552 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:53.023552 28552 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:53.026093 28552 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:53.028466 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.029335 20252 raft_consensus.cc:2368] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24.
I20260709 12:20:53.030607 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:53.031314 20294 leader_election.cc:400] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24.
I20260709 12:20:53.031409 21041 raft_consensus.cc:2393] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 23: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:53.031886 20294 leader_election.cc:403] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.032928 28552 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:20:53.041015 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.044096 28552 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765) with higher term. Message: Invalid argument: T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 for earlier term 23. Current term is 24.
I20260709 12:20:53.044862 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d79a5dd3e7e46678ffc3ddc6af43051" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:53.048148 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.051229 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.055974 20077 catalog_manager.cc:5697] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.057593 20077 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 22, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 22 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:53.059005 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094b66f474ed4806afc377722fa74020" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:53.060289 28552 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:53.060683 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e8de971f5342ac94652edf51dd27ef" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:53.060833 28552 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:53.063714 20077 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 21 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:53.065573 20252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.047132 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:53.044862 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda77defaf824b5c9cc9505346d7080c" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.065193 20077 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 13 to 14, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 14 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:53.067314 20252 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:53.069330 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.071339 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8aaa749694d4c0c9f5af38eeb53fe12" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:53.071539 28552 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:53.075408 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:53.077301 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:53.077904 28552 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:53.078101 21041 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:53.078444 28552 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:53.078935 28552 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:53.082141 20077 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 19 to 20, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 20 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:53.084347 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.085876 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 324) took 5287 ms. Trace:
I20260709 12:20:53.088955 20077 catalog_manager.cc:5697] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 22 to 24, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 24 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:53.087862 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:53.092099 20220 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 144 similar messages]
I20260709 12:20:53.089196 20075 rpcz_store.cc:276] 0709 12:20:47.798035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.800043 (+  2008us) service_pool.cc:224] Handling call
0709 12:20:53.085812 (+5285769us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:52.061971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:52.077991 (+ 16020us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:52.078048 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:20:52.078065 (+    17us) tablet.cc:662] Decoding operations
0709 12:20:52.079371 (+  1306us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:52.079485 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:52.079512 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:20:52.080741 (+  1229us) tablet.cc:701] Row locks acquired
0709 12:20:52.080801 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:20:52.080968 (+   167us) write_op.cc:270] Start()
0709 12:20:52.081134 (+   166us) write_op.cc:276] Timestamp: P: 1783599652080901 usec, L: 0
0709 12:20:52.081158 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:52.082073 (+   915us) log.cc:844] Serialized 5557 byte log entry
0709 12:20:52.589161 (+507088us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b4400022b4c. stack: 00007f5dd7dd9343 00007f5dd7dd9240 00007f5dd77681d4 00007f5de14a6304 00007f5de14a6299 00007f5dd7c93db1 00007f5dd7d31c85 00007f5dd7d326a2 00007f5ddaaa41db 00007f5ddaa9faaf 00007f5ddaa9386e 00007f5ddaa92bb6 00007f5ddaa927d8 00007f5ddaa9c221 00007f5ddaa9c1d9 00007f5ddaa9c169
0709 12:20:52.642983 (+ 53822us) op_driver.cc:464] REPLICATION: finished
0709 12:20:52.701898 (+ 58915us) write_op.cc:301] APPLY: starting
0709 12:20:52.702022 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:52.730753 (+ 28731us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:52.730775 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:52.945465 (+214690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:52.947745 (+  2280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:20:52.947794 (+    49us) write_op.cc:312] APPLY: finished
0709 12:20:52.948166 (+   372us) log.cc:844] Serialized 129 byte log entry
0709 12:20:52.954707 (+  6541us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:52.985281 (+ 30574us) write_op.cc:454] Released schema lock
0709 12:20:52.985348 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:52.988537 (+  3189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:52.990572 (+  2035us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195424,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":58606,"apply.run_cpu_time_us":22194,"apply.run_wall_time_us":283934,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62731,"num_ops":14,"prepare.queue_time_us":102121,"prepare.run_cpu_time_us":19074,"prepare.run_wall_time_us":358245,"raft.queue_time_us":51149,"raft.run_cpu_time_us":2346,"raft.run_wall_time_us":45763,"replication_time_us":561618,"spinlock_wait_cycles":81439360,"thread_start_us":466620,"threads_started":4,"wal-append.queue_time_us":451266}]]}
I20260709 12:20:53.093766 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94a451623b3d4ba9b27eb7e8b56cb47a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:53.094313 20325 raft_consensus.cc:1217] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 19.15->[20.16-20.16]   Dedup: 20.16->[]
I20260709 12:20:53.094784 20324 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:20:53.100486 20325 raft_consensus.cc:1240] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:20:53.093770 20251 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:53.098989 28552 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:53.105487 21008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 134130us
I20260709 12:20:53.108314 28552 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:20:53.108269 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.701s (SENT)
W20260709 12:20:53.111053 21008 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.718s (SENT)
I20260709 12:20:53.111447 21008 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.102145 20077 catalog_manager.cc:5697] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 19 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:53.114727 20325 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:53.117484 28595 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:53.117897 20327 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:53.118389 20324 raft_consensus.cc:1240] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:53.123148 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:53.125303 21041 raft_consensus.cc:2393] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 18: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:20:53.127311 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:53.127154 20077 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 19 to 20, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 20 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:53.139662 28594 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.140949 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:53.141605 21034 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:53.141660 20077 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 15 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:53.150264 21034 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e929b30888874ed59248f1229cecd3c6 in term 24.
I20260709 12:20:53.155970 20219 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
W20260709 12:20:53.156579 20220 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.157033 20220 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.160089 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:53.161298 20220 leader_election.cc:336] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.158891 28616 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:53.163350 20220 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.161041 28640 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:20:53.167245 20220 leader_election.cc:336] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.169114 20220 leader_election.cc:304] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:53.173601 20220 leader_election.cc:336] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.172263 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.174106 20220 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.174877 28636 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:53.175324 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.176249 28636 raft_consensus.cc:2804] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:53.176654 28636 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:53.177037 28636 raft_consensus.cc:3060] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:53.166323 28421 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:53.180125 20144 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.181296 28640 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 LEADER]: Becoming Leader. State: Replica: e929b30888874ed59248f1229cecd3c6, State: Running, Role: LEADER
I20260709 12:20:53.181468 20144 leader_election.cc:304] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:53.181699 28216 raft_consensus.cc:2749] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.182317 28640 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:53.183763 28594 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:53.187799 20220 leader_election.cc:336] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.188285 20220 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.184475 28216 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:53.167544 28504 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.188764 20144 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:53.189926 20220 leader_election.cc:336] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.190677 20220 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.184481 28594 raft_consensus.cc:2749] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:20:53.195497 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:53.197408 20220 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.199625 21041 raft_consensus.cc:1275] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 27 index: 22. Preceding OpId from leader: term: 30 index: 23. (index mismatch)
I20260709 12:20:53.190191 28573 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:53.197188 28616 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:53.202921 28625 consensus_queue.cc:1048] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:20:53.203596 28590 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:53.215161 20144 leader_election.cc:304] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.220785 28590 raft_consensus.cc:3060] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:53.226838 28421 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.227450 28421 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:53.228698 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.230700 28421 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:53.231298 28594 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.237674 28590 raft_consensus.cc:2749] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.232082 20328 raft_consensus.cc:1275] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:20:53.242894 20144 leader_election.cc:304] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.249101 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:53.252876 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 55483.8us
W20260709 12:20:53.253749 20220 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.254532 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:53.254648 20220 leader_election.cc:336] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.255224 20220 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:53.256687 20220 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:53.258026 20220 leader_election.cc:336] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.251848 28594 raft_consensus.cc:2749] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:53.258674 20220 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.256023 28590 raft_consensus.cc:2749] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.256814 28504 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:53.247789 28216 consensus_queue.cc:1048] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:20:53.260396 28640 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:53.267728 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.274578 28594 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:53.281850 28636 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:53.290582 21008 leader_election.cc:336] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.837s (SENT)
W20260709 12:20:53.296229 21008 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Timed out: RequestConsensusVote RPC to 127.18.132.65:39563 timed out after 1.852s (SENT)
I20260709 12:20:53.299994 28421 consensus_queue.cc:1059] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:20:53.300494 20325 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:20:53.305685 28636 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:53.308144 20144 leader_election.cc:400] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 28. Current term is 30.
I20260709 12:20:53.311065 20144 leader_election.cc:403] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:53.316450 28594 raft_consensus.cc:3060] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Advancing to term 30
W20260709 12:20:53.323797 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.334177 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:53.330991 28616 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:53.385944 20248 raft_consensus.cc:1240] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:53.387866 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:53.388195 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674ae039bae9486b8fa77a2493757981" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.389587 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:53.397709 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5dfa3335ec44bcb98beeec64591f01" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:20:53.402384 21041 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 26. Current term is 27. Ops: []
W20260709 12:20:53.404650 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.407825 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.408823 20220 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.408543 20251 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 18.
I20260709 12:20:53.409467 20220 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:53.409145 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.411193 21008 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.411684 21008 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.412434 28595 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:20:53.413024 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.412258 28216 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:53.413523 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.403329 28421 consensus_queue.cc:1243] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:20:53.414820 28595 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:53.416479 28636 raft_consensus.cc:3055] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:53.416877 28636 raft_consensus.cc:740] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
W20260709 12:20:53.416994 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.417434 21008 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.417793 28636 consensus_queue.cc:260] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:53.418706 21008 leader_election.cc:336] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.418959 28636 raft_consensus.cc:3060] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:53.419664 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.408108 28594 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 30 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217) with higher term. Message: Invalid argument: T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 for earlier term 28. Current term is 30.
W20260709 12:20:53.420871 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.421031 28595 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:53.421433 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.420887 28421 raft_consensus.cc:493] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:53.422403 28421 raft_consensus.cc:515] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:53.423467 20220 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.423980 28595 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:53.424944 20220 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.425586 28421 leader_election.cc:290] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:53.429244 20220 leader_election.cc:336] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.429662 20220 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.430358 28216 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.434541 20144 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:53.435448 28594 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:53.438035 20144 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:53.441617 20220 leader_election.cc:336] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.442303 20220 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.443578 28640 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:53.444938 20220 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.445339 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:53.454209 20220 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.456373 20220 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.456413 28640 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:53.460484 28640 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:20:53.462045 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.463436 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.463964 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.464732 28571 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:20:53.466414 20220 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:53.467396 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.467947 20220 leader_election.cc:336] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.468312 20220 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.469133 28665 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.470324 28665 consensus_queue.cc:1059] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:53.474139 28665 consensus_queue.cc:1059] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:53.475023 28594 raft_consensus.cc:3055] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:53.475419 28594 raft_consensus.cc:740] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:53.476354 28594 consensus_queue.cc:260] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:53.478318 28640 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.480067 28421 consensus_queue.cc:1059] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:53.483451 28594 raft_consensus.cc:3060] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:53.485801 18961 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 20205)
I20260709 12:20:53.488137 20294 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:53.489699 28629 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:53.490214 28629 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:53.491202 28629 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:53.494768 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.500463 28670 consensus_queue.cc:1059] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:53.500768 20144 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.510459 20327 raft_consensus.cc:1275] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:20:53.512082 28571 consensus_queue.cc:1048] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:53.517817 20144 leader_election.cc:304] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.532385 28670 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:53.533104 28670 raft_consensus.cc:2749] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:53.538249 28673 raft_consensus.cc:3055] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:53.538718 28673 raft_consensus.cc:740] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:53.539714 28673 consensus_queue.cc:260] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:53.541296 28673 raft_consensus.cc:3060] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:53.557437 28590 raft_consensus.cc:3055] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:20:53.557827 28665 raft_consensus.cc:3055] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:53.557941 28590 raft_consensus.cc:740] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:53.558323 28665 raft_consensus.cc:740] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:53.559222 28665 consensus_queue.cc:260] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:53.580154 28665 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:53.559010 28590 consensus_queue.cc:260] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:53.596338 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 78669.5us
I20260709 12:20:53.601241 20144 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.601846 28672 consensus_queue.cc:1059] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:53.602741 28672 consensus_queue.cc:1243] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [LEADER]: Peer e929b30888874ed59248f1229cecd3c6 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:53.603250 28672 raft_consensus.cc:3055] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:53.603567 28672 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f5c544fad8874e818acaad733a9d14f1, State: Running, Role: LEADER
I20260709 12:20:53.604027 28590 raft_consensus.cc:3060] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:53.606863 21041 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:53.610059 28616 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:53.615948 20144 leader_election.cc:304] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.608520 28672 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:53.618525 28421 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:53.619228 28672 raft_consensus.cc:3060] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:53.621511 28675 raft_consensus.cc:2749] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.629429 20144 leader_election.cc:304] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.632794 28421 raft_consensus.cc:2749] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.634691 20144 leader_election.cc:304] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.644119 28421 raft_consensus.cc:2749] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:53.647905 20328 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:53.650350 20144 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.652418 20144 leader_election.cc:304] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.651314 28421 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.649286 28640 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:53.660490 20077 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55664 (request call id 314) took 2624 ms. Trace:
I20260709 12:20:53.660674 20144 leader_election.cc:304] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.662475 28421 raft_consensus.cc:2749] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:53.663388 28421 raft_consensus.cc:2749] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:53.667239 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.678483 20144 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.660928 20077 rpcz_store.cc:276] 0709 12:20:51.036402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.087625 (+ 51223us) service_pool.cc:224] Handling call
0709 12:20:53.660393 (+2572768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:53.257290 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:53.276326 (+ 19036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:53.276374 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:20:53.276397 (+    23us) tablet.cc:662] Decoding operations
0709 12:20:53.277514 (+  1117us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:53.277608 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:53.277642 (+    34us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:20:53.279209 (+  1567us) tablet.cc:701] Row locks acquired
0709 12:20:53.279235 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:20:53.279417 (+   182us) write_op.cc:270] Start()
0709 12:20:53.279587 (+   170us) write_op.cc:276] Timestamp: P: 1783599653279358 usec, L: 0
0709 12:20:53.279608 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:53.295864 (+ 16256us) log.cc:844] Serialized 3616 byte log entry
0709 12:20:53.354247 (+ 58383us) op_driver.cc:464] REPLICATION: finished
0709 12:20:53.357759 (+  3512us) write_op.cc:301] APPLY: starting
0709 12:20:53.357855 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:53.378888 (+ 21033us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:53.378988 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:53.470819 (+ 91831us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:53.471189 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:20:53.471260 (+    71us) write_op.cc:312] APPLY: finished
0709 12:20:53.471679 (+   419us) log.cc:844] Serialized 89 byte log entry
0709 12:20:53.472753 (+  1074us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:53.501310 (+ 28557us) write_op.cc:454] Released schema lock
0709 12:20:53.501373 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:53.501820 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:53.501856 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35995,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":3265,"apply.run_cpu_time_us":14362,"apply.run_wall_time_us":144013,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37674,"num_ops":9,"prepare.queue_time_us":82505,"prepare.run_cpu_time_us":4889,"prepare.run_wall_time_us":51982,"replication_time_us":74419,"thread_start_us":37236,"threads_started":1}]]}
I20260709 12:20:53.680601 28672 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.691313 21038 raft_consensus.cc:1240] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:53.700812 20325 raft_consensus.cc:1217] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Deduplicated request from leader. Original: 25.17->[26.18-26.18]   Dedup: 26.18->[]
I20260709 12:20:53.701372 20325 raft_consensus.cc:1240] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:20:53.695955 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:53.699800 20327 raft_consensus.cc:1240] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Rejecting Update request from peer f5c544fad8874e818acaad733a9d14f1 for earlier term 21. Current term is 22. Ops: []
W20260709 12:20:53.700098 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.694026 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78812bac55564850a870dc75f26b8b9a" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:53.721683 21008 leader_election.cc:336] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:53.726263 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.727216 21008 leader_election.cc:336] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:53.729700 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.730630 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.731019 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:53.738126 28631 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:53.741848 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.742417 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:53.743263 21008 leader_election.cc:336] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:53.756879 20144 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.757830 28672 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:20:53.765424 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:53.767026 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.773521 20076 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 22 to 24, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 24 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.780805 28156 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.781415 28156 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:53.784824 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:53.785507 20248 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:20:53.786890 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:53.787909 28631 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:53.786118 28156 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:53.788314 28631 raft_consensus.cc:493] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.788807 28631 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:53.789283 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:53.791534 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.797209 28631 raft_consensus.cc:515] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:53.799994 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:53.800311 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dedcb24fca34377b036e86f9764e60b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:53.800658 20248 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:53.801051 20144 leader_election.cc:304] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.801843 28672 raft_consensus.cc:2749] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:53.807281 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.799388 28631 leader_election.cc:290] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:53.815878 20248 raft_consensus.cc:2468] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:20:53.820165 20063 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 94a451623b3d4ba9b27eb7e8b56cb47a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 13
I20260709 12:20:53.824395 21007 leader_election.cc:304] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 85fa447fc35d4f88ab7c85630749ec78
I20260709 12:20:53.825629 28595 raft_consensus.cc:2804] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:53.826159 28595 raft_consensus.cc:697] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:53.827117 28595 consensus_queue.cc:237] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:53.843420 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:53.847820 20074 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 322) took 48298 ms (client timeout 15000 ms). Trace:
W20260709 12:20:53.848424 20074 rpcz_store.cc:269] 0709 12:20:05.541516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.541780 (+   264us) service_pool.cc:224] Handling call
0709 12:20:53.839667 (+48297887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":667397,"reported_tablets":48}
I20260709 12:20:53.854261 28672 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:53.855016 28672 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:53.857368 28672 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:53.862998 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
W20260709 12:20:53.880265 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.882232 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40142d5f54b2446e8c64c73d6fb188fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:53.882339 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.889531 20144 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:53.890435 28672 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:53.905392 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:53.924585 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:53.928910 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:53.940977 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:53.962245 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.977425 20077 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 17 to 18, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 18 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:53.982666 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:53.984344 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:53.985961 20077 catalog_manager.cc:5697] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 19 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 21 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:53.990860 20077 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 21 to 22, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 22 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:53.993124 20077 catalog_manager.cc:5697] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:53.995352 20077 catalog_manager.cc:5697] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 19 to 21, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:53.998159 20076 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 315) took 24299 ms (client timeout 15000 ms). Trace:
I20260709 12:20:53.997206 20077 catalog_manager.cc:5697] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 27 to 30. New cstate: current_term: 30 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.004675 20077 catalog_manager.cc:5697] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 6 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 17 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.009714 20077 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 14 to 15, leader changed from 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 15 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:54.012169 21038 raft_consensus.cc:1240] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Rejecting Update request from peer 85fa447fc35d4f88ab7c85630749ec78 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:54.014595 28625 consensus_queue.cc:1059] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:54.015357 28625 consensus_queue.cc:1243] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Peer 8aef67aa330543a191ab5ab5dc30e84c log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:20:54.016860 28625 raft_consensus.cc:3055] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:54.012228 20077 catalog_manager.cc:5697] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:54.017192 28625 raft_consensus.cc:740] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
W20260709 12:20:54.019707 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:54.024791 20077 catalog_manager.cc:5697] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 25 to 27, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 27 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:54.029230 20077 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:54.030752 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:54.030661 20077 catalog_manager.cc:5697] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 24 to 29, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to e929b30888874ed59248f1229cecd3c6 (127.18.132.66). New cstate: current_term: 29 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } }
I20260709 12:20:54.033452 20077 catalog_manager.cc:5697] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 21, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:54.019150 28625 consensus_queue.cc:260] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:54.035769 28625 raft_consensus.cc:3060] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:53.998673 20076 rpcz_store.cc:269] 0709 12:20:29.698803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.710319 (+ 11516us) service_pool.cc:224] Handling call
0709 12:20:53.998060 (+24287741us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:53.881121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:53.881707 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:53.881748 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:20:53.881773 (+    25us) tablet.cc:662] Decoding operations
0709 12:20:53.882114 (+   341us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:53.882184 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:53.882208 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:53.882396 (+   188us) tablet.cc:701] Row locks acquired
0709 12:20:53.882411 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:20:53.882564 (+   153us) write_op.cc:270] Start()
0709 12:20:53.882673 (+   109us) write_op.cc:276] Timestamp: P: 1783599653882515 usec, L: 0
0709 12:20:53.882692 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:20:53.883393 (+   701us) log.cc:844] Serialized 541 byte log entry
0709 12:20:53.930653 (+ 47260us) op_driver.cc:464] REPLICATION: finished
0709 12:20:53.931025 (+   372us) write_op.cc:301] APPLY: starting
0709 12:20:53.931130 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:53.932008 (+   878us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:53.932098 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:53.932804 (+   706us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:53.932955 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:20:53.932994 (+    39us) write_op.cc:312] APPLY: finished
0709 12:20:53.933182 (+   188us) log.cc:844] Serialized 25 byte log entry
0709 12:20:53.933335 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:53.933413 (+    78us) write_op.cc:454] Released schema lock
0709 12:20:53.933457 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":58229,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":91,"apply.run_cpu_time_us":2771,"apply.run_wall_time_us":2771,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":24733,"prepare.run_cpu_time_us":2717,"prepare.run_wall_time_us":22015,"replication_time_us":47796,"thread_start_us":26973,"threads_started":1}]]}
W20260709 12:20:54.122404 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:54.210867 28502 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.211503 28502 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.213781 28502 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:54.215648 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.216477 20248 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:20:54.218120 20078 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 18 to 20, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to f5c544fad8874e818acaad733a9d14f1 (127.18.132.65). New cstate: current_term: 20 leader_uuid: "f5c544fad8874e818acaad733a9d14f1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:54.220042 20295 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:54.221395 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: 
I20260709 12:20:54.222246 28502 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:54.222613 28502 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.222918 28502 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:54.231971 20078 catalog_manager.cc:5697] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:54.241106 28502 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.245800 28502 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:54.253769 28672 raft_consensus.cc:493] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.254455 28672 raft_consensus.cc:515] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.256757 28672 leader_election.cc:290] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.260802 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.261545 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:54.262508 20248 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:54.269552 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc39a197f2d41e4bc3e1f92594e8baa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.293946 20144 leader_election.cc:304] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.295749 28672 raft_consensus.cc:2749] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:54.297993 28672 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:54.298611 28672 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:20:54.321306 20295 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:54.322521 20295 leader_election.cc:336] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:54.301010 28672 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.344569 28672 raft_consensus.cc:493] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.346491 28672 raft_consensus.cc:515] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.348949 28672 leader_election.cc:290] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.360407 20073 catalog_manager.cc:5697] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.364213 20078 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55652 (request call id 316) took 3560 ms. Trace:
I20260709 12:20:54.365350 20078 rpcz_store.cc:276] 0709 12:20:50.804260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.804522 (+   262us) service_pool.cc:224] Handling call
0709 12:20:54.364141 (+3559619us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:54.270171 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:54.270784 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:54.270839 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:20:54.270853 (+    14us) tablet.cc:662] Decoding operations
0709 12:20:54.271446 (+   593us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:54.271537 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:54.271590 (+    53us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:54.272144 (+   554us) tablet.cc:701] Row locks acquired
0709 12:20:54.272170 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:20:54.272329 (+   159us) write_op.cc:270] Start()
0709 12:20:54.272455 (+   126us) write_op.cc:276] Timestamp: P: 1783599654272277 usec, L: 0
0709 12:20:54.272472 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:20:54.273146 (+   674us) log.cc:844] Serialized 919 byte log entry
0709 12:20:54.275953 (+  2807us) op_driver.cc:464] REPLICATION: finished
0709 12:20:54.276811 (+   858us) write_op.cc:301] APPLY: starting
0709 12:20:54.276907 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:54.278351 (+  1444us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:54.278449 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:54.283819 (+  5370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:54.284019 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:20:54.284073 (+    54us) write_op.cc:312] APPLY: finished
0709 12:20:54.284303 (+   230us) log.cc:844] Serialized 33 byte log entry
0709 12:20:54.284489 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.284588 (+    99us) write_op.cc:454] Released schema lock
0709 12:20:54.284635 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:54.285074 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.285106 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1663,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":637,"apply.run_cpu_time_us":4409,"apply.run_wall_time_us":8223,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8372,"num_ops":2,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":3261,"prepare.run_wall_time_us":3260,"replication_time_us":3344}]]}
I20260709 12:20:54.368808 28672 raft_consensus.cc:493] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.370033 28672 raft_consensus.cc:515] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.373147 20248 raft_consensus.cc:2468] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
I20260709 12:20:54.378293 28672 leader_election.cc:290] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.382157 20294 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:54.383790 28502 raft_consensus.cc:2804] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:20:54.384377 28502 raft_consensus.cc:697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:54.385506 28502 consensus_queue.cc:237] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.390043 28683 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.390666 20328 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:20:54.391408 20328 pending_rounds.cc:85] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Aborting all ops after (but not including) 12
I20260709 12:20:54.391713 20328 pending_rounds.cc:107] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:20:54.392071 20328 raft_consensus.cc:2889] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:54.395028 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:54.396560 28156 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:54.397483 18961 tablet_replica.cc:333] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.398834 18961 raft_consensus.cc:2243] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:54.385906 20144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 92056.7us
I20260709 12:20:54.409320 20249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.410688 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.410759 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.414638 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.415243 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d6b71b9e74e4e84fa04048ad9b6f4" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.415738 20325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68043269e84d00b62b03a362170cc8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.421741 18961 raft_consensus.cc:2272] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.428210 18961 tablet_replica.cc:333] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.430331 18961 raft_consensus.cc:2243] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.431193 18961 pending_rounds.cc:70] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Trying to abort 1 pending ops.
I20260709 12:20:54.431464 18961 pending_rounds.cc:77] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1: Aborting op as it isn't in flight: id { term: 24 index: 18 } timestamp: 7305624154407702528 op_type: NO_OP noop_request { }
I20260709 12:20:54.433073 18961 raft_consensus.cc:2889] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:54.433449 18961 raft_consensus.cc:2272] T dda77defaf824b5c9cc9505346d7080c P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.424896 28672 raft_consensus.cc:493] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.440688 28672 raft_consensus.cc:515] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.443138 28672 leader_election.cc:290] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.443321 20256 raft_consensus.cc:1275] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:54.390635 28683 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.449846 28683 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.454022 28595 consensus_queue.cc:1048] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:20:54.456641 20256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.469143 20144 leader_election.cc:304] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.469702 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.469848 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de701338877c4a78b14dec4df55119c2" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.470417 20144 leader_election.cc:304] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.471426 18961 tablet_replica.cc:333] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.471796 20144 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.472594 18961 raft_consensus.cc:2243] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.473044 28683 raft_consensus.cc:493] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.473486 18961 raft_consensus.cc:2272] T 6c5dfa3335ec44bcb98beeec64591f01 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.473618 28683 raft_consensus.cc:515] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.476073 28683 leader_election.cc:290] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.476643 28683 raft_consensus.cc:2749] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:54.477468 28683 raft_consensus.cc:2749] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:54.478169 28683 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:54.473663 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "463ac757068e4382abd72beef4bbf682" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.499153 28683 raft_consensus.cc:493] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.499859 28683 raft_consensus.cc:515] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.502724 28683 leader_election.cc:290] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.523627 18961 tablet_replica.cc:333] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.524855 18961 raft_consensus.cc:2243] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.525807 18961 raft_consensus.cc:2272] T 8bc39a197f2d41e4bc3e1f92594e8baa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.527082 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.529592 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2f9bd02105458eb0ee8e4142956948" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.530923 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.533169 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64230d63b49741d69bace479cb6508f1" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.533512 20078 catalog_manager.cc:5697] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 22 to 24, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.536528 20144 leader_election.cc:304] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.544548 20144 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.547969 20075 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55658 (request call id 325) took 1322 ms. Trace:
I20260709 12:20:54.548695 20144 leader_election.cc:304] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.549096 20073 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56956 (request call id 213) took 2865 ms. Trace:
I20260709 12:20:54.546840 28689 raft_consensus.cc:2749] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:54.546062 28683 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:20:54.551780 28672 raft_consensus.cc:2749] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.553031 20144 leader_election.cc:304] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.548485 20075 rpcz_store.cc:276] 0709 12:20:53.223544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.224030 (+   486us) service_pool.cc:224] Handling call
0709 12:20:54.545499 (+1321469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63638,"reported_tablets":22}
I20260709 12:20:54.554379 18961 tablet_replica.cc:333] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.554836 28689 raft_consensus.cc:2749] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:54.550725 20073 rpcz_store.cc:276] 0709 12:20:51.684148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:51.684314 (+   166us) service_pool.cc:224] Handling call
0709 12:20:54.549028 (+2864714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:54.378086 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:54.378717 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:54.378788 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:20:54.378811 (+    23us) tablet.cc:662] Decoding operations
0709 12:20:54.379188 (+   377us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:54.379241 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:54.379261 (+    20us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:20:54.379460 (+   199us) tablet.cc:701] Row locks acquired
0709 12:20:54.379478 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:20:54.379687 (+   209us) write_op.cc:270] Start()
0709 12:20:54.379807 (+   120us) write_op.cc:276] Timestamp: P: 1783599654379622 usec, L: 0
0709 12:20:54.379842 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:20:54.380515 (+   673us) log.cc:844] Serialized 536 byte log entry
0709 12:20:54.382578 (+  2063us) op_driver.cc:464] REPLICATION: finished
0709 12:20:54.383100 (+   522us) write_op.cc:301] APPLY: starting
0709 12:20:54.383188 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:54.388272 (+  5084us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:54.388391 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:54.389253 (+   862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:54.389441 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:20:54.389499 (+    58us) write_op.cc:312] APPLY: finished
0709 12:20:54.389724 (+   225us) log.cc:844] Serialized 25 byte log entry
0709 12:20:54.389928 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.390034 (+   106us) write_op.cc:454] Released schema lock
0709 12:20:54.390084 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:54.390488 (+   404us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:54.390520 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44508,"reported_tablets":25,"spinlock_wait_cycles":78080,"child_traces":[["op",{"apply.queue_time_us":284,"apply.run_cpu_time_us":3316,"apply.run_wall_time_us":7327,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":2746,"prepare.run_wall_time_us":2746,"replication_time_us":2606}]]}
I20260709 12:20:54.567675 18961 raft_consensus.cc:2243] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.581799 28686 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:54.583351 28686 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.585755 28686 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.586248 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.588891 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633082b519c485f8ea5b7f711895275" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.592319 18961 raft_consensus.cc:2272] T 75d963e0e1da434f887fc330570683e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.598136 20144 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.606671 28686 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:54.629241 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 94a451623b3d4ba9b27eb7e8b56cb47a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:20:54.638185 28686 raft_consensus.cc:493] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.638733 28686 raft_consensus.cc:515] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:54.643079 18961 tablet_replica.cc:333] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.649286 18961 raft_consensus.cc:2243] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.650132 18961 raft_consensus.cc:2272] T f979d38c94754ec998f38fd4e97c3ab9 P f5c544fad8874e818acaad733a9d14f1 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.644363 28686 leader_election.cc:290] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:54.645895 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.647128 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cacb9a2627045debeb7e4198ce2bcf7" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:54.596216 20078 catalog_manager.cc:5697] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 18 to 19, leader changed from 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 19 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:54.653437 18961 tablet_replica.cc:333] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.658241 18961 raft_consensus.cc:2243] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.654573 20144 leader_election.cc:304] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:54.665930 28686 raft_consensus.cc:2749] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:54.678278 28686 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.678905 28686 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.690394 28686 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.659380 18961 raft_consensus.cc:2272] T ff822ba5f5ad4f8c87f6018de9072cfb P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.695392 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.701256 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb68e81778549dc97b899388fd918fc" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.701500 28686 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:20:54.702292 28686 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:54.704286 28686 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:54.707355 18961 tablet_replica.cc:333] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.716637 18961 raft_consensus.cc:2243] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.717465 18961 pending_rounds.cc:70] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Trying to abort 1 pending ops.
I20260709 12:20:54.717854 18961 pending_rounds.cc:77] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305624148984279040 op_type: NO_OP noop_request { }
I20260709 12:20:54.723699 18961 raft_consensus.cc:2889] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:54.724146 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:54.722462 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9ab1c5b9f64cf4ac204ed80e9e0035" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.724123 18961 raft_consensus.cc:2272] T 34e43fd47bc14908b8da11134e6fd1d6 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.748018 28686 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.748605 28686 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.750959 28686 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.762928 28686 raft_consensus.cc:493] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:54.763661 28686 raft_consensus.cc:515] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:54.771195 28686 leader_election.cc:290] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:54.778290 18961 tablet_replica.cc:333] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.792325 18961 raft_consensus.cc:2243] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.793282 18961 raft_consensus.cc:2272] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.796741 18961 tablet_replica.cc:333] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.799947 20144 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
W20260709 12:20:54.800848 20144 raft_consensus.cc:2686] T fbb68e81778549dc97b899388fd918fc P f5c544fad8874e818acaad733a9d14f1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:54.803783 18961 raft_consensus.cc:2243] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.804729 18961 raft_consensus.cc:2272] T bd163d5722084caaae2c38bdcf1e7698 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.808101 18961 tablet_replica.cc:333] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
W20260709 12:20:54.808481 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 51398.8us
I20260709 12:20:54.809121 18961 raft_consensus.cc:2243] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.809988 18961 raft_consensus.cc:2272] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.813179 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.815547 20144 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:54.816262 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.819119 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.828329 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2810bc1c814f432184fd2110cf8b6e45" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:54.835722 28686 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:54.840497 18961 tablet_replica.cc:333] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.841579 18961 raft_consensus.cc:2243] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.842267 18961 raft_consensus.cc:2272] T 94a451623b3d4ba9b27eb7e8b56cb47a P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.844846 28686 raft_consensus.cc:493] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:54.846895 20144 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.845417 28686 raft_consensus.cc:515] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:54.849543 28686 leader_election.cc:290] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:54.857522 28689 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:54.859148 20144 leader_election.cc:304] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.865058 28689 raft_consensus.cc:2749] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:54.862138 18961 tablet_replica.cc:333] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.881808 18961 raft_consensus.cc:2243] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.882467 18961 raft_consensus.cc:2272] T 0d378f8e2f934dcc8adcad8d5c71b573 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.892073 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.900893 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a145c5f943d84d5eade056f80c775a0e" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:54.906602 18961 tablet_replica.cc:333] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.915817 18961 raft_consensus.cc:2243] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.916641 18961 raft_consensus.cc:2272] T e8aaa749694d4c0c9f5af38eeb53fe12 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.919819 18961 tablet_replica.cc:333] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.920750 18961 raft_consensus.cc:2243] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.921458 18961 raft_consensus.cc:2272] T fc2f9bd02105458eb0ee8e4142956948 P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:54.926088 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:54.914391 20144 leader_election.cc:304] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:54.931046 28689 raft_consensus.cc:2749] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:54.936282 28686 raft_consensus.cc:493] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8aef67aa330543a191ab5ab5dc30e84c)
I20260709 12:20:54.936944 28686 raft_consensus.cc:515] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:54.939258 28686 leader_election.cc:290] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:54.948933 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.952970 28686 raft_consensus.cc:493] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.953549 28686 raft_consensus.cc:515] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:20:54.953878 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f631101c7754614902057ac50b914e5" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:54.955776 28686 leader_election.cc:290] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:54.959317 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:54.960182 20248 raft_consensus.cc:2393] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5c544fad8874e818acaad733a9d14f1 in current term 24: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
I20260709 12:20:54.962494 20328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8a3c653acbd4849b4107b058ac2f753" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:54.964608 20144 leader_election.cc:304] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.966254 28686 raft_consensus.cc:2749] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:54.968072 18961 tablet_replica.cc:333] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:54.969127 18961 raft_consensus.cc:2243] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.969969 18961 raft_consensus.cc:2272] T 766b995bcec04c62a05a9d91c572f494 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.973860 20144 leader_election.cc:304] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:54.974643 28689 raft_consensus.cc:3060] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:54.975757 20248 raft_consensus.cc:1275] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:20:54.979470 28695 consensus_queue.cc:1048] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:54.984534 28689 raft_consensus.cc:2749] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:55.008867 18961 tablet_replica.cc:333] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.012518 18961 raft_consensus.cc:2243] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.013206 18961 raft_consensus.cc:2272] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.015636 18961 tablet_replica.cc:333] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
W20260709 12:20:55.022557 20220 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.016518 18961 raft_consensus.cc:2243] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.027381 18961 raft_consensus.cc:2272] T 674ae039bae9486b8fa77a2493757981 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.027899 28686 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:20:55.028504 28686 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:55.030750 28686 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:55.034341 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:55.035750 20251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddbf42869844c6f9ae72ceaefc93ea8" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:55.038112 20144 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:20:55.039942 28686 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:55.053908 18961 tablet_replica.cc:333] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.066366 18961 raft_consensus.cc:2243] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.067065 18961 raft_consensus.cc:2272] T e9c1aa13628842369b17a21768c9a5e5 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.068311 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.090039 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.092622 18961 tablet_replica.cc:333] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.093681 18961 raft_consensus.cc:2243] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.094458 18961 raft_consensus.cc:2272] T 64230d63b49741d69bace479cb6508f1 P f5c544fad8874e818acaad733a9d14f1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.097414 18961 tablet_replica.cc:333] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.098335 18961 raft_consensus.cc:2243] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.098999 18961 raft_consensus.cc:2272] T 78812bac55564850a870dc75f26b8b9a P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.101967 18961 tablet_replica.cc:333] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.102807 18961 raft_consensus.cc:2243] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.103392 18961 raft_consensus.cc:2272] T 8cacb9a2627045debeb7e4198ce2bcf7 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.106292 18961 tablet_replica.cc:333] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.107054 18961 raft_consensus.cc:2243] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.107547 18961 raft_consensus.cc:2272] T 937144b407c548958468c2b27f8cd054 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.109362 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.110415 18961 tablet_replica.cc:333] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.128127 18961 raft_consensus.cc:2243] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.128826 18961 raft_consensus.cc:2272] T 5260534c5dcb4fe0a840162b4eb6d460 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.131893 18961 tablet_replica.cc:333] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.132812 18961 raft_consensus.cc:2243] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.133502 18961 raft_consensus.cc:2272] T 02f2bc2263db420a815ba46efc7bf818 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.152596 18961 tablet_replica.cc:333] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.156155 18961 raft_consensus.cc:2243] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.156842 18961 raft_consensus.cc:2272] T bddbf42869844c6f9ae72ceaefc93ea8 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.160552 18961 tablet_replica.cc:333] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.161388 18961 raft_consensus.cc:2243] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.162081 18961 raft_consensus.cc:2272] T 094b66f474ed4806afc377722fa74020 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.168756 18961 tablet_replica.cc:333] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.169552 18961 raft_consensus.cc:2243] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.170173 18961 raft_consensus.cc:2272] T 7d79a5dd3e7e46678ffc3ddc6af43051 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.174036 18961 tablet_replica.cc:333] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.180557 18961 raft_consensus.cc:2243] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.195976 18961 raft_consensus.cc:2272] T 2810bc1c814f432184fd2110cf8b6e45 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.200717 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.203589 18961 tablet_replica.cc:333] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.204589 18961 raft_consensus.cc:2243] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.205210 18961 raft_consensus.cc:2272] T 9f631101c7754614902057ac50b914e5 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.208250 18961 tablet_replica.cc:333] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.209084 18961 raft_consensus.cc:2243] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.209817 18961 raft_consensus.cc:2272] T a633082b519c485f8ea5b7f711895275 P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.219835 28686 raft_consensus.cc:493] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.220340 28686 raft_consensus.cc:515] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:55.222497 28686 leader_election.cc:290] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:55.225998 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:55.230595 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56046fd4231240119a75348ab3fc48d3" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:55.232823 18961 tablet_replica.cc:333] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.233227 20144 leader_election.cc:304] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:55.233837 18961 raft_consensus.cc:2243] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.234721 18961 pending_rounds.cc:70] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Trying to abort 2 pending ops.
I20260709 12:20:55.234997 18961 pending_rounds.cc:77] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting op as it isn't in flight: id { term: 28 index: 17 } timestamp: 7305624164201156608 op_type: NO_OP noop_request { }
I20260709 12:20:55.235368 18961 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:55.235680 18961 pending_rounds.cc:77] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305624068282736640 op_type: NO_OP noop_request { }
I20260709 12:20:55.235931 28686 raft_consensus.cc:2749] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:20:55.236029 18961 raft_consensus.cc:2889] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:55.251863 18961 raft_consensus.cc:2272] T 463ac757068e4382abd72beef4bbf682 P f5c544fad8874e818acaad733a9d14f1 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.256296 18961 tablet_replica.cc:333] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.257304 18961 raft_consensus.cc:2243] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:55.260079 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.261969 18961 raft_consensus.cc:2272] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P f5c544fad8874e818acaad733a9d14f1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.275835 18961 tablet_replica.cc:333] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.280599 18961 raft_consensus.cc:2243] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.281704 18961 raft_consensus.cc:2272] T 0cfc71bca12d482b9f153b0596eba41f P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.284451 18961 tablet_replica.cc:333] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.285344 18961 raft_consensus.cc:2243] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.286197 18961 raft_consensus.cc:2272] T de68043269e84d00b62b03a362170cc8 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.289243 18961 tablet_replica.cc:333] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.290110 18961 raft_consensus.cc:2243] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.290721 18961 raft_consensus.cc:2272] T 56046fd4231240119a75348ab3fc48d3 P f5c544fad8874e818acaad733a9d14f1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.294574 18961 tablet_replica.cc:333] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.294957 28686 raft_consensus.cc:493] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.295414 18961 raft_consensus.cc:2243] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.295524 28686 raft_consensus.cc:515] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:55.296218 18961 raft_consensus.cc:2272] T a145c5f943d84d5eade056f80c775a0e P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.297925 28686 leader_election.cc:290] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:55.299237 18961 tablet_replica.cc:333] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.300114 18961 raft_consensus.cc:2243] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.301393 18961 raft_consensus.cc:2272] T 98e8de971f5342ac94652edf51dd27ef P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.304337 18961 tablet_replica.cc:333] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.305054 18961 raft_consensus.cc:2243] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.305634 18961 raft_consensus.cc:2272] T de701338877c4a78b14dec4df55119c2 P f5c544fad8874e818acaad733a9d14f1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.311874 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:55.313141 21041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0621ca652d416d9284323ec7eb2363" candidate_uuid: "f5c544fad8874e818acaad733a9d14f1" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:55.315485 18961 tablet_replica.cc:333] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.316390 18961 raft_consensus.cc:2243] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.317101 18961 raft_consensus.cc:2272] T 94d92f1167e6425dbdcc7276bd1de9b7 P f5c544fad8874e818acaad733a9d14f1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.321754 18961 tablet_replica.cc:333] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.322561 18961 raft_consensus.cc:2243] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.323424 18961 pending_rounds.cc:70] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Trying to abort 1 pending ops.
I20260709 12:20:55.323697 18961 pending_rounds.cc:77] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: Aborting op as it isn't in flight: id { term: 20 index: 18 } timestamp: 7305624156218449920 op_type: NO_OP noop_request { }
I20260709 12:20:55.324051 18961 raft_consensus.cc:2889] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:55.324388 18961 raft_consensus.cc:2272] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.328104 18961 tablet_replica.cc:333] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.328011 20144 leader_election.cc:304] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5c544fad8874e818acaad733a9d14f1; no voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:55.337810 20144 raft_consensus.cc:2686] T ae0621ca652d416d9284323ec7eb2363 P f5c544fad8874e818acaad733a9d14f1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:55.338012 18961 raft_consensus.cc:2243] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.338847 18961 pending_rounds.cc:70] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Trying to abort 1 pending ops.
I20260709 12:20:55.339090 18961 pending_rounds.cc:77] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1: Aborting op as it isn't in flight: id { term: 24 index: 17 } timestamp: 7305624153298432000 op_type: NO_OP noop_request { }
W20260709 12:20:55.339303 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.339423 18961 raft_consensus.cc:2889] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:55.340186 18961 raft_consensus.cc:2272] T 599fe0ac57224f249385f1d6243cb41a P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.342976 18961 tablet_replica.cc:333] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.343827 18961 raft_consensus.cc:2243] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.344967 18961 raft_consensus.cc:2272] T fc3c17581b364b2292ad25402ab6bf57 P f5c544fad8874e818acaad733a9d14f1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.349015 18961 tablet_replica.cc:333] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.349953 18961 raft_consensus.cc:2243] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.351048 18961 raft_consensus.cc:2272] T 5844fde759d84503859902ab6bf69cdc P f5c544fad8874e818acaad733a9d14f1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.356675 18961 tablet_replica.cc:333] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.357570 18961 raft_consensus.cc:2243] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.358060 18961 raft_consensus.cc:2272] T 3fe31035391b450ebd3c369e9917f7aa P f5c544fad8874e818acaad733a9d14f1 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.359208 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.361841 18961 tablet_replica.cc:333] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.362715 18961 raft_consensus.cc:2243] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.363334 18961 raft_consensus.cc:2272] T e89e7906a9724d15951ec300ab3095b6 P f5c544fad8874e818acaad733a9d14f1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.366492 18961 tablet_replica.cc:333] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.367188 18961 raft_consensus.cc:2243] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.367926 18961 raft_consensus.cc:2272] T 40142d5f54b2446e8c64c73d6fb188fc P f5c544fad8874e818acaad733a9d14f1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.370702 18961 tablet_replica.cc:333] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1: stopping tablet replica
I20260709 12:20:55.371511 18961 raft_consensus.cc:2243] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.372054 18961 raft_consensus.cc:2272] T d8a3c653acbd4849b4107b058ac2f753 P f5c544fad8874e818acaad733a9d14f1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.372428 20328 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:55.406059 20251 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:20:55.406296 20294 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd163d5722084caaae2c38bdcf1e7698. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.408721 28502 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:20:55.414088 20295 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.421758 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.446674 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.470664 28695 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:20:55.472489 20248 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:20:55.496663 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.497351 20327 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:55.504792 20075 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 14, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:20:55.529408 20248 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:55.532280 28502 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:55.537760 20294 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbb68e81778549dc97b899388fd918fc. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.550733 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.587829 28502 raft_consensus.cc:2955] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:20:55.601150 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.607321 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.651832 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.718027 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.719146 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.733173 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.737227 20248 raft_consensus.cc:2955] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:20:55.749619 20073 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 10, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.760011 20251 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:20:55.788084 20219 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fe31035391b450ebd3c369e9917f7aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.789302 20328 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:20:55.790999 28573 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:55.826478 28702 raft_consensus.cc:2955] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:20:55.830976 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 94a451623b3d4ba9b27eb7e8b56cb47a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:20:55.843168 20328 raft_consensus.cc:2955] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
W20260709 12:20:55.845468 21008 connection.cc:573] client connection to 127.18.132.65:39563 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:20:55.868324 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.869127 20220 connection.cc:769] client connection to 127.18.132.65:39563 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 12:20:55.876329 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: sendmsg error: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.890429 20075 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index -1 to 15, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 22 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:20:55.930780 28716 ts_tablet_manager.cc:933] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:55.931205 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:55.961980 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:55.963603 28716 tablet_copy_client.cc:323] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:20:55.973101 20248 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
W20260709 12:20:55.981995 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:55.995169 20340 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet bd163d5722084caaae2c38bdcf1e7698 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:20:55.996100 20340 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet bd163d5722084caaae2c38bdcf1e7698 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-bd163d5722084caaae2c38bdcf1e7698
I20260709 12:20:56.004199 28721 ts_tablet_manager.cc:933] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:20:56.013873 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.038226 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:56.058035 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:56.072155 20327 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:20:56.072438 20220 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:56.075635 20219 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 -> Peer 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217): Couldn't send request to peer 8aef67aa330543a191ab5ab5dc30e84c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9c1aa13628842369b17a21768c9a5e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.083274 28724 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:56.083967 20340 tablet_copy_source_session.cc:215] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:56.085733 28721 tablet_copy_client.cc:323] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.67:46619
I20260709 12:20:56.087973 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd163d5722084caaae2c38bdcf1e7698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:56.090452 20339 tablet_copy_service.cc:140] P 85fa447fc35d4f88ab7c85630749ec78: Received BeginTabletCopySession request for tablet fbb68e81778549dc97b899388fd918fc from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:43354)
I20260709 12:20:56.091158 20339 tablet_copy_service.cc:161] P 85fa447fc35d4f88ab7c85630749ec78: Beginning new tablet copy session on tablet fbb68e81778549dc97b899388fd918fc from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:43354: session id = 8aef67aa330543a191ab5ab5dc30e84c-fbb68e81778549dc97b899388fd918fc
I20260709 12:20:56.109006 28716 tablet_copy_client.cc:806] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:56.109867 28716 tablet_copy_client.cc:670] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
I20260709 12:20:56.118292 20339 tablet_copy_source_session.cc:215] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:56.120536 28716 tablet_copy_client.cc:538] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:56.136988 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb68e81778549dc97b899388fd918fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:56.141779 28702 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:20:56.148824 20327 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } } }
I20260709 12:20:56.154232 28716 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:20:56.188025 20075 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index -1 to 11, NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) added. New cstate: current_term: 17 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:56.190428 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.264987 28721 tablet_copy_client.cc:806] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:56.265650 28721 tablet_copy_client.cc:670] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:56.290804 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.291592 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.292102 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.299000 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:56.313045 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.401428 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.408265 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.410000 28721 tablet_copy_client.cc:538] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:56.416319 28727 ts_tablet_manager.cc:933] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:56.417544 28571 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.418170 28571 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.420544 28571 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:56.422185 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:20:56.427958 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:56.430152 28721 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
W20260709 12:20:56.444671 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.445076 28727 tablet_copy_client.cc:323] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:20:56.445225 21008 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:56.446022 28571 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:56.453205 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet 3fe31035391b450ebd3c369e9917f7aa from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:20:56.453835 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet 3fe31035391b450ebd3c369e9917f7aa from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-3fe31035391b450ebd3c369e9917f7aa
I20260709 12:20:56.464676 20266 tablet_copy_source_session.cc:215] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:20:56.467785 28695 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.488480 28695 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.491089 28695 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:56.493230 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:56.494053 21038 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 20.
I20260709 12:20:56.495555 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:56.497035 28729 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:56.497462 28729 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
W20260709 12:20:56.497679 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.500921 28727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe31035391b450ebd3c369e9917f7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:56.497846 28729 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:56.526839 28729 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.526819 28716 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:56.537026 28716 tablet_bootstrap.cc:492] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:20:56.537899 28716 ts_tablet_manager.cc:1403] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.384s	user 0.058s	sys 0.006s
W20260709 12:20:56.538203 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:56.538827 20295 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.541559 28732 ts_tablet_manager.cc:933] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: Initiating tablet copy from peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:56.542779 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfc71bca12d482b9f153b0596eba41f" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
W20260709 12:20:56.550163 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.550470 21034 raft_consensus.cc:3060] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:56.550470 28640 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.555675 28640 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.558007 28640 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:56.559470 21038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "e929b30888874ed59248f1229cecd3c6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:20:56.563210 20220 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.563653 20220 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e929b30888874ed59248f1229cecd3c6; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:56.564769 28640 raft_consensus.cc:2749] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:56.570228 21034 raft_consensus.cc:2468] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 21.
I20260709 12:20:56.545025 28716 raft_consensus.cc:359] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:56.548235 28729 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:56.571609 20294 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:20:56.572472 28729 raft_consensus.cc:2804] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:56.572993 28729 raft_consensus.cc:697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:20:56.573916 28729 consensus_queue.cc:237] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:56.583544 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.572077 28716 raft_consensus.cc:740] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:20:56.584614 28571 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.586603 28727 tablet_copy_client.cc:806] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
W20260709 12:20:56.606317 20295 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.608748 28571 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.611253 28732 tablet_copy_client.cc:323] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Beginning tablet copy session from remote peer at address 127.18.132.66:37765
I20260709 12:20:56.613302 28571 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:20:56.618513 20266 tablet_copy_service.cc:140] P e929b30888874ed59248f1229cecd3c6: Received BeginTabletCopySession request for tablet e9c1aa13628842369b17a21768c9a5e5 from peer 8aef67aa330543a191ab5ab5dc30e84c ({username='slave'} at 127.0.0.1:40218)
I20260709 12:20:56.618898 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6" is_pre_election: true
I20260709 12:20:56.619099 20266 tablet_copy_service.cc:161] P e929b30888874ed59248f1229cecd3c6: Beginning new tablet copy session on tablet e9c1aa13628842369b17a21768c9a5e5 from peer 8aef67aa330543a191ab5ab5dc30e84c at {username='slave'} at 127.0.0.1:40218: session id = 8aef67aa330543a191ab5ab5dc30e84c-e9c1aa13628842369b17a21768c9a5e5
I20260709 12:20:56.619679 20248 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 20.
I20260709 12:20:56.620777 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: 
W20260709 12:20:56.621011 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.610251 28727 tablet_copy_client.cc:670] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:56.632786 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.623247 28571 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:56.639663 28571 raft_consensus.cc:493] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.640115 28571 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:56.628427 20073 catalog_manager.cc:5697] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 20 to 21, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 21 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.646482 28695 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.647143 28695 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.649456 28695 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:20:56.650426 20266 tablet_copy_source_session.cc:215] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:20:56.673409 20295 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.675758 28716 consensus_queue.cc:260] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:56.679771 28727 tablet_copy_client.cc:538] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:56.697621 28716 ts_tablet_manager.cc:1434] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.008s
I20260709 12:20:56.662559 21034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:20:56.715701 28694 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.716430 28694 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.717480 20339 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-bd163d5722084caaae2c38bdcf1e7698 received from {username='slave'} at 127.0.0.1:43354
I20260709 12:20:56.718104 20339 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-bd163d5722084caaae2c38bdcf1e7698 on tablet bd163d5722084caaae2c38bdcf1e7698 with peer 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:56.718561 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44459.4us
I20260709 12:20:56.718990 28694 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:56.720847 20294 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:56.723374 28728 raft_consensus.cc:2749] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:56.727900 21008 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:20:56.736006 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.751760 28721 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:56.752897 28721 tablet_bootstrap.cc:492] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:20:56.753707 28721 ts_tablet_manager.cc:1403] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.324s	user 0.038s	sys 0.006s
I20260709 12:20:56.754400 28732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c1aa13628842369b17a21768c9a5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:56.758260 28571 raft_consensus.cc:515] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:56.764458 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 46490.6us
I20260709 12:20:56.768402 20327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:20:56.769130 20327 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
I20260709 12:20:56.780304 28721 raft_consensus.cc:359] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:56.784216 28721 raft_consensus.cc:740] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:20:56.785349 28721 consensus_queue.cc:260] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:56.795061 28721 ts_tablet_manager.cc:1434] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:20:56.805655 28571 leader_election.cc:290] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:20:56.810618 21008 leader_election.cc:336] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.789817 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:56.816722 28736 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:56.817209 28736 raft_consensus.cc:493] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5c544fad8874e818acaad733a9d14f1)
I20260709 12:20:56.817600 28736 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:56.820681 20248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844fde759d84503859902ab6bf69cdc" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e929b30888874ed59248f1229cecd3c6"
I20260709 12:20:56.821491 20248 raft_consensus.cc:3060] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:56.835815 28736 raft_consensus.cc:515] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.848954 28736 leader_election.cc:290] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:20:56.839197 20248 raft_consensus.cc:2468] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 21.
I20260709 12:20:56.842300 20339 tablet_copy_service.cc:342] P 85fa447fc35d4f88ab7c85630749ec78: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-fbb68e81778549dc97b899388fd918fc received from {username='slave'} at 127.0.0.1:43354
I20260709 12:20:56.850638 20339 tablet_copy_service.cc:434] P 85fa447fc35d4f88ab7c85630749ec78: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-fbb68e81778549dc97b899388fd918fc on tablet fbb68e81778549dc97b899388fd918fc with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:56.850569 21007 leader_election.cc:304] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6; no voters: f5c544fad8874e818acaad733a9d14f1
W20260709 12:20:56.845278 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:56.838292 28727 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:20:56.850019 20329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3c17581b364b2292ad25402ab6bf57" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:20:56.853425 20329 raft_consensus.cc:3060] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:56.855597 28737 raft_consensus.cc:2804] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:56.856232 28737 raft_consensus.cc:697] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:56.857191 28737 consensus_queue.cc:237] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:56.869460 21008 leader_election.cc:336] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.902173 20073 catalog_manager.cc:5697] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 20 to 21, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 21 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:56.927253 18961 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 20201)
I20260709 12:20:56.938969 20329 raft_consensus.cc:2468] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:20:56.963948 21007 leader_election.cc:304] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: f5c544fad8874e818acaad733a9d14f1
I20260709 12:20:56.964077 28732 tablet_copy_client.cc:806] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 0 data blocks...
I20260709 12:20:56.965564 28595 raft_consensus.cc:2804] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:56.966111 28595 raft_consensus.cc:697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:20:56.967113 28595 consensus_queue.cc:237] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:56.969568 28732 tablet_copy_client.cc:670] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Starting download of 1 WAL segments...
W20260709 12:20:57.001785 20064 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 59890.4us
W20260709 12:20:57.007834 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 94a451623b3d4ba9b27eb7e8b56cb47a: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:56.997583 28732 tablet_copy_client.cc:538] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:20:57.028213 21038 raft_consensus.cc:1217] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEARNER]: Deduplicated request from leader. Original: 24.13->[24.14-24.14]   Dedup: 24.14->[]
W20260709 12:20:57.079026 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:57.082727 21038 raft_consensus.cc:1275] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:20:57.090066 28729 consensus_queue.cc:1048] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 12:20:57.101806 21041 raft_consensus.cc:1217] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:20:57.109071 20075 catalog_manager.cc:5697] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 16, leader changed from f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 16 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.166564 28732 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap starting.
I20260709 12:20:57.281383 28727 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:57.282467 28727 tablet_bootstrap.cc:492] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:20:57.283339 28727 ts_tablet_manager.cc:1403] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.526s	user 0.063s	sys 0.003s
I20260709 12:20:57.324548 28727 raft_consensus.cc:359] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:57.325443 28727 raft_consensus.cc:740] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:20:57.327370 28727 consensus_queue.cc:260] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:57.351135 20256 raft_consensus.cc:1275] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:20:57.352730 28571 consensus_queue.cc:1048] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:57.357717 28727 ts_tablet_manager.cc:1434] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:20:57.359930 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-3fe31035391b450ebd3c369e9917f7aa received from {username='slave'} at 127.0.0.1:40218
I20260709 12:20:57.360391 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-3fe31035391b450ebd3c369e9917f7aa on tablet 3fe31035391b450ebd3c369e9917f7aa with peer 8aef67aa330543a191ab5ab5dc30e84c
W20260709 12:20:57.378562 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:57.407909 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.416260 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.455854 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:57.495299 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:57.502825 28732 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:57.504043 28732 tablet_bootstrap.cc:492] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: Bootstrap complete.
I20260709 12:20:57.504905 28732 ts_tablet_manager.cc:1403] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent bootstrapping tablet: real 0.339s	user 0.035s	sys 0.013s
I20260709 12:20:57.519001 28732 raft_consensus.cc:359] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:57.519970 28732 raft_consensus.cc:740] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Initialized, Role: LEARNER
I20260709 12:20:57.521206 28732 consensus_queue.cc:260] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: NON_VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: true } }
I20260709 12:20:57.533741 28732 ts_tablet_manager.cc:1434] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:20:57.535646 20266 tablet_copy_service.cc:342] P e929b30888874ed59248f1229cecd3c6: Request end of tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-e9c1aa13628842369b17a21768c9a5e5 received from {username='slave'} at 127.0.0.1:40218
I20260709 12:20:57.536072 20266 tablet_copy_service.cc:434] P e929b30888874ed59248f1229cecd3c6: ending tablet copy session 8aef67aa330543a191ab5ab5dc30e84c-e9c1aa13628842369b17a21768c9a5e5 on tablet e9c1aa13628842369b17a21768c9a5e5 with peer 8aef67aa330543a191ab5ab5dc30e84c
I20260709 12:20:57.585951 20324 raft_consensus.cc:1275] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:20:57.587553 28571 consensus_queue.cc:1048] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:57.613389 28695 raft_consensus.cc:1064] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
W20260709 12:20:57.635721 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:57.624549 28695 consensus_queue.cc:237] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:57.656522 28753 log.cc:927] Time spent T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:20:57.689059 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.710202 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.722494 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.724689 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.731995 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 95770.1us
I20260709 12:20:57.740206 28756 raft_consensus.cc:1064] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:20:57.745831 21041 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:57.743198 28756 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 12, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:57.751523 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:57.752058 28695 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:57.752959 20248 raft_consensus.cc:1275] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:57.759811 28704 consensus_queue.cc:1048] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:57.782428 21038 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEARNER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:20:57.785701 28755 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:57.793171 20256 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:20:57.795511 20295 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:57.798916 28729 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:57.838656 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:57.843838 21041 raft_consensus.cc:1217] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
W20260709 12:20:57.867205 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:57.880239 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:57.886430 28729 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index 14 to 15, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:57.893296 21038 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:57.899181 28704 raft_consensus.cc:2955] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:57.908699 20248 raft_consensus.cc:2955] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:57.927884 18961 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 20201)
I20260709 12:20:57.931939 20075 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 14 to 15, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.937131 21034 raft_consensus.cc:1217] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:20:57.948657 20256 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:57.978377 20078 catalog_manager.cc:5697] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 10 to 11, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:57.987412 21038 raft_consensus.cc:2955] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.033725 20323 consensus_queue.cc:237] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:58.061730 21038 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:20:58.070633 28729 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:58.078579 20248 raft_consensus.cc:1275] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:20:58.080509 28704 consensus_queue.cc:1048] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:58.089182 28755 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:58.097148 21008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111) [suppressed 466 similar messages]
I20260709 12:20:58.116849 21034 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.127599 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd163d5722084caaae2c38bdcf1e7698 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:58.127779 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:58.133464 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.137331 20248 raft_consensus.cc:2955] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.144521 20077 catalog_manager.cc:5697] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: config changed from index 15 to 16, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:58.223974 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:58.266534 20064 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 44396us
W20260709 12:20:58.269212 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:20:58.301386 28770 raft_consensus.cc:1064] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
I20260709 12:20:58.304659 28770 consensus_queue.cc:237] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:58.320030 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:58.329908 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:58.341665 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:58.351006 28573 raft_consensus.cc:1064] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: attempting to promote NON_VOTER 8aef67aa330543a191ab5ab5dc30e84c to VOTER
W20260709 12:20:58.352519 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.353849 28573 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:20:58.377782 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:58.380452 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:58.461629 20323 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:58.464673 28770 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:20:58.473541 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:58.476414 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.480005 21034 raft_consensus.cc:1275] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:58.481989 21038 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 LEARNER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:20:58.487617 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.488183 28770 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:58.487401 28775 consensus_queue.cc:1048] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:58.494228 20324 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:58.495975 28774 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:58.533973 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:58.538075 28744 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:58.540236 20220 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:58.543305 21038 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.549358 28778 raft_consensus.cc:2955] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.551362 21034 raft_consensus.cc:2955] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.577714 20324 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.589033 20323 raft_consensus.cc:2955] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.605949 20078 catalog_manager.cc:5697] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: config changed from index 15 to 16, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.623090 20077 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 11 to 12, 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:58.642307 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.706214 20248 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:20:58.722426 21038 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:58.723950 28778 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:58.733600 20329 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Refusing update from remote peer e929b30888874ed59248f1229cecd3c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:58.740622 28744 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:20:58.743301 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:58.762842 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.764942 28744 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:58.766707 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:58.793763 21034 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
I20260709 12:20:58.803190 20329 raft_consensus.cc:2955] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } } }
W20260709 12:20:58.804322 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:58.833886 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:58.829788 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:58.850924 20063 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9c1aa13628842369b17a21768c9a5e5 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:58.857569 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:58.867543 20075 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 reported cstate change: config changed from index 12 to 13, VOTER f5c544fad8874e818acaad733a9d14f1 (127.18.132.65) evicted. New cstate: current_term: 17 leader_uuid: "e929b30888874ed59248f1229cecd3c6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:58.928417 18961 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 20201)
W20260709 12:20:58.988477 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.003551 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.024163 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.070176 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.135183 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.144644 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.158916 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.176318 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.420401 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:59.421023 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.428378 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:20:59.620136 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:59.663784 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:59.746556 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:59.928988 18961 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 20201)
W20260709 12:20:59.955653 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:00.016532 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.110371 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.115808 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:00.172385 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.186546 20064 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 48282.3us
W20260709 12:21:00.300417 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.324204 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.353128 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.369588 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.487142 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.492237 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.494271 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:00.514842 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.667415 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 65488.1us
W20260709 12:21:00.705291 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.763306 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:00.810459 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:00.833950 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.856487 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.932642 18961 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:00.939857 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.942215 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:00.944989 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:00.947150 20067 maintenance_manager.cc:419] P b336d660a2b34362b3d4d9e44ca2179d: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033399
W20260709 12:21:01.011830 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:01.012477 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:01.079708 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:01.133913 20066 maintenance_manager.cc:643] P b336d660a2b34362b3d4d9e44ca2179d: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.186s	user 0.053s	sys 0.019s Metrics: {"bytes_written":8397,"delete_count":0,"lbm_write_time_us":1221,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":24137,"threads_started":1,"update_count":326,"wal-append.queue_time_us":23928}
I20260709 12:21:01.136484 20067 maintenance_manager.cc:419] P b336d660a2b34362b3d4d9e44ca2179d: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.423811
W20260709 12:21:01.174065 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:01.177910 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.178494 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:01.282871 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.361032 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.430015 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:01.497102 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.503402 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.513217 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.596222 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.596954 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.673386 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 76476.4us
W20260709 12:21:01.723443 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.843600 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.851508 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.851734 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 236921us
W20260709 12:21:01.852355 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.860682 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.882416 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 78956us
W20260709 12:21:01.906461 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:01.933256 18961 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:01.937870 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.097167 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:02.179823 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.181834 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:02.212606 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:02.224454 20066 maintenance_manager.cc:643] P b336d660a2b34362b3d4d9e44ca2179d: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.087s	user 0.147s	sys 0.020s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":30110,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":79294,"dirs.run_cpu_time_us":416,"dirs.run_wall_time_us":8357,"lbm_read_time_us":2244,"lbm_reads_lt_1ms":26,"lbm_write_time_us":21455,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":10,"peak_mem_usage":590376,"reinsert_count":0,"thread_start_us":87348,"threads_started":2,"update_count":356}
I20260709 12:21:02.229410 20067 maintenance_manager.cc:419] P b336d660a2b34362b3d4d9e44ca2179d: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:21:02.230299 20066 maintenance_manager.cc:643] P b336d660a2b34362b3d4d9e44ca2179d: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 12:21:02.309194 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.486636 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:02.599658 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:02.606983 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:02.610349 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.719247 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.725598 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 54605.7us
W20260709 12:21:02.786445 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.829627 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.928095 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.930994 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.933862 18961 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:02.968529 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:02.997865 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.058209 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.082229 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.102175 21008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111) [suppressed 463 similar messages]
W20260709 12:21:03.246062 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:03.345534 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:03.346184 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.359809 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.453166 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.526530 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.529964 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:03.545771 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.560483 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.603098 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.657564 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:03.672920 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.706218 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:03.789557 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:03.794611 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:03.838711 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:03.934379 18961 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:04.018656 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:04.100903 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.163966 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.184039 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.184680 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.237426 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.238294 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.235818 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:04.323859 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.362975 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.472379 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.497416 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.515892 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.624861 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:04.788097 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:04.830757 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:04.856621 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:04.899592 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:04.934950 18961 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:04.971227 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.020674 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:05.106257 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.131017 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.223145 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.293572 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.336678 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.503897 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.587664 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.602810 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.607863 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.641620 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.655531 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:05.872720 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.935479 18961 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:05.942659 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:05.947679 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.018157 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.142375 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.213692 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.218277 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:06.244459 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.262408 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.304910 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.306137 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.323065 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.326435 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.453677 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.509862 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.546797 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.596104 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.685179 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.698550 20220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 49108.4us
W20260709 12:21:06.782953 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.808493 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.822655 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.829975 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:06.845553 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:06.865640 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.936103 18961 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:06.978343 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:06.994216 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.000398 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.066078 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:07.100857 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.455894 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:07.479159 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:07.481802 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.535812 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.545846 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.588080 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.667344 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:07.695458 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.709267 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.733321 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:07.781036 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:07.936682 18961 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:08.111182 20220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111) [suppressed 450 similar messages]
W20260709 12:21:08.139876 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.244633 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.264312 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.337733 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:08.340006 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.377877 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.427444 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.436275 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.449095 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.555855 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.579200 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.588660 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.655834 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.705292 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.759927 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.804059 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.859642 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.876185 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.899144 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.898720 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:08.937446 18961 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:08.939492 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.972576 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:08.978400 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.181150 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.267663 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.276780 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.487352 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.564141 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:09.602154 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:09.634085 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.636615 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:09.648667 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.725819 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.762794 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.811985 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.901944 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:09.913323 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.937980 18961 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:09.937942 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:09.969318 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.107623 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 75697.4us
W20260709 12:21:10.223960 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:10.260674 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.284446 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.410521 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:10.488273 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.678691 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.692708 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:10.710122 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:10.721702 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 96204.6us
W20260709 12:21:10.737391 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:10.759709 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.791895 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.830860 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:10.855285 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:10.881672 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.938714 18961 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:10.942229 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.942852 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:10.958824 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:10.974998 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.088613 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.118088 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.205710 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.216652 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.293712 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.320293 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.361321 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.363307 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.414149 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.535796 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 94a451623b3d4ba9b27eb7e8b56cb47a: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:11.603243 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.654671 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:11.686404 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.837018 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.870728 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:11.939340 18961 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:12.003212 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.045697 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.064266 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.111914 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:12.134822 20219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 80977.5us
W20260709 12:21:12.169188 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.187633 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:12.234865 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.263985 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.382246 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.405571 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:12.428267 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.441743 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.470775 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.492111 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:12.801942 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:12.816485 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.872285 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.899477 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:12.939983 18961 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:12.942943 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:12.976918 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:13.116914 20295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 12:21:13.144152 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:13.205855 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.239778 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.286381 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.333949 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.361424 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.399461 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.468796 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.510039 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.547021 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:13.592340 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:13.610920 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:13.616616 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:13.628599 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:13.842047 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 74789.9us
W20260709 12:21:13.940660 18961 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:14.106830 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.122642 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.146839 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.157781 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.212375 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.223448 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.238814 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.246232 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.267549 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.289062 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.362003 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.480080 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:14.628571 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:14.628826 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.701027 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.718225 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.728667 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.777217 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.855899 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.877624 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.898203 20109 debug-util.cc:398] Leaking SignalData structure 0x7b0800175160 after lost signal to thread 18964
W20260709 12:21:14.899935 20109 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7c80 after lost signal to thread 20112
W20260709 12:21:14.901742 20109 debug-util.cc:398] Leaking SignalData structure 0x7b0800118800 after lost signal to thread 20280
W20260709 12:21:14.905375 20109 debug-util.cc:398] Leaking SignalData structure 0x7b0800318820 after lost signal to thread 20354
W20260709 12:21:14.907095 20109 debug-util.cc:398] Leaking SignalData structure 0x7b080025ae20 after lost signal to thread 21072
W20260709 12:21:14.928025 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.941254 18961 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:14.973423 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:14.982481 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:14.986280 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.054664 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:15.124742 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:15.143895 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.205639 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.254670 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:46619, user_credentials={real_user=slave}} blocked reactor thread for 91278.9us
W20260709 12:21:15.308859 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:15.490274 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 56212.5us
W20260709 12:21:15.501544 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:38217, user_credentials={real_user=slave}} blocked reactor thread for 75889.8us
W20260709 12:21:15.679068 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.686252 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:15.701459 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:15.756467 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.824919 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.856530 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.927999 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:15.941818 18961 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 20201)
W20260709 12:21:16.005448 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.009629 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.035607 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.047384 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.120036 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.122424 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.133486 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.170181 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.175930 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.223549 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.270481 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.345369 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.419458 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:16.457304 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.731328 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:16.739745 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.766918 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.889091 20220 consensus_peers.cc:597] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:16.958287 20220 consensus_peers.cc:597] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:17.009690 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.055766 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.089685 20220 consensus_peers.cc:597] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.104722 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:17.129459 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:17.149845 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:17.244671 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.326519 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.367834 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.375451 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.386439 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:17.449404 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:17.474948 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.506753 20220 consensus_peers.cc:597] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.632167 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.635111 20220 consensus_peers.cc:597] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.722102 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:17.833562 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:17.987465 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:17.994278 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:18.018769 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
W20260709 12:21:18.074432 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:18.147159 20220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111) [suppressed 449 similar messages]
W20260709 12:21:18.266026 20220 consensus_peers.cc:597] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.268332 20220 consensus_peers.cc:597] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:18.318535 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.375329 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:18.408649 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.428349 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.460453 20220 consensus_peers.cc:597] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.488345 20220 consensus_peers.cc:597] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.514403 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:18.544096 20220 consensus_peers.cc:597] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.556969 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.560766 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:18.575924 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
W20260709 12:21:18.593065 20294 consensus_peers.cc:597] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.624528 21007 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.652900 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.666080 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:18.667600 20294 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.674013 20294 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.689110 20294 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.721855 20294 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.725698 20294 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.737628 21007 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.765874 21007 consensus_peers.cc:597] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.777329 21007 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.795377 20294 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.801424 21007 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.804258 20294 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.837220 20220 consensus_peers.cc:597] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:18.838707 21007 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.839612 21007 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.873588 21007 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.883946 20294 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.886085 20294 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.886756 20294 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.886699 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:18.888221 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:21:18.892143 20294 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.892907 18961 tablet_replica.cc:333] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.894194 18961 raft_consensus.cc:2243] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.895308 18961 raft_consensus.cc:2272] T dda77defaf824b5c9cc9505346d7080c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.897253 21007 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.902868 20294 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:18.906164 20294 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.906303 18961 tablet_replica.cc:333] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.907516 18961 raft_consensus.cc:2243] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.908915 18961 raft_consensus.cc:2272] T 6c5dfa3335ec44bcb98beeec64591f01 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.912075 18961 tablet_replica.cc:333] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.913065 18961 raft_consensus.cc:2243] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.913872 18961 raft_consensus.cc:2272] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.917133 18961 tablet_replica.cc:333] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.918072 18961 raft_consensus.cc:2243] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.918825 18961 raft_consensus.cc:2272] T 75d963e0e1da434f887fc330570683e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.921765 18961 tablet_replica.cc:333] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.923373 18961 raft_consensus.cc:2243] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:18.928040 20294 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.924091 18961 raft_consensus.cc:2272] T 1b4b4e64b7f442968c110b5d746e4b14 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.931879 18961 tablet_replica.cc:333] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.932868 18961 raft_consensus.cc:2243] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:18.933636 21007 consensus_peers.cc:597] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.934324 18961 raft_consensus.cc:2272] T bd163d5722084caaae2c38bdcf1e7698 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.938760 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:18.939170 18961 tablet_replica.cc:333] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.941241 18961 raft_consensus.cc:2243] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.942096 18961 raft_consensus.cc:2272] T 8bc39a197f2d41e4bc3e1f92594e8baa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:18.942898 21007 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.945566 18961 tablet_replica.cc:333] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.946720 18961 raft_consensus.cc:2243] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.947474 18961 raft_consensus.cc:2272] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.950721 18961 tablet_replica.cc:333] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.951802 18961 raft_consensus.cc:2243] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.952757 18961 raft_consensus.cc:2272] T 94a451623b3d4ba9b27eb7e8b56cb47a P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.956136 18961 tablet_replica.cc:333] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.957151 18961 raft_consensus.cc:2243] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:18.962275 20294 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.968945 18961 raft_consensus.cc:2272] T 5844fde759d84503859902ab6bf69cdc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.972791 18961 tablet_replica.cc:333] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.973858 18961 raft_consensus.cc:2243] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:21:18.978385 21007 consensus_peers.cc:597] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:18.979411 18961 raft_consensus.cc:2272] T 674ae039bae9486b8fa77a2493757981 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.982699 18961 tablet_replica.cc:333] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.983681 18961 raft_consensus.cc:2243] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:18.984927 18961 raft_consensus.cc:2272] T e9c1aa13628842369b17a21768c9a5e5 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.987954 18961 tablet_replica.cc:333] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.988901 18961 raft_consensus.cc:2243] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.989624 18961 raft_consensus.cc:2272] T 78812bac55564850a870dc75f26b8b9a P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:18.992694 18961 tablet_replica.cc:333] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:18.993868 18961 raft_consensus.cc:2243] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:18.997766 18961 raft_consensus.cc:2272] T e8aaa749694d4c0c9f5af38eeb53fe12 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.002166 18961 tablet_replica.cc:333] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.003085 18961 raft_consensus.cc:2243] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.003892 18961 raft_consensus.cc:2272] T fc2f9bd02105458eb0ee8e4142956948 P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.006862 18961 tablet_replica.cc:333] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.007762 18961 raft_consensus.cc:2243] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.008441 18961 raft_consensus.cc:2272] T 766b995bcec04c62a05a9d91c572f494 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.013275 18961 tablet_replica.cc:333] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.014202 18961 raft_consensus.cc:2243] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.015060 18961 raft_consensus.cc:2272] T 04d32aa1a8cf46979742c1fb0beb8b2c P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:19.022360 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:19.022698 18961 tablet_replica.cc:333] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.024798 18961 raft_consensus.cc:2243] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.025805 18961 raft_consensus.cc:2272] T 64230d63b49741d69bace479cb6508f1 P e929b30888874ed59248f1229cecd3c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.028756 18961 tablet_replica.cc:333] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.029703 18961 raft_consensus.cc:2243] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.031641 18961 raft_consensus.cc:2272] T 937144b407c548958468c2b27f8cd054 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:19.032750 21007 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:19.034441 18961 tablet_replica.cc:333] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.035432 18961 raft_consensus.cc:2243] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.036736 18961 raft_consensus.cc:2272] T 463ac757068e4382abd72beef4bbf682 P e929b30888874ed59248f1229cecd3c6 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.039747 18961 tablet_replica.cc:333] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.040643 18961 raft_consensus.cc:2243] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.042236 18961 raft_consensus.cc:2272] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P e929b30888874ed59248f1229cecd3c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.047461 18961 tablet_replica.cc:333] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.049993 18961 raft_consensus.cc:2243] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.050659 18961 raft_consensus.cc:2272] T 9dedcb24fca34377b036e86f9764e60b P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:19.051914 20294 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:19.055406 18961 tablet_replica.cc:333] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.056401 18961 raft_consensus.cc:2243] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.072024 18961 raft_consensus.cc:2272] T ce44adc86d94477297f0d6521f9cb48b P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.075244 18961 tablet_replica.cc:333] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.076195 18961 raft_consensus.cc:2243] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.078145 18961 raft_consensus.cc:2272] T 5260534c5dcb4fe0a840162b4eb6d460 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.096201 18961 tablet_replica.cc:333] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.109117 18961 raft_consensus.cc:2243] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.109891 18961 raft_consensus.cc:2272] T 2810bc1c814f432184fd2110cf8b6e45 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.113802 18961 tablet_replica.cc:333] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.116281 18961 raft_consensus.cc:2243] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.117197 18961 raft_consensus.cc:2272] T b58bdb95474c4f788fec380b260dc1be P e929b30888874ed59248f1229cecd3c6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.129659 18961 tablet_replica.cc:333] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.130528 18961 raft_consensus.cc:2243] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.131244 18961 raft_consensus.cc:2272] T 9f631101c7754614902057ac50b914e5 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.134123 18961 tablet_replica.cc:333] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.134943 18961 raft_consensus.cc:2243] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.136320 18961 raft_consensus.cc:2272] T a633082b519c485f8ea5b7f711895275 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.139041 18961 tablet_replica.cc:333] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.139909 18961 raft_consensus.cc:2243] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.140911 18961 raft_consensus.cc:2272] T bddbf42869844c6f9ae72ceaefc93ea8 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.143880 18961 tablet_replica.cc:333] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.144742 18961 raft_consensus.cc:2243] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.145433 18961 raft_consensus.cc:2272] T 094b66f474ed4806afc377722fa74020 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:19.145838 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:19.148248 18961 tablet_replica.cc:333] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.149147 18961 raft_consensus.cc:2243] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.149992 18961 raft_consensus.cc:2272] T 7d79a5dd3e7e46678ffc3ddc6af43051 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.152604 18961 tablet_replica.cc:333] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.153577 18961 raft_consensus.cc:2243] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.154676 18961 raft_consensus.cc:2272] T 53fc708954624727a65ab4485d1a2285 P e929b30888874ed59248f1229cecd3c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.157545 18961 tablet_replica.cc:333] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.158391 18961 raft_consensus.cc:2243] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.159646 18961 raft_consensus.cc:2272] T 98e8de971f5342ac94652edf51dd27ef P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.162391 18961 tablet_replica.cc:333] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.163139 18961 raft_consensus.cc:2243] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.163918 18961 raft_consensus.cc:2272] T de701338877c4a78b14dec4df55119c2 P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.166579 18961 tablet_replica.cc:333] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.172381 18961 raft_consensus.cc:2243] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.173583 18961 raft_consensus.cc:2272] T 94d92f1167e6425dbdcc7276bd1de9b7 P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.177079 18961 tablet_replica.cc:333] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
W20260709 12:21:19.182538 21007 consensus_peers.cc:597] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:19.183399 18961 raft_consensus.cc:2243] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.191516 18961 raft_consensus.cc:2272] T bc70b6f5a049439b939f85c3a096fb9d P e929b30888874ed59248f1229cecd3c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.194254 18961 tablet_replica.cc:333] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.195060 18961 raft_consensus.cc:2243] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.195837 18961 raft_consensus.cc:2272] T 99f5ffbc4fe542b3996e60bb26ee1c35 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.208866 18961 tablet_replica.cc:333] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
W20260709 12:21:19.212731 21069 debug-util.cc:398] Leaking SignalData structure 0x7b08003666a0 after lost signal to thread 18964
W20260709 12:21:19.214028 21069 debug-util.cc:398] Leaking SignalData structure 0x7b080036c840 after lost signal to thread 20112
I20260709 12:21:19.212278 18961 raft_consensus.cc:2243] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:19.215497 21069 debug-util.cc:398] Leaking SignalData structure 0x7b080014f360 after lost signal to thread 20280
W20260709 12:21:19.222191 21069 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba140 after lost signal to thread 20354
W20260709 12:21:19.225560 21069 debug-util.cc:398] Leaking SignalData structure 0x7b0800085ee0 after lost signal to thread 21072
I20260709 12:21:19.226974 18961 raft_consensus.cc:2272] T de68043269e84d00b62b03a362170cc8 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.230557 18961 tablet_replica.cc:333] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.231462 18961 raft_consensus.cc:2243] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.232201 18961 raft_consensus.cc:2272] T 812122fe309946b0a0eebf7bc2214d12 P e929b30888874ed59248f1229cecd3c6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.235251 18961 tablet_replica.cc:333] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.236119 18961 raft_consensus.cc:2243] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.236735 18961 raft_consensus.cc:2272] T 6ebc8da2a63b4daeb972508fd248a6f2 P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.239607 18961 tablet_replica.cc:333] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.240518 18961 raft_consensus.cc:2243] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.241703 18961 raft_consensus.cc:2272] T 40142d5f54b2446e8c64c73d6fb188fc P e929b30888874ed59248f1229cecd3c6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.244728 18961 tablet_replica.cc:333] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.246776 18961 raft_consensus.cc:2243] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.254346 18961 raft_consensus.cc:2272] T fbb68e81778549dc97b899388fd918fc P e929b30888874ed59248f1229cecd3c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.257438 18961 tablet_replica.cc:333] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.258311 18961 raft_consensus.cc:2243] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.259301 18961 raft_consensus.cc:2272] T 02f2bc2263db420a815ba46efc7bf818 P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.262068 18961 tablet_replica.cc:333] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.262828 18961 raft_consensus.cc:2243] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.263440 18961 raft_consensus.cc:2272] T d8a3c653acbd4849b4107b058ac2f753 P e929b30888874ed59248f1229cecd3c6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.267884 18961 tablet_replica.cc:333] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.268734 18961 raft_consensus.cc:2243] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:19.270670 18961 raft_consensus.cc:2272] T 3fe31035391b450ebd3c369e9917f7aa P e929b30888874ed59248f1229cecd3c6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.273834 18961 tablet_replica.cc:333] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.274578 18961 raft_consensus.cc:2243] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 23 LEADER]: Raft consensus shutting down.
W20260709 12:21:19.276310 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:19.278668 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:19.289927 18961 raft_consensus.cc:2272] T 8271323bedc7421a87f787fc100b6efe P e929b30888874ed59248f1229cecd3c6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:19.299206 18961 tablet_replica.cc:333] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6: stopping tablet replica
I20260709 12:21:19.300060 18961 raft_consensus.cc:2243] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:19.301450 18961 raft_consensus.cc:2272] T e89e7906a9724d15951ec300ab3095b6 P e929b30888874ed59248f1229cecd3c6 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:19.430910 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:19.559948 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 104048us
W20260709 12:21:19.562170 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:19.562909 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:19.587392 20294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 76768us
W20260709 12:21:19.586781 20295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39563, user_credentials={real_user=slave}} blocked reactor thread for 67384.5us
W20260709 12:21:19.627914 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:19.662184 20294 connection.cc:573] client connection to 127.18.132.66:37765 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:21:19.665364 20295 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:19.670910 20295 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:19.710412 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:19.888777 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:19.907545 20295 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:19.941588 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:19.944967 20295 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:20.012048 20295 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:20.063989 28891 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.064695 28891 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:20.073602 20294 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.077379 28891 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:21:20.079370 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:21:20.081864 20294 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.084010 28897 raft_consensus.cc:2749] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:20.150251 20295 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:20.162351 28895 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.163057 28895 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.165354 28895 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:20.163049 28897 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.166383 28897 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.168665 28897 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:21:20.171852 21007 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.174129 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:21:20.179720 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.182755 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.181599 28895 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.184474 28895 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.185407 28879 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:21:20.186980 28895 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:20.188825 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
W20260709 12:21:20.189409 20294 leader_election.cc:336] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.189517 20323 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 17.
W20260709 12:21:20.195129 21007 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.196156 20294 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.197335 28897 raft_consensus.cc:2749] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:20.197914 21007 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.203842 28895 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:20.204232 28895 raft_consensus.cc:493] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.204593 28895 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:20.216698 28895 raft_consensus.cc:515] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:20.249428 21007 leader_election.cc:336] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.250083 28895 leader_election.cc:290] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:20.254623 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c1aa13628842369b17a21768c9a5e5" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:21:20.255227 20323 raft_consensus.cc:3060] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:20.263556 20323 raft_consensus.cc:2468] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 18.
I20260709 12:21:20.268373 28891 raft_consensus.cc:493] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.272598 28891 raft_consensus.cc:515] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:21:20.274814 28891 leader_election.cc:290] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:20.280014 20295 consensus_peers.cc:597] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:20.285459 20294 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.288637 20295 leader_election.cc:336] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.289093 20295 leader_election.cc:304] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:21:20.290391 20295 consensus_peers.cc:597] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:21:20.291237 28891 raft_consensus.cc:2749] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:20.296878 28891 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.297444 28891 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.292701 21007 leader_election.cc:304] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.298990 28895 raft_consensus.cc:2804] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:20.299796 28891 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:21:20.299814 28895 raft_consensus.cc:697] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:21:20.301863 28895 consensus_queue.cc:237] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.315263 28879 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.315913 28879 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.318380 28879 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:20.326455 20294 leader_election.cc:336] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.329301 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
W20260709 12:21:20.329818 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.333410 20294 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.334200 28891 raft_consensus.cc:2749] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:20.337107 21007 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.337736 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.338570 28879 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:21:20.353103 28879 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.353726 28879 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.358072 28891 raft_consensus.cc:493] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.358708 28891 raft_consensus.cc:515] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:21:20.360095 28895 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.360687 28895 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.361042 28891 leader_election.cc:290] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:20.366106 28891 raft_consensus.cc:493] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.366923 28891 raft_consensus.cc:515] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:21:20.370316 28891 leader_election.cc:290] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:20.384851 28895 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:20.375597 28879 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:20.387074 20295 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:20.387554 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:20.387758 20295 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:20.387701 20294 leader_election.cc:336] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.388558 20294 leader_election.cc:304] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:21:20.389516 20294 leader_election.cc:336] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.389899 20294 leader_election.cc:304] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.390208 28901 raft_consensus.cc:2749] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:20.390981 28901 raft_consensus.cc:2749] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:20.391283 28903 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.391878 28903 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.403046 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:21:20.403791 20323 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 15.
W20260709 12:21:20.404709 21007 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.405401 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.410951 20077 catalog_manager.cc:5697] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 17 to 18, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 18 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.413941 28879 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:20.417852 21008 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.428045 28879 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.429384 28897 raft_consensus.cc:493] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.430037 28897 raft_consensus.cc:515] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:21:20.431594 28906 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.432248 28906 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.428681 28879 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.433434 28897 leader_election.cc:290] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:20.434589 28906 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:20.435078 28879 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:20.438560 20294 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.441411 20295 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:20.441632 21008 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:20.441926 20295 leader_election.cc:336] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.442327 20295 leader_election.cc:304] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.443105 28897 raft_consensus.cc:2749] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:21:20.449774 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:20.453444 28903 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:20.471164 21007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:37765, user_credentials={real_user=slave}} blocked reactor thread for 66496.1us
I20260709 12:21:20.474620 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:21:20.479372 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:21:20.480240 28895 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.480753 28895 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.481937 28904 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:21:20.482465 28904 raft_consensus.cc:493] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.482852 28895 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:20.487855 21007 leader_election.cc:336] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.482903 28904 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:21:20.491114 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:21:20.491369 28901 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.491950 28901 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.494184 28901 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:21:20.494740 20323 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 19.
W20260709 12:21:20.504793 21007 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.505363 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:21:20.506102 20294 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.507052 28895 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:20.508965 21007 leader_election.cc:336] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.509388 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.510087 28903 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:20.511142 21007 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.511549 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.513293 28903 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:20.515914 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:21:20.516219 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:21:20.516635 28903 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:20.517154 21035 raft_consensus.cc:2468] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 19.
I20260709 12:21:20.517645 28903 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.518082 28903 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:20.524255 28904 raft_consensus.cc:515] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.526021 28903 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.529233 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.544330 28897 raft_consensus.cc:2804] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:20.544777 28897 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.545135 28897 raft_consensus.cc:3060] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:20.529942 21007 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.554451 28903 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:20.559197 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:21:20.560899 28895 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.561451 28895 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.563467 28895 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:20.564847 28897 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.566167 20323 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8aef67aa330543a191ab5ab5dc30e84c in current term 20: Already voted for candidate 85fa447fc35d4f88ab7c85630749ec78 in this term.
W20260709 12:21:20.568598 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:20.570441 28904 leader_election.cc:290] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:20.572175 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:21:20.577461 20323 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 24.
I20260709 12:21:20.572666 28897 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
W20260709 12:21:20.573550 20294 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.579243 21007 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.580513 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.582847 28904 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:20.590703 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fc708954624727a65ab4485d1a2285" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:21:20.591415 20323 raft_consensus.cc:3060] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:21:20.591960 20295 consensus_peers.cc:597] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:20.600292 20323 raft_consensus.cc:2468] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 16.
I20260709 12:21:20.601490 28904 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.602371 28904 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.606035 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc70b6f5a049439b939f85c3a096fb9d" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:21:20.606972 21035 raft_consensus.cc:2393] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 85fa447fc35d4f88ab7c85630749ec78 in current term 20: Already voted for candidate 8aef67aa330543a191ab5ab5dc30e84c in this term.
I20260709 12:21:20.605316 28897 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.608508 28897 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
W20260709 12:21:20.613633 21008 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.615562 28904 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:20.606302 21007 leader_election.cc:336] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.618067 20294 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.619787 20295 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:20.620271 20295 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.621090 28901 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:20.621918 28897 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:20.624716 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.629312 21007 leader_election.cc:304] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:21:20.629971 28904 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:20.632608 28904 raft_consensus.cc:493] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.633257 28904 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:20.632666 28908 raft_consensus.cc:2804] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:20.635375 28908 raft_consensus.cc:697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:21:20.636353 28908 consensus_queue.cc:237] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.656172 20294 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: 8aef67aa330543a191ab5ab5dc30e84c, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.665258 20323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78" is_pre_election: true
I20260709 12:21:20.665117 28897 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:20.667213 28904 raft_consensus.cc:515] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.669453 28904 leader_election.cc:290] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:20.670482 21007 leader_election.cc:336] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.682523 20324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce44adc86d94477297f0d6521f9cb48b" candidate_uuid: "8aef67aa330543a191ab5ab5dc30e84c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "85fa447fc35d4f88ab7c85630749ec78"
I20260709 12:21:20.683274 20324 raft_consensus.cc:3060] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:20.695804 21007 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.703049 28901 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.703895 28901 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.707839 28901 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:21:20.712150 20324 raft_consensus.cc:2468] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aef67aa330543a191ab5ab5dc30e84c in term 25.
W20260709 12:21:20.714251 20295 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:20.713411 21007 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.713363 28908 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:20.725618 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:20.734694 20294 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.737787 20294 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:20.737008 21007 leader_election.cc:304] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:21:20.747414 28895 raft_consensus.cc:2804] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:20.747983 28895 raft_consensus.cc:697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 25 LEADER]: Becoming Leader. State: Replica: 8aef67aa330543a191ab5ab5dc30e84c, State: Running, Role: LEADER
I20260709 12:21:20.748840 28895 consensus_queue.cc:237] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:20.755292 21007 leader_election.cc:336] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:20.757830 20077 catalog_manager.cc:5697] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 15 to 16, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 16 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.744818 28901 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:20.757853 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe31035391b450ebd3c369e9917f7aa" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:21:20.761593 21035 raft_consensus.cc:2468] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 22.
I20260709 12:21:20.782861 28901 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.783548 28901 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:20.785888 28901 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:21:20.788906 21040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c" is_pre_election: true
I20260709 12:21:20.789667 21040 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 23.
I20260709 12:21:20.836478 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: 
I20260709 12:21:20.844295 28897 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:20.845155 28897 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:20.845783 28897 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:21:20.853868 20294 leader_election.cc:336] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.907696 20295 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:20.913833 20323 raft_consensus.cc:1275] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:21:20.912747 20077 catalog_manager.cc:5697] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c reported cstate change: term changed from 24 to 25, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68). New cstate: current_term: 25 leader_uuid: "8aef67aa330543a191ab5ab5dc30e84c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.918171 28879 consensus_queue.cc:1048] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:21:20.940016 21007 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.944577 28897 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:20.953651 20294 leader_election.cc:336] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:20.953830 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:20.954002 21035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8271323bedc7421a87f787fc100b6efe" candidate_uuid: "85fa447fc35d4f88ab7c85630749ec78" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8aef67aa330543a191ab5ab5dc30e84c"
I20260709 12:21:20.950289 28897 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Requested vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 8aef67aa330543a191ab5ab5dc30e84c (127.18.132.68:38217)
I20260709 12:21:20.954978 21035 raft_consensus.cc:3060] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:20.967541 21035 raft_consensus.cc:2468] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fa447fc35d4f88ab7c85630749ec78 in term 24.
W20260709 12:21:20.967590 21007 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:20.984970 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:20.987757 20294 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78, 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6
I20260709 12:21:20.991902 28897 raft_consensus.cc:2804] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:20.992894 28897 raft_consensus.cc:697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Becoming Leader. State: Replica: 85fa447fc35d4f88ab7c85630749ec78, State: Running, Role: LEADER
I20260709 12:21:20.994338 28897 consensus_queue.cc:237] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:21.025617 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:21.026183 20294 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:21.029680 20077 catalog_manager.cc:5697] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 reported cstate change: term changed from 23 to 24, leader changed from e929b30888874ed59248f1229cecd3c6 (127.18.132.66) to 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67). New cstate: current_term: 24 leader_uuid: "85fa447fc35d4f88ab7c85630749ec78" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:21.050876 20294 consensus_peers.cc:597] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.057214 20295 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.077684 21007 consensus_peers.cc:597] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.115834 21007 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.135696 20294 consensus_peers.cc:597] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:21.139451 20323 raft_consensus.cc:1275] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:21:21.147081 28879 consensus_queue.cc:1048] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:21:21.153743 20295 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.153486 21007 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.176709 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:21.224095 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
W20260709 12:21:21.243175 20294 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:21.261530 20323 raft_consensus.cc:1275] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Refusing update from remote peer 8aef67aa330543a191ab5ab5dc30e84c: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:21:21.264182 28903 consensus_queue.cc:1048] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:21:21.273547 20295 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.277732 20294 consensus_peers.cc:597] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.276261 21007 consensus_peers.cc:597] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.304118 20294 consensus_peers.cc:597] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.325047 20294 consensus_peers.cc:597] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.348089 21007 consensus_peers.cc:597] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.359709 21007 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.358934 20294 consensus_peers.cc:597] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.408663 20295 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.409397 20294 consensus_peers.cc:597] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:21.430568 21035 raft_consensus.cc:1275] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Refusing update from remote peer 85fa447fc35d4f88ab7c85630749ec78: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:21:21.449747 20294 consensus_peers.cc:597] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.450623 20294 consensus_peers.cc:597] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:21.470829 28901 consensus_queue.cc:1048] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:21:21.483862 21007 consensus_peers.cc:597] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.486353 21007 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.498349 20294 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.500808 21007 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.501492 21007 consensus_peers.cc:597] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.514200 21007 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.532956 21007 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.536679 21007 consensus_peers.cc:597] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.543149 21007 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.562551 20294 consensus_peers.cc:597] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.597105 20295 consensus_peers.cc:597] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:21:21.621387 20294 consensus_peers.cc:597] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.623132 20294 consensus_peers.cc:597] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.624634 20294 consensus_peers.cc:597] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.664475 20294 consensus_peers.cc:597] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.665333 20294 consensus_peers.cc:597] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.689014 21007 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:21.700490 20295 consensus_peers.cc:597] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:21.744733 20295 consensus_peers.cc:597] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.755867 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:21.779325 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
W20260709 12:21:21.790699 21007 consensus_peers.cc:597] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:21.791070 28903 raft_consensus.cc:493] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:21.791693 28903 raft_consensus.cc:515] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:21.793972 28903 leader_election.cc:290] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:21.800364 21007 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:21.802706 21008 leader_election.cc:336] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:21.805317 21008 leader_election.cc:304] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:21.807891 28903 raft_consensus.cc:2749] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:21.805837 21007 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.823513 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:21:21.841964 21007 consensus_peers.cc:597] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.850646 21007 consensus_peers.cc:597] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.878414 21007 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.885289 21008 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:21:21.900527 21007 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.912628 20295 consensus_peers.cc:597] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.949023 21007 consensus_peers.cc:597] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.976814 21007 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:21.989382 20295 consensus_peers.cc:597] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:21.994318 21007 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:22.003352 21007 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:22.004205 21007 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.026872 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:22.032147 18961 tablet_replica.cc:333] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.033428 18961 raft_consensus.cc:2243] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.044844 18961 raft_consensus.cc:2272] T dc4c01fd2da34b0e9fb9ba3d8b2bd4c8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.051640 18961 tablet_replica.cc:333] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.055735 18961 raft_consensus.cc:2243] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.061492 18961 raft_consensus.cc:2272] T d8a3c653acbd4849b4107b058ac2f753 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.064977 18961 tablet_replica.cc:333] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.065996 18961 raft_consensus.cc:2243] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.067332 18961 raft_consensus.cc:2272] T 0cfc71bca12d482b9f153b0596eba41f P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.098248 21007 consensus_peers.cc:597] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.104422 18961 tablet_replica.cc:333] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.105949 18961 raft_consensus.cc:2243] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.108466 18961 raft_consensus.cc:2272] T 8271323bedc7421a87f787fc100b6efe P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.126693 18961 tablet_replica.cc:333] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.129539 18961 raft_consensus.cc:2243] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.131186 18961 raft_consensus.cc:2272] T e89e7906a9724d15951ec300ab3095b6 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.141746 18961 tablet_replica.cc:333] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.147423 18961 raft_consensus.cc:2243] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.149132 18961 raft_consensus.cc:2272] T 3fe31035391b450ebd3c369e9917f7aa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.153832 18961 tablet_replica.cc:333] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.157491 18961 raft_consensus.cc:2243] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.159041 18961 raft_consensus.cc:2272] T ff822ba5f5ad4f8c87f6018de9072cfb P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.162317 18961 tablet_replica.cc:333] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
W20260709 12:21:22.162560 21007 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:22.163254 21007 consensus_peers.cc:597] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.163285 18961 raft_consensus.cc:2243] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.165036 18961 raft_consensus.cc:2272] T 34e43fd47bc14908b8da11134e6fd1d6 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.168229 18961 tablet_replica.cc:333] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.169198 18961 raft_consensus.cc:2243] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.171437 18961 raft_consensus.cc:2272] T fbb68e81778549dc97b899388fd918fc P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.174297 18961 tablet_replica.cc:333] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.175132 18961 raft_consensus.cc:2243] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.176450 18961 raft_consensus.cc:2272] T 75d963e0e1da434f887fc330570683e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.179298 18961 tablet_replica.cc:333] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.180162 18961 raft_consensus.cc:2243] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.181605 18961 raft_consensus.cc:2272] T f979d38c94754ec998f38fd4e97c3ab9 P 85fa447fc35d4f88ab7c85630749ec78 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.185245 18961 tablet_replica.cc:333] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.186213 18961 raft_consensus.cc:2243] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.187585 18961 raft_consensus.cc:2272] T bd163d5722084caaae2c38bdcf1e7698 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.190371 18961 tablet_replica.cc:333] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.191291 18961 raft_consensus.cc:2243] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.193440 18961 raft_consensus.cc:2272] T 1b4b4e64b7f442968c110b5d746e4b14 P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.196339 18961 tablet_replica.cc:333] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.197220 18961 raft_consensus.cc:2243] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.198671 18961 raft_consensus.cc:2272] T 8bc39a197f2d41e4bc3e1f92594e8baa P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.200197 21007 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.205737 18961 tablet_replica.cc:333] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.206836 18961 raft_consensus.cc:2243] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.207552 18961 raft_consensus.cc:2272] T 8cacb9a2627045debeb7e4198ce2bcf7 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.210707 18961 tablet_replica.cc:333] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.215333 18961 raft_consensus.cc:2243] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.216158 18961 raft_consensus.cc:2272] T 937144b407c548958468c2b27f8cd054 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.219424 18961 tablet_replica.cc:333] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.220379 18961 raft_consensus.cc:2243] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.221700 18961 raft_consensus.cc:2272] T 4c3d6b71b9e74e4e84fa04048ad9b6f4 P 85fa447fc35d4f88ab7c85630749ec78 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.230759 18961 tablet_replica.cc:333] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.231761 18961 raft_consensus.cc:2243] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.233078 18961 raft_consensus.cc:2272] T 94a451623b3d4ba9b27eb7e8b56cb47a P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.236194 18961 tablet_replica.cc:333] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.237023 18961 raft_consensus.cc:2243] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.237779 18961 raft_consensus.cc:2272] T 0d378f8e2f934dcc8adcad8d5c71b573 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.240780 18961 tablet_replica.cc:333] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.241639 18961 raft_consensus.cc:2243] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.242934 18961 raft_consensus.cc:2272] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.248279 18961 tablet_replica.cc:333] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.249176 18961 raft_consensus.cc:2243] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.249917 18961 raft_consensus.cc:2272] T 674ae039bae9486b8fa77a2493757981 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.257090 21007 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.262171 28901 raft_consensus.cc:493] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:22.262859 28901 raft_consensus.cc:515] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } }
I20260709 12:21:22.268556 28901 leader_election.cc:290] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:22.273758 18961 tablet_replica.cc:333] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
W20260709 12:21:22.279381 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:22.280638 18961 raft_consensus.cc:2243] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.282188 18961 raft_consensus.cc:2272] T e9c1aa13628842369b17a21768c9a5e5 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.272020 20295 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:22.283943 20294 leader_election.cc:336] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:22.285590 20294 leader_election.cc:304] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85fa447fc35d4f88ab7c85630749ec78; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:22.286351 28901 raft_consensus.cc:2749] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:22.290884 18961 tablet_replica.cc:333] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.295228 18961 raft_consensus.cc:2243] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.296861 18961 raft_consensus.cc:2272] T fc2f9bd02105458eb0ee8e4142956948 P 85fa447fc35d4f88ab7c85630749ec78 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.300074 18961 tablet_replica.cc:333] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.298856 28895 raft_consensus.cc:493] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:22.301321 18961 raft_consensus.cc:2243] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.301087 28895 raft_consensus.cc:515] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:22.303176 18961 raft_consensus.cc:2272] T 766b995bcec04c62a05a9d91c572f494 P 85fa447fc35d4f88ab7c85630749ec78 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.307101 18961 tablet_replica.cc:333] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.307981 18961 raft_consensus.cc:2243] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.309259 18961 raft_consensus.cc:2272] T 094b66f474ed4806afc377722fa74020 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.312568 18961 tablet_replica.cc:333] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
W20260709 12:21:22.313328 21008 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:22.313548 18961 raft_consensus.cc:2243] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.315039 18961 raft_consensus.cc:2272] T b58bdb95474c4f788fec380b260dc1be P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.318634 18961 tablet_replica.cc:333] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.319487 18961 raft_consensus.cc:2243] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.320384 18961 raft_consensus.cc:2272] T a633082b519c485f8ea5b7f711895275 P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.323684 18961 tablet_replica.cc:333] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.324756 18961 raft_consensus.cc:2243] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.334446 18961 raft_consensus.cc:2272] T 78812bac55564850a870dc75f26b8b9a P 85fa447fc35d4f88ab7c85630749ec78 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.337556 18961 tablet_replica.cc:333] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.338449 18961 raft_consensus.cc:2243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.340718 28903 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:22.341444 28903 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:22.344408 28903 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:22.347608 28895 leader_election.cc:290] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:22.339043 18961 raft_consensus.cc:2272] T 04d32aa1a8cf46979742c1fb0beb8b2c P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.349489 21008 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:22.351881 18961 tablet_replica.cc:333] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.352792 18961 raft_consensus.cc:2243] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.354102 18961 raft_consensus.cc:2272] T 64230d63b49741d69bace479cb6508f1 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.356992 18961 tablet_replica.cc:333] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
W20260709 12:21:22.359102 21007 leader_election.cc:336] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:22.357813 18961 raft_consensus.cc:2243] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.359719 21007 leader_election.cc:304] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:22.360725 28904 raft_consensus.cc:2749] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:22.362123 18961 raft_consensus.cc:2272] T de68043269e84d00b62b03a362170cc8 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.365613 18961 tablet_replica.cc:333] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.366438 18961 raft_consensus.cc:2243] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.367342 18961 raft_consensus.cc:2272] T 812122fe309946b0a0eebf7bc2214d12 P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.370365 18961 tablet_replica.cc:333] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.371129 18961 raft_consensus.cc:2243] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.372073 18961 raft_consensus.cc:2272] T 6ebc8da2a63b4daeb972508fd248a6f2 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.372083 21008 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:21:22.375427 18961 tablet_replica.cc:333] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.376327 18961 raft_consensus.cc:2243] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.376984 18961 raft_consensus.cc:2272] T ae0621ca652d416d9284323ec7eb2363 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.379845 18961 tablet_replica.cc:333] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.380647 18961 raft_consensus.cc:2243] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.381268 18961 raft_consensus.cc:2272] T 599fe0ac57224f249385f1d6243cb41a P 85fa447fc35d4f88ab7c85630749ec78 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.384016 18961 tablet_replica.cc:333] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.384747 18961 raft_consensus.cc:2243] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.385356 18961 raft_consensus.cc:2272] T fc3c17581b364b2292ad25402ab6bf57 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.388260 18961 tablet_replica.cc:333] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.396201 18961 raft_consensus.cc:2243] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:21:22.396525 21007 consensus_peers.cc:597] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.397660 18961 raft_consensus.cc:2272] T 7d79a5dd3e7e46678ffc3ddc6af43051 P 85fa447fc35d4f88ab7c85630749ec78 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.400839 18961 tablet_replica.cc:333] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.401660 18961 raft_consensus.cc:2243] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.402469 18961 raft_consensus.cc:2272] T bc70b6f5a049439b939f85c3a096fb9d P 85fa447fc35d4f88ab7c85630749ec78 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.405263 18961 tablet_replica.cc:333] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.406041 18961 raft_consensus.cc:2243] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.406637 18961 raft_consensus.cc:2272] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.409412 18961 tablet_replica.cc:333] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.410157 18961 raft_consensus.cc:2243] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.410964 18961 raft_consensus.cc:2272] T 53fc708954624727a65ab4485d1a2285 P 85fa447fc35d4f88ab7c85630749ec78 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.413636 18961 tablet_replica.cc:333] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.414384 18961 raft_consensus.cc:2243] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:22.415776 18961 raft_consensus.cc:2272] T de701338877c4a78b14dec4df55119c2 P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.418879 18961 tablet_replica.cc:333] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.419669 18961 raft_consensus.cc:2243] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.420276 18961 raft_consensus.cc:2272] T 40142d5f54b2446e8c64c73d6fb188fc P 85fa447fc35d4f88ab7c85630749ec78 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.422425 21007 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:22.422952 21007 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:22.423287 18961 tablet_replica.cc:333] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.424166 18961 raft_consensus.cc:2243] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.424727 18961 raft_consensus.cc:2272] T ce44adc86d94477297f0d6521f9cb48b P 85fa447fc35d4f88ab7c85630749ec78 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.428434 18961 tablet_replica.cc:333] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.429173 18961 raft_consensus.cc:2243] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.430022 18961 raft_consensus.cc:2272] T 9dedcb24fca34377b036e86f9764e60b P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.431093 28927 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:22.432791 18961 tablet_replica.cc:333] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.433542 18961 raft_consensus.cc:2243] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.434175 18961 raft_consensus.cc:2272] T 463ac757068e4382abd72beef4bbf682 P 85fa447fc35d4f88ab7c85630749ec78 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.437103 18961 tablet_replica.cc:333] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.437768 18961 raft_consensus.cc:2243] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.438432 18961 raft_consensus.cc:2272] T 56046fd4231240119a75348ab3fc48d3 P 85fa447fc35d4f88ab7c85630749ec78 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.439580 21007 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:22.441538 18961 tablet_replica.cc:333] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78: stopping tablet replica
I20260709 12:21:22.442262 18961 raft_consensus.cc:2243] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.442909 18961 raft_consensus.cc:2272] T a145c5f943d84d5eade056f80c775a0e P 85fa447fc35d4f88ab7c85630749ec78 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:22.454159 21008 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:22.467326 28927 raft_consensus.cc:493] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:22.468046 28927 raft_consensus.cc:515] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:22.475484 21008 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:22.476591 28926 raft_consensus.cc:493] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:22.477293 28926 raft_consensus.cc:515] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:22.479549 28926 leader_election.cc:290] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
I20260709 12:21:22.486500 28927 leader_election.cc:290] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:22.503396 21008 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:22.518204 21008 consensus_peers.cc:597] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:22.560027 28927 raft_consensus.cc:493] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:22.560801 28927 raft_consensus.cc:515] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:22.563123 28927 leader_election.cc:290] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765)
W20260709 12:21:22.569358 21008 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:22.571267 21007 leader_election.cc:336] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:22.571981 21007 leader_election.cc:304] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:22.572842 28927 raft_consensus.cc:2749] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:22.573163 21007 leader_election.cc:336] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:22.573781 21007 leader_election.cc:304] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:22.574613 28927 raft_consensus.cc:2749] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:21:22.578646 21007 connection.cc:769] client connection to 127.18.132.67:46619 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:21:22.602334 21007 leader_election.cc:336] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:22.603015 21007 leader_election.cc:304] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:22.603938 28904 raft_consensus.cc:2749] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:22.706461 21008 consensus_peers.cc:597] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:22.809388 28904 raft_consensus.cc:493] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:22.810053 28904 raft_consensus.cc:515] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:22.812279 28904 leader_election.cc:290] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:22.823247 21007 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:22.823962 21007 leader_election.cc:336] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:22.824358 21007 leader_election.cc:304] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:22.825064 28904 raft_consensus.cc:2749] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:23.055747 21008 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:23.116022 21008 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:23.154577 21007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111) [suppressed 692 similar messages]
I20260709 12:21:23.162357 28926 raft_consensus.cc:493] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.162972 28926 raft_consensus.cc:515] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } attrs { replace: true } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.166152 28926 leader_election.cc:290] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.175397 21008 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:23.179119 21008 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:23.189642 21007 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:23.190313 21007 leader_election.cc:304] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:23.191157 28926 raft_consensus.cc:2749] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:21:23.192256 21007 leader_election.cc:336] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.279981 28926 raft_consensus.cc:493] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.280580 28926 raft_consensus.cc:515] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.282651 28926 leader_election.cc:290] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
I20260709 12:21:23.284608 28926 raft_consensus.cc:493] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.285104 28926 raft_consensus.cc:515] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.287003 28926 leader_election.cc:290] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.287453 21008 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:23.290724 21007 leader_election.cc:336] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.291162 21007 leader_election.cc:304] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:23.291880 28926 raft_consensus.cc:2749] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:23.295989 21007 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:23.296854 21007 leader_election.cc:336] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.297214 21007 leader_election.cc:304] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:23.297864 28926 raft_consensus.cc:2749] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:23.300664 28904 raft_consensus.cc:493] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.301151 28904 raft_consensus.cc:515] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.303364 28904 leader_election.cc:290] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.311125 21008 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:23.314400 21007 leader_election.cc:336] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.314970 21007 leader_election.cc:304] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:23.315775 28904 raft_consensus.cc:2749] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:21:23.378893 28904 raft_consensus.cc:493] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.379518 28904 raft_consensus.cc:515] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:23.381305 21007 consensus_peers.cc:597] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:23.382472 28904 leader_election.cc:290] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.387480 21008 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:23.390349 21007 leader_election.cc:336] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.390810 21007 leader_election.cc:304] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:23.391539 28904 raft_consensus.cc:2749] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:23.477525 28926 raft_consensus.cc:493] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.478159 28926 raft_consensus.cc:515] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.480530 28926 leader_election.cc:290] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.486743 21007 leader_election.cc:336] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
W20260709 12:21:23.487953 21007 leader_election.cc:336] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.489647 21007 leader_election.cc:304] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:23.490433 28904 raft_consensus.cc:2749] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:23.494550 21008 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:23.552337 21008 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:23.566355 21007 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:23.588819 28926 raft_consensus.cc:493] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.589457 28926 raft_consensus.cc:515] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.591638 28926 leader_election.cc:290] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.597000 21007 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
W20260709 12:21:23.597507 21008 leader_election.cc:336] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:23.597975 21008 leader_election.cc:304] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:23.598732 28926 raft_consensus.cc:2749] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:23.640251 28926 raft_consensus.cc:493] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.640964 28926 raft_consensus.cc:515] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:23.645820 28926 leader_election.cc:290] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.647927 21007 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
W20260709 12:21:23.648955 21008 leader_election.cc:336] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:23.649430 21008 leader_election.cc:304] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, f5c544fad8874e818acaad733a9d14f1
I20260709 12:21:23.650619 28926 raft_consensus.cc:2749] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:23.664590 28926 raft_consensus.cc:493] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 85fa447fc35d4f88ab7c85630749ec78)
I20260709 12:21:23.665191 28926 raft_consensus.cc:515] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
W20260709 12:21:23.673945 21007 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:23.676839 28926 leader_election.cc:290] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:23.681710 21007 leader_election.cc:336] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:23.682237 21007 leader_election.cc:304] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: 85fa447fc35d4f88ab7c85630749ec78, e929b30888874ed59248f1229cecd3c6
I20260709 12:21:23.683033 28926 raft_consensus.cc:2749] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:23.685746 21007 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.705323 21008 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:21:23.715092 21007 consensus_peers.cc:597] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.726020 21007 consensus_peers.cc:597] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.750878 21007 consensus_peers.cc:597] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.774585 21007 consensus_peers.cc:597] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.807842 21007 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.884593 21007 consensus_peers.cc:597] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.906463 21007 consensus_peers.cc:597] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:23.928612 21007 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.939244 21007 consensus_peers.cc:597] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.963654 21007 consensus_peers.cc:597] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:24.015640 21007 consensus_peers.cc:597] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:24.022773 21007 consensus_peers.cc:597] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:24.032141 21007 consensus_peers.cc:597] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:24.037031 21007 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:24.085239 21007 consensus_peers.cc:597] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:24.169713 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
W20260709 12:21:24.226032 21007 consensus_peers.cc:597] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:24.256592 21007 consensus_peers.cc:597] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:24.323549 18961 tablet_server.cc:179] TabletServer@127.18.132.68:0 shutting down...
W20260709 12:21:24.330024 21007 consensus_peers.cc:597] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Couldn't send request to peer e929b30888874ed59248f1229cecd3c6. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:24.372467 28926 raft_consensus.cc:493] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e929b30888874ed59248f1229cecd3c6)
I20260709 12:21:24.373111 28926 raft_consensus.cc:515] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f5c544fad8874e818acaad733a9d14f1" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39563 } } peers { permanent_uuid: "e929b30888874ed59248f1229cecd3c6" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 37765 } } peers { permanent_uuid: "85fa447fc35d4f88ab7c85630749ec78" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 46619 } attrs { replace: true } } peers { permanent_uuid: "8aef67aa330543a191ab5ab5dc30e84c" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 38217 } attrs { promote: false } }
I20260709 12:21:24.376262 28926 leader_election.cc:290] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563), e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765), 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619)
W20260709 12:21:24.381106 21008 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:24.390348 21007 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e929b30888874ed59248f1229cecd3c6 (127.18.132.66:37765): Network error: Client connection negotiation failed: client connection to 127.18.132.66:37765: connect: Connection refused (error 111)
I20260709 12:21:24.390776 21007 leader_election.cc:304] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8aef67aa330543a191ab5ab5dc30e84c; no voters: e929b30888874ed59248f1229cecd3c6, f5c544fad8874e818acaad733a9d14f1
W20260709 12:21:24.391533 21007 leader_election.cc:336] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111)
I20260709 12:21:24.391819 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:24.392381 28904 raft_consensus.cc:2749] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:24.392863 18961 tablet_replica.cc:333] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.394410 18961 raft_consensus.cc:2243] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.396323 18961 raft_consensus.cc:2272] T e9c1aa13628842369b17a21768c9a5e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.399555 21007 consensus_peers.cc:597] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:24.399574 21008 consensus_peers.cc:597] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:24.400205 18961 tablet_replica.cc:333] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.401342 18961 raft_consensus.cc:2243] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.402138 18961 raft_consensus.cc:2272] T 3fe31035391b450ebd3c369e9917f7aa P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.405534 18961 tablet_replica.cc:333] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.406576 18961 raft_consensus.cc:2243] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.407335 18961 raft_consensus.cc:2272] T fbb68e81778549dc97b899388fd918fc P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.410818 18961 tablet_replica.cc:333] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.411762 18961 raft_consensus.cc:2243] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.412781 18961 raft_consensus.cc:2272] T bd163d5722084caaae2c38bdcf1e7698 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.416072 18961 tablet_replica.cc:333] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.417109 18961 raft_consensus.cc:2243] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.417690 18961 raft_consensus.cc:2272] T 8271323bedc7421a87f787fc100b6efe P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.420830 18961 tablet_replica.cc:333] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.421692 18961 raft_consensus.cc:2243] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.422312 18961 raft_consensus.cc:2272] T f979d38c94754ec998f38fd4e97c3ab9 P 8aef67aa330543a191ab5ab5dc30e84c [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.425612 18961 tablet_replica.cc:333] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.426461 18961 raft_consensus.cc:2243] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.427743 18961 raft_consensus.cc:2272] T dda77defaf824b5c9cc9505346d7080c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.430932 18961 tablet_replica.cc:333] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.431839 18961 raft_consensus.cc:2243] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.432962 18961 raft_consensus.cc:2272] T 9dedcb24fca34377b036e86f9764e60b P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.435917 18961 tablet_replica.cc:333] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.436776 18961 raft_consensus.cc:2243] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.437522 18961 raft_consensus.cc:2272] T 5260534c5dcb4fe0a840162b4eb6d460 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.440598 18961 tablet_replica.cc:333] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.441551 18961 raft_consensus.cc:2243] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.442718 18961 raft_consensus.cc:2272] T ae0621ca652d416d9284323ec7eb2363 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.445832 18961 tablet_replica.cc:333] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.446723 18961 raft_consensus.cc:2243] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:21:24.447636 21007 consensus_peers.cc:597] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:24.447929 18961 raft_consensus.cc:2272] T 599fe0ac57224f249385f1d6243cb41a P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.450908 18961 tablet_replica.cc:333] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.451773 18961 raft_consensus.cc:2243] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.453194 18961 raft_consensus.cc:2272] T fc3c17581b364b2292ad25402ab6bf57 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.456115 21008 consensus_peers.cc:597] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:21:24.456359 18961 tablet_replica.cc:333] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.457258 18961 raft_consensus.cc:2243] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.458364 18961 raft_consensus.cc:2272] T 53fc708954624727a65ab4485d1a2285 P 8aef67aa330543a191ab5ab5dc30e84c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.459542 21008 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): Couldn't send request to peer f5c544fad8874e818acaad733a9d14f1. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:21:24.461440 18961 tablet_replica.cc:333] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.462368 18961 raft_consensus.cc:2243] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.463092 18961 raft_consensus.cc:2272] T 98e8de971f5342ac94652edf51dd27ef P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.466333 18961 tablet_replica.cc:333] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.467201 18961 raft_consensus.cc:2243] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.467875 18961 raft_consensus.cc:2272] T bddbf42869844c6f9ae72ceaefc93ea8 P 8aef67aa330543a191ab5ab5dc30e84c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.471130 18961 tablet_replica.cc:333] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.472075 18961 raft_consensus.cc:2243] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.473004 18961 raft_consensus.cc:2272] T 94a451623b3d4ba9b27eb7e8b56cb47a P 8aef67aa330543a191ab5ab5dc30e84c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.476058 18961 tablet_replica.cc:333] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.476891 18961 raft_consensus.cc:2243] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.478080 18961 raft_consensus.cc:2272] T 99f5ffbc4fe542b3996e60bb26ee1c35 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.481338 18961 tablet_replica.cc:333] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.482214 18961 raft_consensus.cc:2243] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.482793 18961 raft_consensus.cc:2272] T bc70b6f5a049439b939f85c3a096fb9d P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.485814 18961 tablet_replica.cc:333] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.486660 18961 raft_consensus.cc:2243] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.488065 18961 raft_consensus.cc:2272] T 1b4b4e64b7f442968c110b5d746e4b14 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.491184 18961 tablet_replica.cc:333] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.492065 18961 raft_consensus.cc:2243] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.493407 18961 raft_consensus.cc:2272] T e8aaa749694d4c0c9f5af38eeb53fe12 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.496593 18961 tablet_replica.cc:333] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.497406 18961 raft_consensus.cc:2243] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.498093 18961 raft_consensus.cc:2272] T 6c5dfa3335ec44bcb98beeec64591f01 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.501163 18961 tablet_replica.cc:333] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.501964 18961 raft_consensus.cc:2243] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.503228 18961 raft_consensus.cc:2272] T 812122fe309946b0a0eebf7bc2214d12 P 8aef67aa330543a191ab5ab5dc30e84c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.505753 21007 consensus_peers.cc:597] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:24.506524 18961 tablet_replica.cc:333] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.507431 18961 raft_consensus.cc:2243] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.508189 18961 raft_consensus.cc:2272] T 0cfc71bca12d482b9f153b0596eba41f P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.511116 18961 tablet_replica.cc:333] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.511977 18961 raft_consensus.cc:2243] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.513211 18961 raft_consensus.cc:2272] T 6ebc8da2a63b4daeb972508fd248a6f2 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.514052 21007 consensus_peers.cc:597] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:24.516204 18961 tablet_replica.cc:333] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.517038 18961 raft_consensus.cc:2243] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.518225 18961 raft_consensus.cc:2272] T a145c5f943d84d5eade056f80c775a0e P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.521147 18961 tablet_replica.cc:333] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.521910 18961 raft_consensus.cc:2243] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.523085 18961 raft_consensus.cc:2272] T cb4da77a6bb24e4f94abb2f4bd8a7f9e P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.526008 18961 tablet_replica.cc:333] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.526770 18961 raft_consensus.cc:2243] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.528021 18961 raft_consensus.cc:2272] T ce44adc86d94477297f0d6521f9cb48b P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.530818 18961 tablet_replica.cc:333] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
W20260709 12:21:24.531250 21007 consensus_peers.cc:597] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c -> Peer 85fa447fc35d4f88ab7c85630749ec78 (127.18.132.67:46619): Couldn't send request to peer 85fa447fc35d4f88ab7c85630749ec78. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:46619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:24.531749 18961 raft_consensus.cc:2243] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.532966 18961 raft_consensus.cc:2272] T 04d32aa1a8cf46979742c1fb0beb8b2c P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.536015 18961 tablet_replica.cc:333] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.536799 18961 raft_consensus.cc:2243] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.538079 18961 raft_consensus.cc:2272] T 0d378f8e2f934dcc8adcad8d5c71b573 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.540999 18961 tablet_replica.cc:333] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.541790 18961 raft_consensus.cc:2243] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.543180 18961 raft_consensus.cc:2272] T 8cacb9a2627045debeb7e4198ce2bcf7 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.546141 18961 tablet_replica.cc:333] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.546890 18961 raft_consensus.cc:2243] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.547505 18961 raft_consensus.cc:2272] T ff822ba5f5ad4f8c87f6018de9072cfb P 8aef67aa330543a191ab5ab5dc30e84c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.550357 18961 tablet_replica.cc:333] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.551123 18961 raft_consensus.cc:2243] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.551815 18961 raft_consensus.cc:2272] T 94d92f1167e6425dbdcc7276bd1de9b7 P 8aef67aa330543a191ab5ab5dc30e84c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.554679 18961 tablet_replica.cc:333] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.555426 18961 raft_consensus.cc:2243] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.556728 18961 raft_consensus.cc:2272] T 9f631101c7754614902057ac50b914e5 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.559629 18961 tablet_replica.cc:333] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.560410 18961 raft_consensus.cc:2243] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.562464 18961 raft_consensus.cc:2272] T 2810bc1c814f432184fd2110cf8b6e45 P 8aef67aa330543a191ab5ab5dc30e84c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.565507 18961 tablet_replica.cc:333] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.566270 18961 raft_consensus.cc:2243] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.567379 18961 raft_consensus.cc:2272] T b58bdb95474c4f788fec380b260dc1be P 8aef67aa330543a191ab5ab5dc30e84c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.570158 18961 tablet_replica.cc:333] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.570909 18961 raft_consensus.cc:2243] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.572592 18961 raft_consensus.cc:2272] T 5844fde759d84503859902ab6bf69cdc P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.575392 18961 tablet_replica.cc:333] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.576108 18961 raft_consensus.cc:2243] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.577339 18961 raft_consensus.cc:2272] T 56046fd4231240119a75348ab3fc48d3 P 8aef67aa330543a191ab5ab5dc30e84c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.580184 18961 tablet_replica.cc:333] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.580857 18961 raft_consensus.cc:2243] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.581490 18961 raft_consensus.cc:2272] T 4f9ab1c5b9f64cf4ac204ed80e9e0035 P 8aef67aa330543a191ab5ab5dc30e84c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.584151 18961 tablet_replica.cc:333] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.584808 18961 raft_consensus.cc:2243] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.585515 18961 raft_consensus.cc:2272] T 34e43fd47bc14908b8da11134e6fd1d6 P 8aef67aa330543a191ab5ab5dc30e84c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.588183 18961 tablet_replica.cc:333] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c: stopping tablet replica
I20260709 12:21:24.588774 18961 raft_consensus.cc:2243] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.589977 18961 raft_consensus.cc:2272] T 02f2bc2263db420a815ba46efc7bf818 P 8aef67aa330543a191ab5ab5dc30e84c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.994426 18961 tablet_server.cc:196] TabletServer@127.18.132.68:0 shutdown complete.
I20260709 12:21:25.078753 18961 master.cc:562] Master@127.18.132.126:44843 shutting down...
W20260709 12:21:25.116676 20126 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:21:25.117039 20126 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:25.117271 20126 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:27.967548 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 94a451623b3d4ba9b27eb7e8b56cb47a: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
W20260709 12:21:31.543715 20064 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111) [suppressed 150 similar messages]
W20260709 12:21:31.547626 20064 catalog_manager.cc:4755] TS f5c544fad8874e818acaad733a9d14f1 (127.18.132.65:39563): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bd163d5722084caaae2c38bdcf1e7698: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39563: connect: Connection refused (error 111)
I20260709 12:21:33.847687 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.848937 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.849376 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P b336d660a2b34362b3d4d9e44ca2179d: stopping tablet replica
I20260709 12:21:34.069159 18961 master.cc:584] Master@127.18.132.126:44843 shutdown complete.
I20260709 12:21:34.125643 18961 test_util.cc:182] -----------------------------------------------
I20260709 12:21:34.125914 18961 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348522187-18961-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (282105 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:21:34.129981 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:45601
I20260709 12:21:34.131198 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.137444 28938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.138206 28939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.138690 28941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.139497 18961 server_base.cc:1061] running on GCE node
I20260709 12:21:34.144361 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.144623 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.144788 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599694144772 us; error 0 us; skew 500 ppm
I20260709 12:21:34.145316 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.148128 18961 webserver.cc:533] Webserver started at http://127.18.132.126:40827/ using document root <none> and password file <none>
I20260709 12:21:34.148655 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.148866 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.149176 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.150559 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "758adb48947145ab9f8735db799762a2"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.155339 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:21:34.158895 28946 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.159636 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:34.159962 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "758adb48947145ab9f8735db799762a2"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.160255 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.182940 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.184298 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.228566 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:45601
I20260709 12:21:34.228694 28998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:45601 every 8 connection(s)
I20260709 12:21:34.233105 28999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.246163 28999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2: Bootstrap starting.
I20260709 12:21:34.251842 28999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.256558 28999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2: No bootstrap required, opened a new log
I20260709 12:21:34.258975 28999 raft_consensus.cc:359] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758adb48947145ab9f8735db799762a2" member_type: VOTER }
I20260709 12:21:34.259413 28999 raft_consensus.cc:385] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.259749 28999 raft_consensus.cc:740] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 758adb48947145ab9f8735db799762a2, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.260414 28999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758adb48947145ab9f8735db799762a2" member_type: VOTER }
I20260709 12:21:34.260918 28999 raft_consensus.cc:399] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:34.261154 28999 raft_consensus.cc:493] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:34.261449 28999 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.266402 28999 raft_consensus.cc:515] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758adb48947145ab9f8735db799762a2" member_type: VOTER }
I20260709 12:21:34.266911 28999 leader_election.cc:304] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 758adb48947145ab9f8735db799762a2; no voters: 
I20260709 12:21:34.268114 28999 leader_election.cc:290] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:34.268569 29002 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.270032 29002 raft_consensus.cc:697] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 1 LEADER]: Becoming Leader. State: Replica: 758adb48947145ab9f8735db799762a2, State: Running, Role: LEADER
I20260709 12:21:34.270804 29002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758adb48947145ab9f8735db799762a2" member_type: VOTER }
I20260709 12:21:34.271436 28999 sys_catalog.cc:565] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:34.277736 29003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "758adb48947145ab9f8735db799762a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758adb48947145ab9f8735db799762a2" member_type: VOTER } }
I20260709 12:21:34.278509 29003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:34.280059 29004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 758adb48947145ab9f8735db799762a2. Latest consensus state: current_term: 1 leader_uuid: "758adb48947145ab9f8735db799762a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758adb48947145ab9f8735db799762a2" member_type: VOTER } }
I20260709 12:21:34.281486 29004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:34.282059 29011 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:34.287683 29011 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:34.289227 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:34.297312 29011 catalog_manager.cc:1383] Generated new cluster ID: 2c5a3f79dc8148c7b83ae2901dd8b397
I20260709 12:21:34.297567 29011 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:34.319909 29011 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:34.321346 29011 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:34.337457 29011 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2: Generated new TSK 0
I20260709 12:21:34.338109 29011 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:34.356223 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.364200 29020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.365289 29021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.371181 18961 server_base.cc:1061] running on GCE node
W20260709 12:21:34.372162 29023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.374663 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.374861 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.374984 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599694374972 us; error 0 us; skew 500 ppm
I20260709 12:21:34.375517 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.378068 18961 webserver.cc:533] Webserver started at http://127.18.132.65:34935/ using document root <none> and password file <none>
I20260709 12:21:34.378520 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.378684 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.378896 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.380268 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.385082 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:21:34.388512 29028 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.389302 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:34.389616 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.389902 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.420598 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.422103 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.423854 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.426465 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.426641 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.426951 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.427141 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.474267 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:42483
I20260709 12:21:34.474381 29091 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:42483 every 8 connection(s)
I20260709 12:21:34.480191 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.488253 29096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.491074 29097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.495042 29099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.495618 29092 heartbeater.cc:344] Connected to a master server at 127.18.132.126:45601
I20260709 12:21:34.496160 29092 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.496652 18961 server_base.cc:1061] running on GCE node
I20260709 12:21:34.497323 29092 heartbeater.cc:507] Master 127.18.132.126:45601 requested a full tablet report, sending...
I20260709 12:21:34.500170 28963 ts_manager.cc:194] Registered new tserver with Master: 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:34.500408 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.500757 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.500945 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599694500928 us; error 0 us; skew 500 ppm
I20260709 12:21:34.501644 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.502373 28963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42060
I20260709 12:21:34.504624 18961 webserver.cc:533] Webserver started at http://127.18.132.66:40953/ using document root <none> and password file <none>
I20260709 12:21:34.505388 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.505638 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.505957 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.507242 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "6cf7766f7e944f41837fd8aa8bde0018"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.512012 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:21:34.515810 29104 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.516610 18961 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:21:34.516913 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "6cf7766f7e944f41837fd8aa8bde0018"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.517225 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.536326 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.537750 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.539367 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.541843 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.542078 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.542341 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.542521 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.589841 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:42507
I20260709 12:21:34.589960 29166 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:42507 every 8 connection(s)
I20260709 12:21:34.595587 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.602933 29170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.606276 29171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.606452 18961 server_base.cc:1061] running on GCE node
W20260709 12:21:34.607739 29173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.608830 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.609099 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.609305 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599694609285 us; error 0 us; skew 500 ppm
I20260709 12:21:34.609580 29167 heartbeater.cc:344] Connected to a master server at 127.18.132.126:45601
I20260709 12:21:34.610029 29167 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.610054 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.611101 29167 heartbeater.cc:507] Master 127.18.132.126:45601 requested a full tablet report, sending...
I20260709 12:21:34.613199 18961 webserver.cc:533] Webserver started at http://127.18.132.67:42375/ using document root <none> and password file <none>
I20260709 12:21:34.613770 28963 ts_manager.cc:194] Registered new tserver with Master: 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:34.613957 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.614274 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.614601 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.615936 28963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42066
I20260709 12:21:34.616379 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "7e87f64602ef465cb6288f69964235a9"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.621990 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:21:34.625607 29178 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.626605 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:21:34.626977 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "7e87f64602ef465cb6288f69964235a9"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.627416 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.640955 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.642323 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.643956 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.646462 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.646668 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.646924 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.647090 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.693698 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:41735
I20260709 12:21:34.693812 29241 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:41735 every 8 connection(s)
I20260709 12:21:34.699427 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.707425 29245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.708917 29246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.712067 29248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.713132 18961 server_base.cc:1061] running on GCE node
I20260709 12:21:34.713374 29242 heartbeater.cc:344] Connected to a master server at 127.18.132.126:45601
I20260709 12:21:34.713896 29242 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.714515 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.714852 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.715101 29242 heartbeater.cc:507] Master 127.18.132.126:45601 requested a full tablet report, sending...
I20260709 12:21:34.715117 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599694715096 us; error 0 us; skew 500 ppm
I20260709 12:21:34.716531 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.718053 28963 ts_manager.cc:194] Registered new tserver with Master: 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:34.719913 18961 webserver.cc:533] Webserver started at http://127.18.132.68:40967/ using document root <none> and password file <none>
I20260709 12:21:34.720150 28963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42076
I20260709 12:21:34.720542 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.720824 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.721114 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.722622 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-3-root/instance:
uuid: "91fd10ed5c3e47fcb354c51acbe25286"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.727427 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:21:34.731354 29253 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.732185 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:21:34.732492 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-3-root
uuid: "91fd10ed5c3e47fcb354c51acbe25286"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:34.732795 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.752684 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.754179 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:34.755968 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:34.758132 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:34.758340 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.758610 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:34.758770 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.806551 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.68:45807
I20260709 12:21:34.806651 29315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.68:45807 every 8 connection(s)
I20260709 12:21:34.822662 29316 heartbeater.cc:344] Connected to a master server at 127.18.132.126:45601
I20260709 12:21:34.823187 29316 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:34.824143 29316 heartbeater.cc:507] Master 127.18.132.126:45601 requested a full tablet report, sending...
I20260709 12:21:34.826172 28963 ts_manager.cc:194] Registered new tserver with Master: 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:34.826650 18961 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016045776s
I20260709 12:21:34.827798 28963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42088
I20260709 12:21:34.856165 28963 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42098:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:21:35.107352 29280 tablet_service.cc:1511] Processing CreateTablet for tablet 26215fc88fd545f290fbaaff9ae467f6 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:35.110625 29278 tablet_service.cc:1511] Processing CreateTablet for tablet faf05148546740429720380b7f235833 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:35.113560 29280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26215fc88fd545f290fbaaff9ae467f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.113173 29277 tablet_service.cc:1511] Processing CreateTablet for tablet 245a5b3a66c044189c7a2a2d10db4149 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:35.116055 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf05148546740429720380b7f235833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.116387 29279 tablet_service.cc:1511] Processing CreateTablet for tablet 970d5a478a4e490a87a712db238e695c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:35.116852 29277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245a5b3a66c044189c7a2a2d10db4149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.117838 29279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970d5a478a4e490a87a712db238e695c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.120782 29276 tablet_service.cc:1511] Processing CreateTablet for tablet 8fecfd39d27743c9aec3e98b7f9162b2 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:35.120971 29205 tablet_service.cc:1511] Processing CreateTablet for tablet 970d5a478a4e490a87a712db238e695c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:35.122288 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecfd39d27743c9aec3e98b7f9162b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.122385 29205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970d5a478a4e490a87a712db238e695c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.124565 29204 tablet_service.cc:1511] Processing CreateTablet for tablet ea44e5f06ab7487b85663ead289a65d5 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:35.124917 29207 tablet_service.cc:1511] Processing CreateTablet for tablet 8e39ebaf09f44b5fafafbcc94e7b50a7 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:35.126121 29204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea44e5f06ab7487b85663ead289a65d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.126919 29206 tablet_service.cc:1511] Processing CreateTablet for tablet f15092329a634992ba6d44f5e89b40db (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:35.130870 29203 tablet_service.cc:1511] Processing CreateTablet for tablet 245a5b3a66c044189c7a2a2d10db4149 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:35.131189 29281 tablet_service.cc:1511] Processing CreateTablet for tablet 8e39ebaf09f44b5fafafbcc94e7b50a7 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:35.132745 29281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e39ebaf09f44b5fafafbcc94e7b50a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.132660 29275 tablet_service.cc:1511] Processing CreateTablet for tablet 1973cb4352f14b628c856d7f58cea0da (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:35.134194 29275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1973cb4352f14b628c856d7f58cea0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.135169 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15092329a634992ba6d44f5e89b40db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.135975 29203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245a5b3a66c044189c7a2a2d10db4149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.136922 29207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e39ebaf09f44b5fafafbcc94e7b50a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.131525 29202 tablet_service.cc:1511] Processing CreateTablet for tablet 8fecfd39d27743c9aec3e98b7f9162b2 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:35.140759 29202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecfd39d27743c9aec3e98b7f9162b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.141098 29201 tablet_service.cc:1511] Processing CreateTablet for tablet cbaa18dc25644cc6976f09ff3dfce4f8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:35.142634 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa18dc25644cc6976f09ff3dfce4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.176409 29277 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1a67b1f91a4f07b9acc926b114d701 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:35.178046 29277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1a67b1f91a4f07b9acc926b114d701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.186425 29055 tablet_service.cc:1511] Processing CreateTablet for tablet f15092329a634992ba6d44f5e89b40db (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:35.188158 29055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15092329a634992ba6d44f5e89b40db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.188515 29052 tablet_service.cc:1511] Processing CreateTablet for tablet faf05148546740429720380b7f235833 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:35.189992 29052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf05148546740429720380b7f235833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.192889 29051 tablet_service.cc:1511] Processing CreateTablet for tablet 245a5b3a66c044189c7a2a2d10db4149 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:35.194519 29051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245a5b3a66c044189c7a2a2d10db4149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.194316 29054 tablet_service.cc:1511] Processing CreateTablet for tablet 26215fc88fd545f290fbaaff9ae467f6 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:35.192889 29053 tablet_service.cc:1511] Processing CreateTablet for tablet ea44e5f06ab7487b85663ead289a65d5 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:35.197062 29053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea44e5f06ab7487b85663ead289a65d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.196877 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 8e39ebaf09f44b5fafafbcc94e7b50a7 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:35.199369 29050 tablet_service.cc:1511] Processing CreateTablet for tablet cbaa18dc25644cc6976f09ff3dfce4f8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:35.200147 29054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26215fc88fd545f290fbaaff9ae467f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.200866 29050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa18dc25644cc6976f09ff3dfce4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.203763 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e39ebaf09f44b5fafafbcc94e7b50a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.209486 29049 tablet_service.cc:1511] Processing CreateTablet for tablet 1973cb4352f14b628c856d7f58cea0da (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:35.210923 29049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1973cb4352f14b628c856d7f58cea0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.214658 29048 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1a67b1f91a4f07b9acc926b114d701 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:35.216015 29048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1a67b1f91a4f07b9acc926b114d701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.225497 29274 tablet_service.cc:1511] Processing CreateTablet for tablet 137ad6a7bad4460bb03ca501e6588a2b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:35.227675 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ad6a7bad4460bb03ca501e6588a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.235584 29336 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:35.241680 29200 tablet_service.cc:1511] Processing CreateTablet for tablet 4f1a67b1f91a4f07b9acc926b114d701 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:35.243253 29200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1a67b1f91a4f07b9acc926b114d701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.249601 29047 tablet_service.cc:1511] Processing CreateTablet for tablet 89fa7dc85da649e3a5c3195b959e3a61 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:35.251098 29047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fa7dc85da649e3a5c3195b959e3a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.253878 29273 tablet_service.cc:1511] Processing CreateTablet for tablet aecf4de06f0641c5bedbc8eb813a7f97 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:35.254281 29132 tablet_service.cc:1511] Processing CreateTablet for tablet f15092329a634992ba6d44f5e89b40db (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:35.253899 29201 tablet_service.cc:1511] Processing CreateTablet for tablet 137ad6a7bad4460bb03ca501e6588a2b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:35.255543 29273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecf4de06f0641c5bedbc8eb813a7f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.256731 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ad6a7bad4460bb03ca501e6588a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.257704 29131 tablet_service.cc:1511] Processing CreateTablet for tablet 26215fc88fd545f290fbaaff9ae467f6 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:35.260596 29130 tablet_service.cc:1511] Processing CreateTablet for tablet 970d5a478a4e490a87a712db238e695c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:35.262306 29132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f15092329a634992ba6d44f5e89b40db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.263041 29131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26215fc88fd545f290fbaaff9ae467f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.264197 29130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 970d5a478a4e490a87a712db238e695c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.270473 29203 tablet_service.cc:1511] Processing CreateTablet for tablet 89fa7dc85da649e3a5c3195b959e3a61 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:35.272149 29203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fa7dc85da649e3a5c3195b959e3a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.288095 29129 tablet_service.cc:1511] Processing CreateTablet for tablet ea44e5f06ab7487b85663ead289a65d5 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:35.289809 29129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea44e5f06ab7487b85663ead289a65d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.293479 29128 tablet_service.cc:1511] Processing CreateTablet for tablet faf05148546740429720380b7f235833 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:35.295042 29128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf05148546740429720380b7f235833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.304718 29337 tablet_bootstrap.cc:492] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
W20260709 12:21:35.309350 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:35.341020 29278 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0254afbe554de5bda48bee078dc4b8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:35.341696 29202 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0254afbe554de5bda48bee078dc4b8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:35.342519 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0254afbe554de5bda48bee078dc4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.343063 29202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0254afbe554de5bda48bee078dc4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.365267 29127 tablet_service.cc:1511] Processing CreateTablet for tablet 8fecfd39d27743c9aec3e98b7f9162b2 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:35.366853 29127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fecfd39d27743c9aec3e98b7f9162b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.369315 29126 tablet_service.cc:1511] Processing CreateTablet for tablet cbaa18dc25644cc6976f09ff3dfce4f8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:35.370719 29126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa18dc25644cc6976f09ff3dfce4f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.373260 29125 tablet_service.cc:1511] Processing CreateTablet for tablet 1973cb4352f14b628c856d7f58cea0da (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:35.374148 29123 tablet_service.cc:1511] Processing CreateTablet for tablet 89fa7dc85da649e3a5c3195b959e3a61 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:35.374728 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1973cb4352f14b628c856d7f58cea0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.376492 29123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89fa7dc85da649e3a5c3195b959e3a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.376983 29124 tablet_service.cc:1511] Processing CreateTablet for tablet 137ad6a7bad4460bb03ca501e6588a2b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:35.378377 29124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ad6a7bad4460bb03ca501e6588a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.402470 29338 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:35.404055 29337 tablet_bootstrap.cc:654] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.403776 29054 tablet_service.cc:1511] Processing CreateTablet for tablet aecf4de06f0641c5bedbc8eb813a7f97 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:35.405321 29054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecf4de06f0641c5bedbc8eb813a7f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.407598 29336 tablet_bootstrap.cc:654] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.418349 29207 tablet_service.cc:1511] Processing CreateTablet for tablet a6f9df47273e4b88bb17fb9d1924c020 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:35.418763 29049 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0254afbe554de5bda48bee078dc4b8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:35.419967 29207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f9df47273e4b88bb17fb9d1924c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.420562 29049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0254afbe554de5bda48bee078dc4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.466882 29125 tablet_service.cc:1511] Processing CreateTablet for tablet aecf4de06f0641c5bedbc8eb813a7f97 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:35.467504 29053 tablet_service.cc:1511] Processing CreateTablet for tablet a11ff826b27146f8b266ae26e03dc775 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:35.469163 29053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ff826b27146f8b266ae26e03dc775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.472306 29057 tablet_service.cc:1511] Processing CreateTablet for tablet d4c2675a26a2453487ff7fa3eb4a4441 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:35.473831 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c2675a26a2453487ff7fa3eb4a4441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.478896 29276 tablet_service.cc:1511] Processing CreateTablet for tablet a6f9df47273e4b88bb17fb9d1924c020 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:35.479283 29279 tablet_service.cc:1511] Processing CreateTablet for tablet d4c2675a26a2453487ff7fa3eb4a4441 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:35.480175 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecf4de06f0641c5bedbc8eb813a7f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.480631 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f9df47273e4b88bb17fb9d1924c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.483237 29279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c2675a26a2453487ff7fa3eb4a4441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.495023 29338 tablet_bootstrap.cc:654] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.497154 29206 tablet_service.cc:1511] Processing CreateTablet for tablet 118990c87a4d480baacf7c25b58229aa (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:35.498770 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118990c87a4d480baacf7c25b58229aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.503356 29126 tablet_service.cc:1511] Processing CreateTablet for tablet a11ff826b27146f8b266ae26e03dc775 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:35.505307 29126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ff826b27146f8b266ae26e03dc775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.506116 29092 heartbeater.cc:499] Master 127.18.132.126:45601 was elected leader, sending a full tablet report...
I20260709 12:21:35.510989 29280 tablet_service.cc:1511] Processing CreateTablet for tablet 118990c87a4d480baacf7c25b58229aa (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:35.512403 29280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118990c87a4d480baacf7c25b58229aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.490823 29123 tablet_service.cc:1511] Processing CreateTablet for tablet a6f9df47273e4b88bb17fb9d1924c020 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:35.518395 29123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f9df47273e4b88bb17fb9d1924c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.518872 29054 tablet_service.cc:1511] Processing CreateTablet for tablet 118990c87a4d480baacf7c25b58229aa (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:35.520393 29054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 118990c87a4d480baacf7c25b58229aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.529168 29128 tablet_service.cc:1511] Processing CreateTablet for tablet d4c2675a26a2453487ff7fa3eb4a4441 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:35.530820 29128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c2675a26a2453487ff7fa3eb4a4441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.536257 29205 tablet_service.cc:1511] Processing CreateTablet for tablet a11ff826b27146f8b266ae26e03dc775 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:35.537734 29205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ff826b27146f8b266ae26e03dc775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.540478 29277 tablet_service.cc:1511] Processing CreateTablet for tablet 504440a1993945c68cb34cd95f8ff39f (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:35.541852 29277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504440a1993945c68cb34cd95f8ff39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.551621 29206 tablet_service.cc:1511] Processing CreateTablet for tablet 504440a1993945c68cb34cd95f8ff39f (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:35.559899 29336 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:35.560493 29336 ts_tablet_manager.cc:1403] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.325s	user 0.006s	sys 0.011s
I20260709 12:21:35.572661 29341 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:35.576205 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504440a1993945c68cb34cd95f8ff39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.572978 29336 raft_consensus.cc:359] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.577427 29336 raft_consensus.cc:385] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.577747 29336 raft_consensus.cc:740] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.578737 29336 consensus_queue.cc:260] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.583863 29125 tablet_service.cc:1511] Processing CreateTablet for tablet 504440a1993945c68cb34cd95f8ff39f (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:35.584685 29052 tablet_service.cc:1511] Processing CreateTablet for tablet 9adb2996f7454cf4821ff6582f680165 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:35.585398 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504440a1993945c68cb34cd95f8ff39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.586020 29052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adb2996f7454cf4821ff6582f680165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.592666 29129 tablet_service.cc:1511] Processing CreateTablet for tablet 9adb2996f7454cf4821ff6582f680165 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:35.594080 29129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adb2996f7454cf4821ff6582f680165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.595297 29278 tablet_service.cc:1511] Processing CreateTablet for tablet fa12ef41f343476a8228cd78fe0db9bb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:35.596737 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa12ef41f343476a8228cd78fe0db9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.596589 29055 tablet_service.cc:1511] Processing CreateTablet for tablet fa12ef41f343476a8228cd78fe0db9bb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:35.597939 29055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa12ef41f343476a8228cd78fe0db9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.599725 29203 tablet_service.cc:1511] Processing CreateTablet for tablet da79a40a6b07437086aa49b0cc2ae9ea (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:35.601091 29203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da79a40a6b07437086aa49b0cc2ae9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.602001 29274 tablet_service.cc:1511] Processing CreateTablet for tablet da79a40a6b07437086aa49b0cc2ae9ea (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:35.603335 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da79a40a6b07437086aa49b0cc2ae9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.606047 29124 tablet_service.cc:1511] Processing CreateTablet for tablet fa12ef41f343476a8228cd78fe0db9bb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:35.621580 29167 heartbeater.cc:499] Master 127.18.132.126:45601 was elected leader, sending a full tablet report...
I20260709 12:21:35.621791 29207 tablet_service.cc:1511] Processing CreateTablet for tablet 9adb2996f7454cf4821ff6582f680165 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:35.623991 29337 tablet_bootstrap.cc:492] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:35.624584 29337 ts_tablet_manager.cc:1403] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.320s	user 0.011s	sys 0.012s
I20260709 12:21:35.619401 29049 tablet_service.cc:1511] Processing CreateTablet for tablet da79a40a6b07437086aa49b0cc2ae9ea (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:35.632464 29049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da79a40a6b07437086aa49b0cc2ae9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.636703 29130 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd34001bec34add96fbddfbb1a9b54a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:35.641722 29337 raft_consensus.cc:359] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:35.642617 29337 raft_consensus.cc:385] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.642921 29337 raft_consensus.cc:740] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.647702 29207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adb2996f7454cf4821ff6582f680165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.660172 29124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa12ef41f343476a8228cd78fe0db9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.661923 29201 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd34001bec34add96fbddfbb1a9b54a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:35.663398 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd34001bec34add96fbddfbb1a9b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.668116 29338 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:35.668694 29338 ts_tablet_manager.cc:1403] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.267s	user 0.020s	sys 0.010s
I20260709 12:21:35.670678 29130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd34001bec34add96fbddfbb1a9b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.672107 29338 raft_consensus.cc:359] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.664877 29337 consensus_queue.cc:260] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:35.672883 29338 raft_consensus.cc:385] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.683316 29276 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd34001bec34add96fbddfbb1a9b54a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:35.684803 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd34001bec34add96fbddfbb1a9b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.689258 29047 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9624100bda4f399b25c0c5fe5206f3 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:35.690649 29047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9624100bda4f399b25c0c5fe5206f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.693224 29341 tablet_bootstrap.cc:654] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.682073 29338 raft_consensus.cc:740] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.712724 29338 consensus_queue.cc:260] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.723148 29242 heartbeater.cc:499] Master 127.18.132.126:45601 was elected leader, sending a full tablet report...
I20260709 12:21:35.742307 29130 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9624100bda4f399b25c0c5fe5206f3 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:35.744215 29130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9624100bda4f399b25c0c5fe5206f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.744868 29206 tablet_service.cc:1511] Processing CreateTablet for tablet 4b9624100bda4f399b25c0c5fe5206f3 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:35.746760 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b9624100bda4f399b25c0c5fe5206f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.760619 29316 heartbeater.cc:499] Master 127.18.132.126:45601 was elected leader, sending a full tablet report...
I20260709 12:21:35.761166 29336 ts_tablet_manager.cc:1434] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.200s	user 0.011s	sys 0.012s
I20260709 12:21:35.762284 29336 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:35.767547 29344 raft_consensus.cc:493] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.760756 29338 ts_tablet_manager.cc:1434] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.001s
I20260709 12:21:35.769822 29336 tablet_bootstrap.cc:654] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.769318 29344 raft_consensus.cc:515] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:35.779633 29341 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:35.780427 29341 ts_tablet_manager.cc:1403] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.208s	user 0.009s	sys 0.009s
I20260709 12:21:35.770586 29338 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:35.785312 29341 raft_consensus.cc:359] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:35.786302 29341 raft_consensus.cc:385] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.786708 29341 raft_consensus.cc:740] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.789076 29276 tablet_service.cc:1511] Processing CreateTablet for tablet 33b994c952494b52b3bd6e1946663c81 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:35.799527 29338 tablet_bootstrap.cc:654] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.799615 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b994c952494b52b3bd6e1946663c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.803609 29346 raft_consensus.cc:493] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.803731 29341 consensus_queue.cc:260] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:35.804217 29346 raft_consensus.cc:515] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.812888 29346 leader_election.cc:290] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
W20260709 12:21:35.818215 29317 tablet.cc:2406] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:35.818848 29337 ts_tablet_manager.cc:1434] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.194s	user 0.040s	sys 0.053s
I20260709 12:21:35.807947 29344 leader_election.cc:290] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:35.821038 29337 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:35.845305 29336 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:35.845999 29336 ts_tablet_manager.cc:1403] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.021s
I20260709 12:21:35.849783 29336 raft_consensus.cc:359] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.850637 29336 raft_consensus.cc:385] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.850993 29336 raft_consensus.cc:740] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.864334 29338 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:35.867131 29205 tablet_service.cc:1511] Processing CreateTablet for tablet 6469c0ade3804810b53702577319456c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:35.875912 29337 tablet_bootstrap.cc:654] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.880813 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:35.909473 29338 ts_tablet_manager.cc:1403] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.007s
I20260709 12:21:35.913300 29205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6469c0ade3804810b53702577319456c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.914856 29278 tablet_service.cc:1511] Processing CreateTablet for tablet 6469c0ade3804810b53702577319456c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 12:21:35.915534 29179 leader_election.cc:343] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.916335 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6469c0ade3804810b53702577319456c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.922048 29338 raft_consensus.cc:359] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:35.923364 29338 raft_consensus.cc:385] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.926225 29338 raft_consensus.cc:740] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.926541 29052 tablet_service.cc:1511] Processing CreateTablet for tablet 33b994c952494b52b3bd6e1946663c81 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:35.927129 29338 consensus_queue.cc:260] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:35.931166 29338 ts_tablet_manager.cc:1434] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:35.932371 29338 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:35.933367 29125 tablet_service.cc:1511] Processing CreateTablet for tablet 33b994c952494b52b3bd6e1946663c81 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:35.934751 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b994c952494b52b3bd6e1946663c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.926240 29336 consensus_queue.cc:260] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.928270 29052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b994c952494b52b3bd6e1946663c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.936918 29341 ts_tablet_manager.cc:1434] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.156s	user 0.011s	sys 0.013s
I20260709 12:21:35.938095 29341 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:35.957496 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:35.960114 29181 leader_election.cc:343] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:35.960664 29181 leader_election.cc:304] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:35.962472 29344 raft_consensus.cc:2749] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:35.966919 29343 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.967639 29343 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.976600 29336 ts_tablet_manager.cc:1434] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.005s
I20260709 12:21:35.978312 29336 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:35.981087 29343 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:35.981873 29343 raft_consensus.cc:493] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:35.982846 29343 raft_consensus.cc:515] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:35.983290 29125 tablet_service.cc:1511] Processing CreateTablet for tablet ad25e9fbcd614e4e9eecbb5dc392c165 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:35.985327 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad25e9fbcd614e4e9eecbb5dc392c165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.986172 29343 leader_election.cc:290] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:36.001113 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:36.005690 29053 tablet_service.cc:1511] Processing CreateTablet for tablet 6469c0ade3804810b53702577319456c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:36.008378 29053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6469c0ade3804810b53702577319456c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.009157 29206 tablet_service.cc:1511] Processing CreateTablet for tablet ad25e9fbcd614e4e9eecbb5dc392c165 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:36.011535 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad25e9fbcd614e4e9eecbb5dc392c165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.013279 29047 tablet_service.cc:1511] Processing CreateTablet for tablet cfbb99959a4d4868936840d4e60bbe83 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:36.014699 29047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbb99959a4d4868936840d4e60bbe83. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.017124 29031 leader_election.cc:343] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.017992 29130 tablet_service.cc:1511] Processing CreateTablet for tablet cfbb99959a4d4868936840d4e60bbe83 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:36.019729 29130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbb99959a4d4868936840d4e60bbe83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.032056 29201 tablet_service.cc:1511] Processing CreateTablet for tablet cfbb99959a4d4868936840d4e60bbe83 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:36.033895 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbb99959a4d4868936840d4e60bbe83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.038847 29346 raft_consensus.cc:493] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.039465 29346 raft_consensus.cc:515] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.041905 29346 leader_election.cc:290] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:36.044133 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:36.045979 29031 leader_election.cc:343] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.051021 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:36.052783 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:36.053683 29338 tablet_bootstrap.cc:654] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:36.054136 29029 leader_election.cc:343] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.054814 29029 leader_election.cc:304] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:36.055914 29346 raft_consensus.cc:2749] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.063918 29055 tablet_service.cc:1511] Processing CreateTablet for tablet aed2c2eff70342fab5e80c4a76ab3593 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:36.065858 29055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed2c2eff70342fab5e80c4a76ab3593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.070185 29354 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.070791 29354 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:36.078812 29124 tablet_service.cc:1511] Processing CreateTablet for tablet aed2c2eff70342fab5e80c4a76ab3593 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:36.080313 29124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed2c2eff70342fab5e80c4a76ab3593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.080250 29354 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
W20260709 12:21:36.072036 29029 leader_election.cc:343] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.082392 29029 leader_election.cc:304] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:36.086403 29341 tablet_bootstrap.cc:654] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.085316 29346 raft_consensus.cc:2749] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.102420 29278 tablet_service.cc:1511] Processing CreateTablet for tablet ad25e9fbcd614e4e9eecbb5dc392c165 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:36.104092 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad25e9fbcd614e4e9eecbb5dc392c165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.114138 29057 tablet_service.cc:1511] Processing CreateTablet for tablet cd03869bf33149b993051af5c8f055eb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:36.115906 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd03869bf33149b993051af5c8f055eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.106642 29336 tablet_bootstrap.cc:654] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.116369 29276 tablet_service.cc:1511] Processing CreateTablet for tablet aed2c2eff70342fab5e80c4a76ab3593 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:36.117718 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed2c2eff70342fab5e80c4a76ab3593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.120965 29207 tablet_service.cc:1511] Processing CreateTablet for tablet cd03869bf33149b993051af5c8f055eb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:36.134068 29338 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:36.134771 29338 ts_tablet_manager.cc:1403] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.203s	user 0.018s	sys 0.008s
I20260709 12:21:36.136361 29337 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:36.136951 29337 ts_tablet_manager.cc:1403] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.317s	user 0.018s	sys 0.051s
I20260709 12:21:36.138463 29338 raft_consensus.cc:359] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.139272 29338 raft_consensus.cc:385] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.139554 29338 raft_consensus.cc:740] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.148350 29338 consensus_queue.cc:260] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.152657 29207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd03869bf33149b993051af5c8f055eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.156075 29337 raft_consensus.cc:359] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.156946 29337 raft_consensus.cc:385] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.157390 29337 raft_consensus.cc:740] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.158303 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:36.157137 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:36.158483 29337 consensus_queue.cc:260] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.161011 29337 ts_tablet_manager.cc:1434] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:21:36.162335 29216 raft_consensus.cc:2468] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
W20260709 12:21:36.165645 29256 leader_election.cc:343] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.192616 29256 leader_election.cc:304] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:36.193742 29360 raft_consensus.cc:2804] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.194186 29360 raft_consensus.cc:493] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.194525 29360 raft_consensus.cc:3060] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.200080 29337 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:36.206466 29360 raft_consensus.cc:515] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.210970 29341 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:36.211730 29341 ts_tablet_manager.cc:1403] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.274s	user 0.016s	sys 0.008s
I20260709 12:21:36.212718 29338 ts_tablet_manager.cc:1434] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.078s	user 0.003s	sys 0.007s
I20260709 12:21:36.221690 29337 tablet_bootstrap.cc:654] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.226248 29205 tablet_service.cc:1511] Processing CreateTablet for tablet 16f61f9c9b39417ca1f74cfa4a80f092 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:36.227165 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:36.227963 29205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f61f9c9b39417ca1f74cfa4a80f092. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.229260 29106 leader_election.cc:343] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.229965 29276 tablet_service.cc:1511] Processing CreateTablet for tablet 16f61f9c9b39417ca1f74cfa4a80f092 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:36.231308 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f61f9c9b39417ca1f74cfa4a80f092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.230995 29338 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:36.232510 29055 tablet_service.cc:1511] Processing CreateTablet for tablet 73311071016949569f4b68732a970667 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:36.230959 29278 tablet_service.cc:1511] Processing CreateTablet for tablet cd03869bf33149b993051af5c8f055eb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:36.234109 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd03869bf33149b993051af5c8f055eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.239079 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:36.239347 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:36.239835 29216 raft_consensus.cc:3060] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.240422 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:36.241155 29065 raft_consensus.cc:3060] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.241174 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:36.215413 29341 raft_consensus.cc:359] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.243631 29341 raft_consensus.cc:385] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:36.243758 29255 leader_election.cc:343] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.244016 29341 raft_consensus.cc:740] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.244359 29255 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:36.244899 29341 consensus_queue.cc:260] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.246188 29343 raft_consensus.cc:2749] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.246178 29360 leader_election.cc:290] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:36.253113 29341 ts_tablet_manager.cc:1434] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
I20260709 12:21:36.254133 29216 raft_consensus.cc:2468] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:36.254460 29341 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:36.255285 29256 leader_election.cc:304] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:36.256261 29360 raft_consensus.cc:2804] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.256963 29360 raft_consensus.cc:697] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:36.256841 29201 tablet_service.cc:1511] Processing CreateTablet for tablet 73311071016949569f4b68732a970667 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:36.258196 29360 consensus_queue.cc:237] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.265146 29125 tablet_service.cc:1511] Processing CreateTablet for tablet 16f61f9c9b39417ca1f74cfa4a80f092 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:36.266484 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f61f9c9b39417ca1f74cfa4a80f092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.258884 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73311071016949569f4b68732a970667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.251849 29055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73311071016949569f4b68732a970667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.261845 29065 raft_consensus.cc:2468] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:36.276700 29274 tablet_service.cc:1511] Processing CreateTablet for tablet b49a4fda120d4293aa6694ed3fb8336e (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:36.278070 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49a4fda120d4293aa6694ed3fb8336e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.296833 29336 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:36.297556 29336 ts_tablet_manager.cc:1403] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.320s	user 0.020s	sys 0.009s
I20260709 12:21:36.298321 29354 raft_consensus.cc:493] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.298921 29354 raft_consensus.cc:515] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.305250 29336 raft_consensus.cc:359] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.306092 29336 raft_consensus.cc:385] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.306406 29336 raft_consensus.cc:740] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.308753 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:36.314817 29354 leader_election.cc:290] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:36.316738 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:36.317517 29065 raft_consensus.cc:2468] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
W20260709 12:21:36.318055 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:36.321967 29106 leader_election.cc:304] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:36.322080 29336 consensus_queue.cc:260] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.323123 29354 raft_consensus.cc:2804] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:36.323053 29047 tablet_service.cc:1511] Processing CreateTablet for tablet b49a4fda120d4293aa6694ed3fb8336e (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:36.323773 29354 raft_consensus.cc:493] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:36.324249 29354 raft_consensus.cc:3060] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.324697 29047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49a4fda120d4293aa6694ed3fb8336e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.327140 29278 tablet_service.cc:1511] Processing CreateTablet for tablet 4719ec61ba174acdbffd0d8a8f691142 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:36.328755 29278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719ec61ba174acdbffd0d8a8f691142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.328931 29336 ts_tablet_manager.cc:1434] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:21:36.330412 29336 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
W20260709 12:21:36.335852 29107 leader_election.cc:343] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.333956 29205 tablet_service.cc:1511] Processing CreateTablet for tablet 4719ec61ba174acdbffd0d8a8f691142 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:36.336439 29107 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:36.337591 29205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719ec61ba174acdbffd0d8a8f691142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.340050 29337 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:36.340615 29337 ts_tablet_manager.cc:1403] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.004s
I20260709 12:21:36.343075 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 4719ec61ba174acdbffd0d8a8f691142 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:36.344340 29337 raft_consensus.cc:359] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:36.346551 29336 tablet_bootstrap.cc:654] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.348127 29341 tablet_bootstrap.cc:654] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.351902 29337 raft_consensus.cc:385] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.353277 29207 tablet_service.cc:1511] Processing CreateTablet for tablet 9548af611b534185ae76fa0d4c896962 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:36.357579 29337 raft_consensus.cc:740] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.359942 29273 tablet_service.cc:1511] Processing CreateTablet for tablet 9548af611b534185ae76fa0d4c896962 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:36.360459 29354 raft_consensus.cc:515] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.361402 29273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9548af611b534185ae76fa0d4c896962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.360543 29337 consensus_queue.cc:260] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:36.364302 29337 ts_tablet_manager.cc:1434] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 12:21:36.364657 29052 tablet_service.cc:1511] Processing CreateTablet for tablet 1b537faf3fa445968eed78c8c6176d0c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:36.365411 29337 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:36.368368 29124 tablet_service.cc:1511] Processing CreateTablet for tablet 73311071016949569f4b68732a970667 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:36.369716 29124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73311071016949569f4b68732a970667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.361402 29207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9548af611b534185ae76fa0d4c896962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.386921 29374 raft_consensus.cc:2749] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.389441 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:36.389760 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719ec61ba174acdbffd0d8a8f691142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.390167 29065 raft_consensus.cc:3060] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.390658 29206 tablet_service.cc:1511] Processing CreateTablet for tablet 1b537faf3fa445968eed78c8c6176d0c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:36.391961 29052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b537faf3fa445968eed78c8c6176d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.392198 29206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b537faf3fa445968eed78c8c6176d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.393988 29354 leader_election.cc:290] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:36.404078 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 83205.6us
I20260709 12:21:36.404258 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:36.405972 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:36.406616 29130 tablet_service.cc:1511] Processing CreateTablet for tablet b49a4fda120d4293aa6694ed3fb8336e (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:36.408124 29130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b49a4fda120d4293aa6694ed3fb8336e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.408190 29105 leader_election.cc:343] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:36.409163 29105 leader_election.cc:343] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.412649 29129 tablet_service.cc:1511] Processing CreateTablet for tablet 9548af611b534185ae76fa0d4c896962 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:36.414057 29129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9548af611b534185ae76fa0d4c896962. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.415235 29336 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:36.415966 29336 ts_tablet_manager.cc:1403] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.002s
I20260709 12:21:36.423638 29053 tablet_service.cc:1511] Processing CreateTablet for tablet 494a1a011a1c49d9845829b1a5858c4a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:36.424811 29338 tablet_bootstrap.cc:654] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.425050 29053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 494a1a011a1c49d9845829b1a5858c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.416610 29128 tablet_service.cc:1511] Processing CreateTablet for tablet 1b537faf3fa445968eed78c8c6176d0c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:36.428438 29128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b537faf3fa445968eed78c8c6176d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.430330 28962 catalog_manager.cc:5697] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:36.432510 29203 tablet_service.cc:1511] Processing CreateTablet for tablet c7496a0c6c1946acad1f4fb97b1ce80b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:36.432961 29127 tablet_service.cc:1511] Processing CreateTablet for tablet 494a1a011a1c49d9845829b1a5858c4a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:36.426448 29336 raft_consensus.cc:359] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.434026 29336 raft_consensus.cc:385] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.434275 29203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7496a0c6c1946acad1f4fb97b1ce80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.434428 29127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 494a1a011a1c49d9845829b1a5858c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.437866 29057 tablet_service.cc:1511] Processing CreateTablet for tablet c7496a0c6c1946acad1f4fb97b1ce80b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:36.434221 29274 tablet_service.cc:1511] Processing CreateTablet for tablet c7496a0c6c1946acad1f4fb97b1ce80b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:36.440440 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7496a0c6c1946acad1f4fb97b1ce80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.440585 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7496a0c6c1946acad1f4fb97b1ce80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.443697 29336 raft_consensus.cc:740] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.435907 29276 tablet_service.cc:1511] Processing CreateTablet for tablet 494a1a011a1c49d9845829b1a5858c4a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:36.447707 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 494a1a011a1c49d9845829b1a5858c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.447155 29336 consensus_queue.cc:260] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.449051 29132 tablet_service.cc:1511] Processing CreateTablet for tablet b1bf6f5ffed54f1fad60a22b102f923d (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:36.450186 29336 ts_tablet_manager.cc:1434] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:21:36.450417 29132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bf6f5ffed54f1fad60a22b102f923d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.464138 29065 raft_consensus.cc:2468] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:36.465649 29106 leader_election.cc:304] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:36.467008 29354 raft_consensus.cc:2804] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.467526 29354 raft_consensus.cc:697] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:36.468062 29280 tablet_service.cc:1511] Processing CreateTablet for tablet b1bf6f5ffed54f1fad60a22b102f923d (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:36.468489 29354 consensus_queue.cc:237] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.470810 29280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bf6f5ffed54f1fad60a22b102f923d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.479984 29336 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:36.486325 29338 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:36.486929 29338 ts_tablet_manager.cc:1403] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.256s	user 0.018s	sys 0.000s
I20260709 12:21:36.501650 29338 raft_consensus.cc:359] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.502489 29338 raft_consensus.cc:385] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.502794 29338 raft_consensus.cc:740] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.505465 29047 tablet_service.cc:1511] Processing CreateTablet for tablet e79910b5e01341aea4d305a8d26211eb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:36.507974 29201 tablet_service.cc:1511] Processing CreateTablet for tablet b1bf6f5ffed54f1fad60a22b102f923d (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:36.509509 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1bf6f5ffed54f1fad60a22b102f923d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.513091 29047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79910b5e01341aea4d305a8d26211eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.520107 29125 tablet_service.cc:1511] Processing CreateTablet for tablet e79910b5e01341aea4d305a8d26211eb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:36.521976 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79910b5e01341aea4d305a8d26211eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.547538 29202 tablet_service.cc:1511] Processing CreateTablet for tablet e79910b5e01341aea4d305a8d26211eb (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:36.549870 29202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79910b5e01341aea4d305a8d26211eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.541093 29336 tablet_bootstrap.cc:654] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.559481 29123 tablet_service.cc:1511] Processing CreateTablet for tablet 98cc247c119e4c099657c60c961aa37d (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:36.561347 29123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cc247c119e4c099657c60c961aa37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.585453 29126 tablet_service.cc:1511] Processing CreateTablet for tablet b774d33d7306413c852622175e13c2cc (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:36.586014 29131 tablet_service.cc:1511] Processing CreateTablet for tablet 3848262912d046ed91ff2b8b5a5ca749 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:36.561148 29274 tablet_service.cc:1511] Processing CreateTablet for tablet 98cc247c119e4c099657c60c961aa37d (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:36.565322 29049 tablet_service.cc:1511] Processing CreateTablet for tablet 98cc247c119e4c099657c60c961aa37d (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:36.588572 29049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cc247c119e4c099657c60c961aa37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.588380 29199 tablet_service.cc:1511] Processing CreateTablet for tablet 092eec00ed674936b54daf8589efe743 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:36.589766 29199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092eec00ed674936b54daf8589efe743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.566574 29200 tablet_service.cc:1511] Processing CreateTablet for tablet 2b638bc90c6b4ca4a599a9104e10af3b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:36.591418 29200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b638bc90c6b4ca4a599a9104e10af3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.591126 29051 tablet_service.cc:1511] Processing CreateTablet for tablet afa3802b77714deab6889b0c74f08f50 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:36.592890 29051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa3802b77714deab6889b0c74f08f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.592796 29198 tablet_service.cc:1511] Processing CreateTablet for tablet afa3802b77714deab6889b0c74f08f50 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:36.594128 29198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa3802b77714deab6889b0c74f08f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.567255 29054 tablet_service.cc:1511] Processing CreateTablet for tablet 2b638bc90c6b4ca4a599a9104e10af3b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:36.596689 29054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b638bc90c6b4ca4a599a9104e10af3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.598178 29337 tablet_bootstrap.cc:654] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.568655 29204 tablet_service.cc:1511] Processing CreateTablet for tablet 9491de7c08e54ace93f8edaaadfff61a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:36.571143 29132 tablet_service.cc:1511] Processing CreateTablet for tablet 9491de7c08e54ace93f8edaaadfff61a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:36.600569 29204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491de7c08e54ace93f8edaaadfff61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.575842 29050 tablet_service.cc:1511] Processing CreateTablet for tablet 092eec00ed674936b54daf8589efe743 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:36.601773 29050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092eec00ed674936b54daf8589efe743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.576856 29279 tablet_service.cc:1511] Processing CreateTablet for tablet 9491de7c08e54ace93f8edaaadfff61a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:36.577979 29360 raft_consensus.cc:493] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.577744 29048 tablet_service.cc:1511] Processing CreateTablet for tablet b774d33d7306413c852622175e13c2cc (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:36.572316 28963 catalog_manager.cc:5697] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:36.582430 29275 tablet_service.cc:1511] Processing CreateTablet for tablet b774d33d7306413c852622175e13c2cc (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:36.582717 29272 tablet_service.cc:1511] Processing CreateTablet for tablet 3848262912d046ed91ff2b8b5a5ca749 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:36.583360 29281 tablet_service.cc:1511] Processing CreateTablet for tablet afa3802b77714deab6889b0c74f08f50 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:36.579027 29277 tablet_service.cc:1511] Processing CreateTablet for tablet 2b638bc90c6b4ca4a599a9104e10af3b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:36.586921 29126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b774d33d7306413c852622175e13c2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.608114 29360 raft_consensus.cc:515] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.612497 29132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491de7c08e54ace93f8edaaadfff61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.614668 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cc247c119e4c099657c60c961aa37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.616381 29048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b774d33d7306413c852622175e13c2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.619153 29275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b774d33d7306413c852622175e13c2cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.619789 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:36.620450 29277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b638bc90c6b4ca4a599a9104e10af3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.620837 29065 raft_consensus.cc:2393] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91fd10ed5c3e47fcb354c51acbe25286 in current term 1: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:36.621155 29272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3848262912d046ed91ff2b8b5a5ca749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.622469 29360 leader_election.cc:290] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:36.623937 29131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3848262912d046ed91ff2b8b5a5ca749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.624598 29279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491de7c08e54ace93f8edaaadfff61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.552721 29338 consensus_queue.cc:260] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.628177 29338 ts_tablet_manager.cc:1434] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.004s
I20260709 12:21:36.635608 29341 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:36.636297 29341 ts_tablet_manager.cc:1403] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.382s	user 0.015s	sys 0.012s
I20260709 12:21:36.648023 29341 raft_consensus.cc:359] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.649026 29341 raft_consensus.cc:385] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.649382 29341 raft_consensus.cc:740] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.648627 29281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa3802b77714deab6889b0c74f08f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.650699 29360 raft_consensus.cc:493] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.661773 29360 raft_consensus.cc:515] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.664132 29360 leader_election.cc:290] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:36.664527 29127 tablet_service.cc:1511] Processing CreateTablet for tablet 092eec00ed674936b54daf8589efe743 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:36.665162 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf05148546740429720380b7f235833" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:36.666239 29127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 092eec00ed674936b54daf8589efe743. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.666853 29255 leader_election.cc:343] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.669875 29055 tablet_service.cc:1511] Processing CreateTablet for tablet 172799b8ec7c4d32905d6b02f0728846 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:36.671379 29055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172799b8ec7c4d32905d6b02f0728846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.691836 29341 consensus_queue.cc:260] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:36.693562 29338 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:36.694605 29341 ts_tablet_manager.cc:1434] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 12:21:36.695919 29341 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:36.710610 29341 tablet_bootstrap.cc:654] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.719520 29338 tablet_bootstrap.cc:654] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.780336 29344 raft_consensus.cc:493] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:36.760187 28949 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 72576.4us
I20260709 12:21:36.791255 29360 consensus_queue.cc:1048] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 12:21:36.813539 28947 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 89441.6us
I20260709 12:21:36.810792 29344 raft_consensus.cc:515] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:36.821674 29344 leader_election.cc:290] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:36.816884 28948 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 81883.9us
I20260709 12:21:36.826700 29343 consensus_queue.cc:1048] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.826788 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 7483cd4c0e99450089e2c3aef8f1524a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:36.828365 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7483cd4c0e99450089e2c3aef8f1524a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.832944 29198 tablet_service.cc:1511] Processing CreateTablet for tablet 172799b8ec7c4d32905d6b02f0728846 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:36.834676 29198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172799b8ec7c4d32905d6b02f0728846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.744544 29203 tablet_service.cc:1511] Processing CreateTablet for tablet 3848262912d046ed91ff2b8b5a5ca749 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:36.866557 29203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3848262912d046ed91ff2b8b5a5ca749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.868116 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:36.884759 29048 tablet_service.cc:1511] Processing CreateTablet for tablet 1c79ddf0b439489197763183ae8553e4 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:36.886348 29048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c79ddf0b439489197763183ae8553e4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.898434 29181 leader_election.cc:343] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.899921 29337 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:36.900586 29337 ts_tablet_manager.cc:1403] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.535s	user 0.018s	sys 0.006s
I20260709 12:21:36.900836 29354 consensus_queue.cc:1048] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:36.905053 29337 raft_consensus.cc:359] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.906045 29337 raft_consensus.cc:385] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.906450 29337 raft_consensus.cc:740] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.907544 29337 consensus_queue.cc:260] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.908082 29132 tablet_service.cc:1511] Processing CreateTablet for tablet 172799b8ec7c4d32905d6b02f0728846 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:36.910060 29132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 172799b8ec7c4d32905d6b02f0728846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.910615 29337 ts_tablet_manager.cc:1434] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 12:21:36.919283 29337 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:36.932161 29341 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:36.933065 29341 ts_tablet_manager.cc:1403] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.237s	user 0.016s	sys 0.008s
I20260709 12:21:36.935279 29337 tablet_bootstrap.cc:654] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.937963 29341 raft_consensus.cc:359] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:36.939064 29341 raft_consensus.cc:385] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.958078 29346 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.962371 29124 tablet_service.cc:1511] Processing CreateTablet for tablet 7483cd4c0e99450089e2c3aef8f1524a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:36.963057 29346 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:36.964257 29274 tablet_service.cc:1511] Processing CreateTablet for tablet 07cf2c0767c14dac861751f1d5d524e8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:36.964973 29198 tablet_service.cc:1511] Processing CreateTablet for tablet 1c79ddf0b439489197763183ae8553e4 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:36.965790 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cf2c0767c14dac861751f1d5d524e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.966334 29198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c79ddf0b439489197763183ae8553e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.958899 29280 tablet_service.cc:1511] Processing CreateTablet for tablet 7483cd4c0e99450089e2c3aef8f1524a (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:36.946417 29341 raft_consensus.cc:740] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.969677 29280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7483cd4c0e99450089e2c3aef8f1524a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.975236 29346 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:36.972800 29336 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:36.976002 29336 ts_tablet_manager.cc:1403] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.525s	user 0.025s	sys 0.015s
I20260709 12:21:36.980209 29124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7483cd4c0e99450089e2c3aef8f1524a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.976058 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:36.984527 29291 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:36.986178 29029 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.001101 29346 raft_consensus.cc:2804] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.016742 29346 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.017190 29346 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.025187 29123 tablet_service.cc:1511] Processing CreateTablet for tablet 07cf2c0767c14dac861751f1d5d524e8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:37.026701 29123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cf2c0767c14dac861751f1d5d524e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.028713 29200 tablet_service.cc:1511] Processing CreateTablet for tablet 07cf2c0767c14dac861751f1d5d524e8 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:37.030148 29200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07cf2c0767c14dac861751f1d5d524e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.028419 29275 tablet_service.cc:1511] Processing CreateTablet for tablet 1c79ddf0b439489197763183ae8553e4 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:37.040841 29275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c79ddf0b439489197763183ae8553e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.041160 29336 raft_consensus.cc:359] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.041975 29336 raft_consensus.cc:385] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.055099 29291 raft_consensus.cc:3060] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.052116 29336 raft_consensus.cc:740] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.070919 29054 tablet_service.cc:1511] Processing CreateTablet for tablet f8fffd97d1134dc9addffe91d5d5e5d4 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:37.072521 29054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fffd97d1134dc9addffe91d5d5e5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.073855 29338 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.080951 29336 consensus_queue.cc:260] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.006628 29341 consensus_queue.cc:260] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.087714 29338 ts_tablet_manager.cc:1403] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.432s	user 0.017s	sys 0.004s
I20260709 12:21:37.109453 29338 raft_consensus.cc:359] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.110343 29338 raft_consensus.cc:385] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.110646 29338 raft_consensus.cc:740] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.095551 29125 tablet_service.cc:1511] Processing CreateTablet for tablet f8fffd97d1134dc9addffe91d5d5e5d4 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:37.118542 29125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fffd97d1134dc9addffe91d5d5e5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.100451 29346 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.120625 29204 tablet_service.cc:1511] Processing CreateTablet for tablet f8fffd97d1134dc9addffe91d5d5e5d4 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:37.122035 29204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fffd97d1134dc9addffe91d5d5e5d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.124444 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:37.125186 29290 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.129040 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.111548 29338 consensus_queue.cc:260] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.130884 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf05148546740429720380b7f235833" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.132072 29141 raft_consensus.cc:2468] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:37.133672 29256 leader_election.cc:304] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.135022 29256 leader_election.cc:304] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.151043 29336 ts_tablet_manager.cc:1434] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.175s	user 0.012s	sys 0.006s
I20260709 12:21:37.152340 29336 tablet_bootstrap.cc:492] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.169045 29057 tablet_service.cc:1511] Processing CreateTablet for tablet 341064dd172e4bfc87467b2395fcad6b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:37.162989 29360 raft_consensus.cc:2749] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.170509 29057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341064dd172e4bfc87467b2395fcad6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.155505 29272 tablet_service.cc:1511] Processing CreateTablet for tablet 341064dd172e4bfc87467b2395fcad6b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:37.176349 29272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341064dd172e4bfc87467b2395fcad6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.180490 29398 consensus_queue.cc:1048] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.157985 29346 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.196880 29201 tablet_service.cc:1511] Processing CreateTablet for tablet 5ecfc448993b45138c2cda5213e934c1 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:37.198428 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecfc448993b45138c2cda5213e934c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.198563 29337 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:37.199208 29337 ts_tablet_manager.cc:1403] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.280s	user 0.009s	sys 0.019s
I20260709 12:21:37.199623 29274 tablet_service.cc:1511] Processing CreateTablet for tablet 5ecfc448993b45138c2cda5213e934c1 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:37.201072 29274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecfc448993b45138c2cda5213e934c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.203610 29048 tablet_service.cc:1511] Processing CreateTablet for tablet 5ecfc448993b45138c2cda5213e934c1 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:37.205055 29048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ecfc448993b45138c2cda5213e934c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.216958 29336 tablet_bootstrap.cc:654] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.217702 29127 tablet_service.cc:1511] Processing CreateTablet for tablet 58c070504fe245aba727845758bbca34 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:37.241216 29127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c070504fe245aba727845758bbca34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.243753 29337 raft_consensus.cc:359] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.244575 29337 raft_consensus.cc:385] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.244886 29337 raft_consensus.cc:740] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.203658 29123 tablet_service.cc:1511] Processing CreateTablet for tablet 341064dd172e4bfc87467b2395fcad6b (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:37.248485 29123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341064dd172e4bfc87467b2395fcad6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.221982 29290 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:37.259236 29029 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.259267 29049 tablet_service.cc:1511] Processing CreateTablet for tablet a2294d7212b244ba80173c04a7ae214e (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:37.222609 29401 raft_consensus.cc:2804] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.223377 29344 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.226007 29203 tablet_service.cc:1511] Processing CreateTablet for tablet 58c070504fe245aba727845758bbca34 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:37.260867 29049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2294d7212b244ba80173c04a7ae214e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.260789 29344 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.261459 29203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c070504fe245aba727845758bbca34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.262372 29124 tablet_service.cc:1511] Processing CreateTablet for tablet a2294d7212b244ba80173c04a7ae214e (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:37.263130 29344 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:37.263731 29124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2294d7212b244ba80173c04a7ae214e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.227308 29281 tablet_service.cc:1511] Processing CreateTablet for tablet 58c070504fe245aba727845758bbca34 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:37.264904 29281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c070504fe245aba727845758bbca34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.267792 29346 raft_consensus.cc:2804] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.268095 29401 raft_consensus.cc:493] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.268671 29401 raft_consensus.cc:3060] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.269147 29346 raft_consensus.cc:697] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:37.270182 29346 consensus_queue.cc:237] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.272480 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.233254 29338 ts_tablet_manager.cc:1434] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.001s
I20260709 12:21:37.236794 29406 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.276024 29406 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.276778 29338 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:37.277056 29201 tablet_service.cc:1511] Processing CreateTablet for tablet a2294d7212b244ba80173c04a7ae214e (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:37.237787 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.278517 29201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2294d7212b244ba80173c04a7ae214e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.279868 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:37.281387 29106 leader_election.cc:343] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.282788 29406 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
W20260709 12:21:37.239766 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 65114.2us
I20260709 12:21:37.283370 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:37.284565 29290 raft_consensus.cc:2393] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:37.285813 29179 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.283456 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:37.288214 29180 leader_election.cc:343] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.288727 29180 leader_election.cc:304] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.290125 29276 tablet_service.cc:1511] Processing CreateTablet for tablet b67bcd4012bb45829241ae1389b6afa3 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:37.292042 29276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67bcd4012bb45829241ae1389b6afa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.291678 29054 tablet_service.cc:1511] Processing CreateTablet for tablet b67bcd4012bb45829241ae1389b6afa3 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:37.293241 29054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67bcd4012bb45829241ae1389b6afa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.300171 29131 tablet_service.cc:1511] Processing CreateTablet for tablet b67bcd4012bb45829241ae1389b6afa3 (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:37.302114 29131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67bcd4012bb45829241ae1389b6afa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.308393 29413 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.309003 29107 leader_election.cc:343] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.309257 29404 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.309592 29107 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.309864 29404 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.311347 29408 raft_consensus.cc:2749] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.312356 29404 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.314550 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.315306 29141 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:37.316231 29198 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5356a7d1c64926aeed795d25f96c0c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:37.316738 29031 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.318459 29404 raft_consensus.cc:2804] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.318965 29404 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.319423 29404 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.321095 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:37.324007 29198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5356a7d1c64926aeed795d25f96c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.324888 29279 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5356a7d1c64926aeed795d25f96c0c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:37.326241 29279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5356a7d1c64926aeed795d25f96c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.329413 29051 tablet_service.cc:1511] Processing CreateTablet for tablet 7d5356a7d1c64926aeed795d25f96c0c (DEFAULT_TABLE table=test-workload [id=a4b05c88603149b18319870992af1ce2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:37.330734 29051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5356a7d1c64926aeed795d25f96c0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.336699 29413 raft_consensus.cc:2749] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.337453 29413 raft_consensus.cc:2749] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.337836 29336 tablet_bootstrap.cc:492] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:37.338469 29336 ts_tablet_manager.cc:1403] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.186s	user 0.007s	sys 0.004s
I20260709 12:21:37.350863 29341 ts_tablet_manager.cc:1434] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.417s	user 0.017s	sys 0.006s
I20260709 12:21:37.361675 29401 raft_consensus.cc:515] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.362025 29404 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.364117 29404 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.364945 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf05148546740429720380b7f235833" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:37.366180 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:37.366556 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf05148546740429720380b7f235833" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:37.366829 29142 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.367236 29141 raft_consensus.cc:3060] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.373171 29255 leader_election.cc:343] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.377557 29142 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:37.378783 29031 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.379453 29338 tablet_bootstrap.cc:654] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.379755 29404 raft_consensus.cc:2804] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.380532 29404 raft_consensus.cc:697] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:37.381495 29404 consensus_queue.cc:237] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.352214 29341 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:37.358566 29337 consensus_queue.cc:260] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.401078 29344 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.401825 29344 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.380529 29141 raft_consensus.cc:2468] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:37.414732 29337 ts_tablet_manager.cc:1434] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.215s	user 0.009s	sys 0.000s
I20260709 12:21:37.415930 29337 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:37.400650 28960 catalog_manager.cc:5697] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.364130 29401 leader_election.cc:290] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:37.426540 29256 leader_election.cc:304] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.427923 29360 raft_consensus.cc:2804] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.428464 29360 raft_consensus.cc:697] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:37.429382 29360 consensus_queue.cc:237] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:37.408761 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 123053us
I20260709 12:21:37.434652 29336 raft_consensus.cc:359] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.438938 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:37.439535 29337 tablet_bootstrap.cc:654] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.442085 29338 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.440955 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:37.475147 29344 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:37.475776 29214 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.480197 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.440466 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.483620 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.484886 29141 raft_consensus.cc:2393] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:37.442337 29400 raft_consensus.cc:493] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.486006 29400 raft_consensus.cc:515] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.488550 29181 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.440012 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.491902 29400 leader_election.cc:290] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:37.492985 29338 ts_tablet_manager.cc:1403] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.217s	user 0.015s	sys 0.002s
I20260709 12:21:37.496600 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1a67b1f91a4f07b9acc926b114d701" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.497558 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1a67b1f91a4f07b9acc926b114d701" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.461318 29336 raft_consensus.cc:385] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.498642 29336 raft_consensus.cc:740] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
W20260709 12:21:37.499532 29255 leader_election.cc:343] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:37.501547 29256 leader_election.cc:343] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.500110 29336 consensus_queue.cc:260] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.515455 29336 ts_tablet_manager.cc:1434] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.177s	user 0.010s	sys 0.002s
I20260709 12:21:37.504922 29256 leader_election.cc:304] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:37.520787 29360 raft_consensus.cc:2749] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.503522 29338 raft_consensus.cc:359] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.527542 29341 tablet_bootstrap.cc:654] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.528537 29336 tablet_bootstrap.cc:492] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.530651 29214 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:37.531258 29344 raft_consensus.cc:2749] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.531939 29217 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:37.523480 29338 raft_consensus.cc:385] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.537585 29338 raft_consensus.cc:740] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.538582 29338 consensus_queue.cc:260] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.535364 28961 catalog_manager.cc:5697] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.540154 29337 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:37.540746 29337 ts_tablet_manager.cc:1403] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.002s
I20260709 12:21:37.541131 29338 ts_tablet_manager.cc:1434] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 12:21:37.540745 28960 catalog_manager.cc:5697] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.544433 29337 raft_consensus.cc:359] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.545228 29337 raft_consensus.cc:385] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.545549 29337 raft_consensus.cc:740] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.546475 29337 consensus_queue.cc:260] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.549026 29337 ts_tablet_manager.cc:1434] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:21:37.552356 29336 tablet_bootstrap.cc:654] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.542346 29338 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:37.556272 29337 tablet_bootstrap.cc:492] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:37.567202 29341 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:37.567904 29341 ts_tablet_manager.cc:1403] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.216s	user 0.019s	sys 0.005s
I20260709 12:21:37.571416 29341 raft_consensus.cc:359] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.572340 29341 raft_consensus.cc:385] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.572688 29338 tablet_bootstrap.cc:654] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.572688 29341 raft_consensus.cc:740] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.573915 29341 consensus_queue.cc:260] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.576053 29337 tablet_bootstrap.cc:654] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.587415 29341 ts_tablet_manager.cc:1434] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:21:37.603960 29341 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:37.612084 29336 tablet_bootstrap.cc:492] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:37.612084 29338 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.612144 29337 tablet_bootstrap.cc:492] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:37.613092 29336 ts_tablet_manager.cc:1403] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.040s
I20260709 12:21:37.613241 29338 ts_tablet_manager.cc:1403] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.071s	user 0.030s	sys 0.018s
I20260709 12:21:37.613353 29337 ts_tablet_manager.cc:1403] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.019s
I20260709 12:21:37.613469 29341 tablet_bootstrap.cc:654] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.616570 29336 raft_consensus.cc:359] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.617409 29336 raft_consensus.cc:385] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.617113 29338 raft_consensus.cc:359] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.617776 29336 raft_consensus.cc:740] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.618126 29338 raft_consensus.cc:385] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.617674 29337 raft_consensus.cc:359] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.618602 29338 raft_consensus.cc:740] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.619069 29337 raft_consensus.cc:385] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.619098 29336 consensus_queue.cc:260] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.619704 29337 raft_consensus.cc:740] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.619800 29338 consensus_queue.cc:260] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.622911 29338 ts_tablet_manager.cc:1434] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:21:37.623493 29337 consensus_queue.cc:260] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.624956 29338 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:37.629241 29336 ts_tablet_manager.cc:1434] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:21:37.630508 29336 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.630956 29360 raft_consensus.cc:493] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.631511 29360 raft_consensus.cc:515] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.632794 29338 tablet_bootstrap.cc:654] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.633915 29360 leader_election.cc:290] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.636581 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.636708 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.637663 29214 raft_consensus.cc:2468] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
W20260709 12:21:37.638319 29256 leader_election.cc:343] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.639150 29256 leader_election.cc:304] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:37.642122 29336 tablet_bootstrap.cc:654] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.645201 29338 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.645964 29338 ts_tablet_manager.cc:1403] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:21:37.646292 29360 raft_consensus.cc:2804] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.646726 29360 raft_consensus.cc:493] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.647085 29360 raft_consensus.cc:3060] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.650004 29338 raft_consensus.cc:359] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.651059 29338 raft_consensus.cc:385] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.647123 29337 ts_tablet_manager.cc:1434] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:21:37.651458 29338 raft_consensus.cc:740] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.652670 29337 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:37.652684 29338 consensus_queue.cc:260] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.654088 29336 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:37.654583 29336 ts_tablet_manager.cc:1403] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:21:37.655701 29338 ts_tablet_manager.cc:1434] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:37.656764 29338 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:37.657639 29336 raft_consensus.cc:359] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.658327 29336 raft_consensus.cc:385] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.658596 29336 raft_consensus.cc:740] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.658753 29360 raft_consensus.cc:515] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.662072 29360 leader_election.cc:290] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.659525 29336 consensus_queue.cc:260] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.662823 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:37.664371 29338 tablet_bootstrap.cc:654] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.664803 29336 ts_tablet_manager.cc:1434] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:21:37.665468 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:37.665858 29336 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.666126 29214 raft_consensus.cc:3060] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.666931 29337 tablet_bootstrap.cc:654] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:37.671995 29256 leader_election.cc:343] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.674988 29336 tablet_bootstrap.cc:654] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.689040 29214 raft_consensus.cc:2468] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:37.690824 29256 leader_election.cc:304] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:37.692754 29360 raft_consensus.cc:2804] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.694125 29360 raft_consensus.cc:697] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:37.695518 29360 consensus_queue.cc:237] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.696621 29341 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:37.696837 29336 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:37.697116 29337 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:37.697391 29341 ts_tablet_manager.cc:1403] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.025s
I20260709 12:21:37.697463 29336 ts_tablet_manager.cc:1403] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.000s
I20260709 12:21:37.700014 29338 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.700618 29338 ts_tablet_manager.cc:1403] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.005s
I20260709 12:21:37.701077 29336 raft_consensus.cc:359] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.701823 29336 raft_consensus.cc:385] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.702093 29336 raft_consensus.cc:740] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.697654 29337 ts_tablet_manager.cc:1403] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.003s
I20260709 12:21:37.703667 29338 raft_consensus.cc:359] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.704375 29338 raft_consensus.cc:385] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.704633 29338 raft_consensus.cc:740] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.705027 28963 catalog_manager.cc:5697] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.705310 29338 consensus_queue.cc:260] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.705515 29337 raft_consensus.cc:359] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.706125 29337 raft_consensus.cc:385] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.706404 29337 raft_consensus.cc:740] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.707093 29337 consensus_queue.cc:260] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.708637 29336 consensus_queue.cc:260] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.710815 29336 ts_tablet_manager.cc:1434] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:21:37.711761 29336 tablet_bootstrap.cc:492] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.713914 29404 consensus_queue.cc:1048] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.717592 29338 ts_tablet_manager.cc:1434] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:37.719820 29337 ts_tablet_manager.cc:1434] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:21:37.720860 29337 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:37.723152 29341 raft_consensus.cc:359] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.723974 29341 raft_consensus.cc:385] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.724332 29341 raft_consensus.cc:740] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.725173 29341 consensus_queue.cc:260] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.728312 29336 tablet_bootstrap.cc:654] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.729089 29338 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:37.727463 29337 tablet_bootstrap.cc:654] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.731752 29341 ts_tablet_manager.cc:1434] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:21:37.735527 29341 tablet_bootstrap.cc:492] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:37.741904 29338 tablet_bootstrap.cc:654] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.742635 29341 tablet_bootstrap.cc:654] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.768936 29404 raft_consensus.cc:493] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.769515 29404 raft_consensus.cc:515] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.771693 29398 raft_consensus.cc:493] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.772400 29398 raft_consensus.cc:515] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.776459 29404 leader_election.cc:290] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:37.777701 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:37.778644 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.778892 29291 raft_consensus.cc:2468] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:37.779495 29214 raft_consensus.cc:2468] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:37.780429 29029 leader_election.cc:304] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.777540 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.778165 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.781088 29107 leader_election.cc:304] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:37.781528 29065 raft_consensus.cc:2468] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:37.782297 29406 raft_consensus.cc:2804] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:37.782485 29031 leader_election.cc:343] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.782827 29406 raft_consensus.cc:493] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.783274 29406 raft_consensus.cc:3060] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.782429 29404 raft_consensus.cc:2804] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.785642 29404 raft_consensus.cc:493] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.786031 29404 raft_consensus.cc:3060] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.786619 29336 tablet_bootstrap.cc:492] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:37.787214 29336 ts_tablet_manager.cc:1403] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.016s
I20260709 12:21:37.790092 29398 leader_election.cc:290] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.790472 29336 raft_consensus.cc:359] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.791153 29336 raft_consensus.cc:385] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.791440 29336 raft_consensus.cc:740] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.792223 29336 consensus_queue.cc:260] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.794553 29336 ts_tablet_manager.cc:1434] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:37.795552 29336 tablet_bootstrap.cc:492] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.795881 29406 raft_consensus.cc:515] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.796451 29404 raft_consensus.cc:515] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.798579 29337 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:37.798768 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:37.799118 29337 ts_tablet_manager.cc:1403] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.009s
I20260709 12:21:37.799355 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
W20260709 12:21:37.800908 29031 leader_election.cc:343] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.802201 29337 raft_consensus.cc:359] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.802891 29337 raft_consensus.cc:385] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.803179 29337 raft_consensus.cc:740] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.803951 29337 consensus_queue.cc:260] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.799379 29065 raft_consensus.cc:3060] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.806174 29337 ts_tablet_manager.cc:1434] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:21:37.807143 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:37.807723 29214 raft_consensus.cc:3060] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.807447 29337 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:37.813344 29065 raft_consensus.cc:2468] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:37.814359 29404 leader_election.cc:290] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:37.815673 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:37.814625 29106 leader_election.cc:304] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.815943 29404 consensus_queue.cc:1048] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:37.821259 29398 raft_consensus.cc:2804] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.821825 29398 raft_consensus.cc:697] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:37.821969 29341 tablet_bootstrap.cc:492] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:37.822624 29341 ts_tablet_manager.cc:1403] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.003s
I20260709 12:21:37.822929 29344 raft_consensus.cc:493] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.823897 29291 raft_consensus.cc:3060] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.824245 29337 tablet_bootstrap.cc:654] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.826279 29412 raft_consensus.cc:493] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.820611 29336 tablet_bootstrap.cc:654] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.826469 29341 raft_consensus.cc:359] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.826838 29412 raft_consensus.cc:515] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.817081 29214 raft_consensus.cc:2468] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:37.819443 29338 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.829344 29412 leader_election.cc:290] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:37.829581 29338 ts_tablet_manager.cc:1403] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.006s
I20260709 12:21:37.823436 29344 raft_consensus.cc:515] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.830649 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:37.831091 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.831391 29289 raft_consensus.cc:2468] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:37.832674 29344 leader_election.cc:290] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:37.833504 29181 leader_election.cc:343] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.833976 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1a67b1f91a4f07b9acc926b114d701" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:37.834333 29179 leader_election.cc:304] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:37.834687 29289 raft_consensus.cc:2468] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:37.822795 29398 consensus_queue.cc:237] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.836699 29344 raft_consensus.cc:2804] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.837091 29344 raft_consensus.cc:493] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.837433 29344 raft_consensus.cc:3060] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.836050 29179 leader_election.cc:304] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:37.839280 29412 raft_consensus.cc:2804] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.819628 29406 leader_election.cc:290] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.839754 29412 raft_consensus.cc:493] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.840452 29412 raft_consensus.cc:3060] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.841817 29338 raft_consensus.cc:359] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.842643 29338 raft_consensus.cc:385] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.842959 29338 raft_consensus.cc:740] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.846011 29338 consensus_queue.cc:260] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.846818 29336 tablet_bootstrap.cc:492] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:37.847429 29336 ts_tablet_manager.cc:1403] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.009s
I20260709 12:21:37.848342 29338 ts_tablet_manager.cc:1434] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:37.850838 29337 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:37.850751 29336 raft_consensus.cc:359] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.827250 29341 raft_consensus.cc:385] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.856426 29341 raft_consensus.cc:740] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.851418 29337 ts_tablet_manager.cc:1403] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.006s
I20260709 12:21:37.851768 29336 raft_consensus.cc:385] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.857890 29412 raft_consensus.cc:515] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.851980 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1a67b1f91a4f07b9acc926b114d701" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.852466 29338 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:37.858857 29336 raft_consensus.cc:740] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.859843 29336 consensus_queue.cc:260] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.862819 29341 consensus_queue.cc:260] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.865414 29338 tablet_bootstrap.cc:654] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.865048 29337 raft_consensus.cc:359] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.864961 29346 consensus_queue.cc:1048] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.865888 29337 raft_consensus.cc:385] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.866206 29337 raft_consensus.cc:740] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.869692 29341 ts_tablet_manager.cc:1434] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.004s
I20260709 12:21:37.870988 29065 raft_consensus.cc:2468] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:37.857738 29344 raft_consensus.cc:515] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.880265 29341 tablet_bootstrap.cc:492] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:37.881331 29344 leader_election.cc:290] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:37.883185 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:37.883364 29337 consensus_queue.cc:260] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.851295 29291 raft_consensus.cc:2468] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
W20260709 12:21:37.885573 29181 leader_election.cc:343] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.886299 29029 leader_election.cc:304] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:37.887526 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:37.887923 29346 raft_consensus.cc:2804] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.888312 29290 raft_consensus.cc:3060] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.888659 29346 raft_consensus.cc:697] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:37.889485 29336 ts_tablet_manager.cc:1434] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:21:37.890640 29336 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:37.889881 29346 consensus_queue.cc:237] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.898671 29404 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.899292 29337 ts_tablet_manager.cc:1434] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:21:37.899325 29404 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.902004 29337 tablet_bootstrap.cc:492] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:37.903903 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.904332 29404 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.904639 29141 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:37.906262 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.906996 29217 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:37.908726 29031 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:37.910158 29404 raft_consensus.cc:2804] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.910542 29404 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.910902 29404 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.915333 29255 consensus_peers.cc:597] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.917930 29341 tablet_bootstrap.cc:654] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.918325 29290 raft_consensus.cc:2468] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:37.919214 29337 tablet_bootstrap.cc:654] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.912642 28961 catalog_manager.cc:5697] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.928211 29179 leader_election.cc:304] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:37.929523 29344 raft_consensus.cc:2804] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.930037 29344 raft_consensus.cc:697] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:37.930912 29344 consensus_queue.cc:237] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.935964 28960 catalog_manager.cc:5697] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.940559 29412 leader_election.cc:290] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:37.947993 29346 consensus_queue.cc:1048] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.948194 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1a67b1f91a4f07b9acc926b114d701" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:37.948793 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f1a67b1f91a4f07b9acc926b114d701" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:37.949025 29290 raft_consensus.cc:3060] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.949420 29065 raft_consensus.cc:3060] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.964051 29398 raft_consensus.cc:493] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.964583 29346 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.964628 29398 raft_consensus.cc:515] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:37.965178 29346 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.968307 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:37.968518 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ad6a7bad4460bb03ca501e6588a2b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:37.969367 29289 raft_consensus.cc:2468] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
W20260709 12:21:37.970021 29029 leader_election.cc:343] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.972004 29398 leader_election.cc:290] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:37.972295 29105 leader_election.cc:304] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:37.973102 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ad6a7bad4460bb03ca501e6588a2b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:37.973433 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:37.974121 29142 raft_consensus.cc:2468] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
W20260709 12:21:37.975044 29107 leader_election.cc:343] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.975387 29031 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:37.976363 29398 raft_consensus.cc:2804] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.976761 29398 raft_consensus.cc:493] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.977123 29398 raft_consensus.cc:3060] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.977415 29290 raft_consensus.cc:2468] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:37.978677 29179 leader_election.cc:304] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:37.979592 29412 raft_consensus.cc:2804] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.980418 29412 raft_consensus.cc:697] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:37.981371 29412 consensus_queue.cc:237] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:37.982473 29338 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:37.982992 29338 ts_tablet_manager.cc:1403] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.131s	user 0.029s	sys 0.012s
I20260709 12:21:37.985930 29338 raft_consensus.cc:359] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:37.986672 29338 raft_consensus.cc:385] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.986953 29338 raft_consensus.cc:740] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.986267 28961 catalog_manager.cc:5697] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.987673 29346 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:37.988392 29065 raft_consensus.cc:2468] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:37.988564 29346 raft_consensus.cc:2804] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.982033 29336 tablet_bootstrap.cc:654] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.989955 29344 raft_consensus.cc:493] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.979336 29404 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.994659 29344 raft_consensus.cc:515] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:37.996873 29404 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:37.996997 29344 leader_election.cc:290] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:37.992357 29341 tablet_bootstrap.cc:492] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:37.994262 29346 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.997785 29346 raft_consensus.cc:3060] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.997905 29341 ts_tablet_manager.cc:1403] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.002s
I20260709 12:21:37.998298 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:37.998974 29214 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.000252 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:37.998904 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:38.001482 29341 raft_consensus.cc:359] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
W20260709 12:21:38.003911 29180 leader_election.cc:343] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.003964 29140 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.004331 29341 raft_consensus.cc:385] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.004761 29341 raft_consensus.cc:740] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.997941 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:38.007851 29181 leader_election.cc:343] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.008332 29181 leader_election.cc:304] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:38.009495 29344 raft_consensus.cc:2749] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.009631 29338 consensus_queue.cc:260] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.012156 29338 ts_tablet_manager.cc:1434] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 12:21:38.012058 29444 raft_consensus.cc:493] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.013279 29338 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:38.013411 29341 consensus_queue.cc:260] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.013971 29444 raft_consensus.cc:515] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.019665 29341 ts_tablet_manager.cc:1434] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:21:38.021116 29341 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:38.022100 29360 consensus_queue.cc:1048] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.022603 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.023245 29444 leader_election.cc:290] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
W20260709 12:21:38.024127 29031 leader_election.cc:343] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.024646 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.025489 29290 raft_consensus.cc:2468] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:38.027907 29341 tablet_bootstrap.cc:654] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.027740 29029 leader_election.cc:304] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:38.033304 29214 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:38.035415 29031 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:38.037402 29404 raft_consensus.cc:2804] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.037900 29404 raft_consensus.cc:493] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.038336 29404 raft_consensus.cc:3060] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.034747 29140 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:38.041451 29406 raft_consensus.cc:493] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.041947 29406 raft_consensus.cc:515] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.042933 29398 raft_consensus.cc:515] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.045434 29406 leader_election.cc:290] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.047014 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.048979 29338 tablet_bootstrap.cc:654] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.049085 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ad6a7bad4460bb03ca501e6588a2b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
W20260709 12:21:38.051244 29107 leader_election.cc:343] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.052735 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.055814 29214 raft_consensus.cc:2393] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cf7766f7e944f41837fd8aa8bde0018 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:38.056223 29398 leader_election.cc:290] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.056999 29107 leader_election.cc:304] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:38.057695 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ad6a7bad4460bb03ca501e6588a2b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.058106 29398 raft_consensus.cc:3060] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.058462 29290 raft_consensus.cc:3060] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.062441 29404 raft_consensus.cc:515] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.065073 29404 leader_election.cc:290] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.065625 29404 raft_consensus.cc:2804] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.066107 29404 raft_consensus.cc:697] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:38.066686 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.067324 29289 raft_consensus.cc:3060] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.070981 29337 tablet_bootstrap.cc:492] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:38.071556 29337 ts_tablet_manager.cc:1403] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.020s
I20260709 12:21:38.077919 29336 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:38.078557 29336 ts_tablet_manager.cc:1403] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.188s	user 0.010s	sys 0.011s
I20260709 12:21:38.071969 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:38.081787 29346 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.086103 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.086176 29336 raft_consensus.cc:359] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.086553 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:38.086978 29336 raft_consensus.cc:385] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.087271 29140 raft_consensus.cc:3060] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.087707 29029 leader_election.cc:343] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.087306 29336 raft_consensus.cc:740] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.089231 29336 consensus_queue.cc:260] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:38.091528 29031 leader_election.cc:343] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.095381 29289 raft_consensus.cc:2468] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:38.097288 29029 leader_election.cc:304] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:38.089895 29346 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:38.098634 29444 raft_consensus.cc:2804] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.099161 29444 raft_consensus.cc:697] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:38.100723 29140 raft_consensus.cc:2468] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:38.100993 29336 ts_tablet_manager.cc:1434] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:21:38.101367 29444 consensus_queue.cc:237] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.102986 29290 raft_consensus.cc:2468] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:38.066962 29404 consensus_queue.cc:237] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.104421 29336 tablet_bootstrap.cc:492] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:38.106860 29105 leader_election.cc:304] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:38.107760 29408 raft_consensus.cc:2804] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.109040 29337 raft_consensus.cc:359] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.109732 29337 raft_consensus.cc:385] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.110005 29337 raft_consensus.cc:740] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.110731 29337 consensus_queue.cc:260] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.112653 29341 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:38.113145 29341 ts_tablet_manager.cc:1403] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.024s
I20260709 12:21:38.110548 29031 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:38.117594 29346 raft_consensus.cc:2804] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.120198 29337 ts_tablet_manager.cc:1434] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 12:21:38.119450 29346 raft_consensus.cc:697] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:38.126051 28959 catalog_manager.cc:5697] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.129144 29336 tablet_bootstrap.cc:654] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.130468 29346 consensus_queue.cc:237] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.132947 29338 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:38.133570 29338 ts_tablet_manager.cc:1403] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.003s
I20260709 12:21:38.135087 29337 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:38.137256 29338 raft_consensus.cc:359] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.138025 29338 raft_consensus.cc:385] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.138358 29338 raft_consensus.cc:740] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.139251 29338 consensus_queue.cc:260] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.130461 29341 raft_consensus.cc:359] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.140493 29341 raft_consensus.cc:385] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.140808 29341 raft_consensus.cc:740] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.141594 29341 consensus_queue.cc:260] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.143671 29408 raft_consensus.cc:697] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:38.140935 29398 raft_consensus.cc:2749] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.144600 29408 consensus_queue.cc:237] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.146042 29338 ts_tablet_manager.cc:1434] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:38.147229 29338 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:38.152325 29341 ts_tablet_manager.cc:1434] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:21:38.157642 29338 tablet_bootstrap.cc:654] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.160528 29341 tablet_bootstrap.cc:492] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:38.164737 29337 tablet_bootstrap.cc:654] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.169301 29360 raft_consensus.cc:493] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.169606 28961 catalog_manager.cc:5697] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.170085 29360 raft_consensus.cc:515] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.178182 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:38.180999 29360 leader_election.cc:290] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
W20260709 12:21:38.181752 29256 leader_election.cc:343] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.184607 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:38.189429 29256 leader_election.cc:343] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.190186 29256 leader_election.cc:304] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:38.191243 29360 raft_consensus.cc:2749] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.194128 29336 tablet_bootstrap.cc:492] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:38.194752 29336 ts_tablet_manager.cc:1403] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.024s
I20260709 12:21:38.198004 29341 tablet_bootstrap.cc:654] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.199738 29336 raft_consensus.cc:359] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.200913 29337 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:38.200830 29336 raft_consensus.cc:385] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.201521 29337 ts_tablet_manager.cc:1403] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 12:21:38.201454 29336 raft_consensus.cc:740] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.202733 29336 consensus_queue.cc:260] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.205583 29336 ts_tablet_manager.cc:1434] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:21:38.206864 29336 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:38.206180 28959 catalog_manager.cc:5697] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.210975 29337 raft_consensus.cc:359] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.211686 29337 raft_consensus.cc:385] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.211953 29337 raft_consensus.cc:740] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.212188 29360 consensus_queue.cc:1048] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.212699 29337 consensus_queue.cc:260] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.214409 29336 tablet_bootstrap.cc:654] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.227350 29337 ts_tablet_manager.cc:1434] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.005s
I20260709 12:21:38.228551 29337 tablet_bootstrap.cc:492] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:38.229647 29408 consensus_queue.cc:1048] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.236611 29338 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:38.237506 29338 ts_tablet_manager.cc:1403] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.010s
I20260709 12:21:38.246318 29336 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:38.246965 29336 ts_tablet_manager.cc:1403] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.040s	user 0.030s	sys 0.008s
I20260709 12:21:38.247959 29337 tablet_bootstrap.cc:654] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.250694 29336 raft_consensus.cc:359] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.251802 29336 raft_consensus.cc:385] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.252234 29336 raft_consensus.cc:740] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.255232 29336 consensus_queue.cc:260] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.257560 29341 tablet_bootstrap.cc:492] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:38.258306 29341 ts_tablet_manager.cc:1403] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.010s
I20260709 12:21:38.254977 28961 catalog_manager.cc:5697] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.262300 29341 raft_consensus.cc:359] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.263049 29341 raft_consensus.cc:385] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.263335 29341 raft_consensus.cc:740] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.264110 29336 ts_tablet_manager.cc:1434] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:21:38.264206 29341 consensus_queue.cc:260] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.265410 29336 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:38.270094 29341 ts_tablet_manager.cc:1434] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:21:38.271181 29341 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:38.274034 29336 tablet_bootstrap.cc:654] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.260782 28961 catalog_manager.cc:5697] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.277817 29341 tablet_bootstrap.cc:654] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.278864 29360 consensus_queue.cc:1048] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.284083 29338 raft_consensus.cc:359] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.284806 29338 raft_consensus.cc:385] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.285135 29338 raft_consensus.cc:740] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.286315 29338 consensus_queue.cc:260] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.288759 29338 ts_tablet_manager.cc:1434] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:21:38.290117 29338 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:38.312042 29398 consensus_queue.cc:1048] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.319655 29338 tablet_bootstrap.cc:654] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.324762 29468 raft_consensus.cc:493] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:38.325177 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:38.325541 29468 raft_consensus.cc:515] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.336794 29341 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:38.337376 29341 ts_tablet_manager.cc:1403] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.017s
I20260709 12:21:38.340426 29341 raft_consensus.cc:359] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.341159 29341 raft_consensus.cc:385] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.341265 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9df47273e4b88bb17fb9d1924c020" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:38.342046 29142 raft_consensus.cc:2468] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:38.341485 29341 raft_consensus.cc:740] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.342417 29337 tablet_bootstrap.cc:492] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:38.342978 29337 ts_tablet_manager.cc:1403] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.020s
I20260709 12:21:38.342996 29341 consensus_queue.cc:260] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.344059 29256 leader_election.cc:304] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:38.345657 29401 raft_consensus.cc:2804] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.346050 29401 raft_consensus.cc:493] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.346176 29341 ts_tablet_manager.cc:1434] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:38.346434 29401 raft_consensus.cc:3060] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.348578 29336 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:38.349143 29336 ts_tablet_manager.cc:1403] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.001s
I20260709 12:21:38.350340 29344 raft_consensus.cc:493] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.350858 29344 raft_consensus.cc:515] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.352942 29344 leader_election.cc:290] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:38.354090 29341 tablet_bootstrap.cc:492] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:38.354143 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118990c87a4d480baacf7c25b58229aa" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:38.354713 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118990c87a4d480baacf7c25b58229aa" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.354895 29066 raft_consensus.cc:2468] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:38.344895 29468 leader_election.cc:290] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:38.346441 29337 raft_consensus.cc:359] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.356447 29180 leader_election.cc:304] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:38.357698 29344 raft_consensus.cc:2804] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.352671 29336 raft_consensus.cc:359] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.361958 29341 tablet_bootstrap.cc:654] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.367111 29338 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:38.367713 29338 ts_tablet_manager.cc:1403] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.004s
I20260709 12:21:38.367794 29444 consensus_queue.cc:1048] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.361924 29336 raft_consensus.cc:385] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.369153 29336 raft_consensus.cc:740] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.369978 29336 consensus_queue.cc:260] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.370836 29290 raft_consensus.cc:2468] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:38.371326 29338 raft_consensus.cc:359] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.372128 29338 raft_consensus.cc:385] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.372459 29338 raft_consensus.cc:740] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.373350 29338 consensus_queue.cc:260] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.359615 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9df47273e4b88bb17fb9d1924c020" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.387364 29214 raft_consensus.cc:2468] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:38.387526 29401 raft_consensus.cc:515] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.390798 29142 raft_consensus.cc:3060] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.395164 29412 raft_consensus.cc:493] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.395784 29412 raft_consensus.cc:515] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.375699 29338 ts_tablet_manager.cc:1434] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:38.378629 29341 tablet_bootstrap.cc:492] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:38.396965 29341 ts_tablet_manager.cc:1403] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.000s
I20260709 12:21:38.398115 29412 leader_election.cc:290] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:38.398864 29336 ts_tablet_manager.cc:1434] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:21:38.358119 29344 raft_consensus.cc:493] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.398895 29398 raft_consensus.cc:493] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.399130 29404 raft_consensus.cc:493] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.400372 29398 raft_consensus.cc:515] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.356463 29337 raft_consensus.cc:385] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.400005 29344 raft_consensus.cc:3060] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.401481 29337 raft_consensus.cc:740] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.402318 29337 consensus_queue.cc:260] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.400645 29404 raft_consensus.cc:515] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.404747 29337 ts_tablet_manager.cc:1434] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 12:21:38.404601 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9df47273e4b88bb17fb9d1924c020" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:38.405264 29141 raft_consensus.cc:3060] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.405766 29337 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:38.407797 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.408599 29289 raft_consensus.cc:2393] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:38.408987 29336 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:38.396260 29401 leader_election.cc:290] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:38.400254 29341 raft_consensus.cc:359] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.410470 29414 raft_consensus.cc:493] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.410972 29414 raft_consensus.cc:515] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.412248 29065 raft_consensus.cc:3060] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.412963 29398 leader_election.cc:290] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:38.413300 29337 tablet_bootstrap.cc:654] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.413401 29414 leader_election.cc:290] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.410449 29341 raft_consensus.cc:385] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.414323 29341 raft_consensus.cc:740] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.414736 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:38.415184 29341 consensus_queue.cc:260] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.415514 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ad6a7bad4460bb03ca501e6588a2b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:38.416323 29106 leader_election.cc:343] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.417611 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:38.418249 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:38.419917 29107 leader_election.cc:343] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.420406 29107 leader_election.cc:304] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:38.421567 29398 raft_consensus.cc:2749] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.422739 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ad6a7bad4460bb03ca501e6588a2b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.422950 29140 raft_consensus.cc:3060] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.423938 29180 leader_election.cc:304] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:38.424768 29414 raft_consensus.cc:3060] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.427380 29289 raft_consensus.cc:2393] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:38.428393 29404 leader_election.cc:290] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:38.428656 29179 leader_election.cc:304] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:38.429930 29412 raft_consensus.cc:3060] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.431666 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf05148546740429720380b7f235833" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:38.434834 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f9df47273e4b88bb17fb9d1924c020" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:38.430119 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf05148546740429720380b7f235833" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.435205 29414 raft_consensus.cc:2749] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.441735 29401 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.442287 29401 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.442591 29029 leader_election.cc:304] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:38.418475 29341 ts_tablet_manager.cc:1434] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:21:38.444651 29401 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:38.444931 29341 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:38.446451 29398 raft_consensus.cc:493] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.446382 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:38.455317 29444 consensus_queue.cc:1048] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.460623 29344 raft_consensus.cc:515] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.462301 29412 raft_consensus.cc:2749] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.399462 29338 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:38.447181 29214 raft_consensus.cc:3060] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.447320 29414 consensus_queue.cc:1048] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.465791 29336 tablet_bootstrap.cc:654] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.451769 29398 raft_consensus.cc:515] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.474490 29398 leader_election.cc:290] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.475258 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.475701 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.451949 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:38.477144 29140 raft_consensus.cc:2393] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91fd10ed5c3e47fcb354c51acbe25286 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:38.477169 29141 raft_consensus.cc:2468] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:38.467363 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118990c87a4d480baacf7c25b58229aa" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.478355 29289 raft_consensus.cc:3060] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.469187 29344 leader_election.cc:290] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:38.468686 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "118990c87a4d480baacf7c25b58229aa" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:38.482923 29066 raft_consensus.cc:3060] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.476361 29290 raft_consensus.cc:2468] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:38.478259 29256 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:38.488951 29105 leader_election.cc:304] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:38.489156 29256 leader_election.cc:304] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:38.490033 29401 raft_consensus.cc:3060] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.491792 29468 raft_consensus.cc:2804] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.492336 29468 raft_consensus.cc:697] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:38.493201 29468 consensus_queue.cc:237] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.495780 29444 raft_consensus.cc:493] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.496328 29444 raft_consensus.cc:515] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.499575 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.499665 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:38.501008 29029 leader_election.cc:343] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.502503 29214 raft_consensus.cc:2468] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
W20260709 12:21:38.505818 29031 leader_election.cc:343] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.506366 29031 leader_election.cc:304] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:38.506636 29289 raft_consensus.cc:2468] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:38.506896 29401 raft_consensus.cc:2749] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.508011 29179 leader_election.cc:304] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:38.508955 29412 raft_consensus.cc:2804] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.509439 29412 raft_consensus.cc:697] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:38.509971 29346 raft_consensus.cc:2749] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.510344 29412 consensus_queue.cc:237] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.511845 29414 consensus_queue.cc:1048] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.516148 29444 leader_election.cc:290] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.471971 29341 tablet_bootstrap.cc:654] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.515439 29338 tablet_bootstrap.cc:654] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.532251 29404 raft_consensus.cc:2749] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.538302 29414 consensus_queue.cc:1048] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.529687 29066 raft_consensus.cc:2468] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:38.544044 29414 consensus_queue.cc:1048] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.549371 29398 raft_consensus.cc:2804] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:38.552189 29337 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:38.552932 29337 ts_tablet_manager.cc:1403] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.038s
I20260709 12:21:38.555778 29468 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.555856 29398 raft_consensus.cc:493] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e87f64602ef465cb6288f69964235a9)
I20260709 12:21:38.556473 29468 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.559435 29468 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:38.556488 29398 raft_consensus.cc:3060] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.561661 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:38.563342 29256 leader_election.cc:343] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.564219 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:38.565269 29404 raft_consensus.cc:493] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.565786 29404 raft_consensus.cc:515] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.559257 29337 raft_consensus.cc:359] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.567963 29404 leader_election.cc:290] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:38.568055 29337 raft_consensus.cc:385] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.568442 29337 raft_consensus.cc:740] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.569365 29337 consensus_queue.cc:260] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.570405 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.571076 29214 raft_consensus.cc:2468] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:38.571907 29337 ts_tablet_manager.cc:1434] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:21:38.572721 29031 leader_election.cc:304] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:38.572949 29337 tablet_bootstrap.cc:492] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
W20260709 12:21:38.577826 29255 leader_election.cc:343] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.578450 29255 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:38.578959 29444 raft_consensus.cc:2804] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.579356 29444 raft_consensus.cc:493] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.579782 29444 raft_consensus.cc:3060] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.580415 29468 raft_consensus.cc:2749] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.577767 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:38.597581 29346 consensus_queue.cc:1048] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.603931 29444 raft_consensus.cc:515] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.604552 29346 consensus_queue.cc:1048] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.594588 29337 tablet_bootstrap.cc:654] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:38.608677 29031 leader_election.cc:343] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.620577 29395 consensus_queue.cc:1048] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:38.621572 29336 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:38.622138 29336 ts_tablet_manager.cc:1403] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.019s
I20260709 12:21:38.627228 29341 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:38.627914 29341 ts_tablet_manager.cc:1403] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.183s	user 0.023s	sys 0.013s
I20260709 12:21:38.634809 29338 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:38.635429 29338 ts_tablet_manager.cc:1403] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.236s	user 0.018s	sys 0.006s
I20260709 12:21:38.625931 29336 raft_consensus.cc:359] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.637424 29336 raft_consensus.cc:385] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.637667 29336 raft_consensus.cc:740] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.651728 28960 catalog_manager.cc:5697] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.648439 29406 consensus_queue.cc:1048] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:21:38.659577 29404 consensus_queue.cc:1048] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.617372 29346 consensus_queue.cc:1048] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:21:38.661271 29336 consensus_queue.cc:260] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.666292 29341 raft_consensus.cc:359] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.667052 29341 raft_consensus.cc:385] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.667335 29341 raft_consensus.cc:740] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.672361 29398 raft_consensus.cc:515] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.681135 29138 raft_consensus.cc:1240] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Rejecting Update request from peer 7e87f64602ef465cb6288f69964235a9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:38.682164 29336 ts_tablet_manager.cc:1434] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.004s
I20260709 12:21:38.684031 29336 tablet_bootstrap.cc:492] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:38.685940 29414 consensus_queue.cc:1059] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.676313 29341 consensus_queue.cc:260] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.692927 29341 ts_tablet_manager.cc:1434] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.003s
I20260709 12:21:38.696262 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:38.696949 29142 raft_consensus.cc:3060] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.673175 29444 leader_election.cc:290] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:38.702919 29338 raft_consensus.cc:359] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.705209 29338 raft_consensus.cc:385] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.705603 29338 raft_consensus.cc:740] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.691401 29412 raft_consensus.cc:3055] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.709106 29338 consensus_queue.cc:260] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:38.708233 29412 raft_consensus.cc:740] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:38.715968 29412 consensus_queue.cc:260] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.717231 29412 raft_consensus.cc:3060] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.700413 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:38.719053 29406 consensus_queue.cc:1048] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.719868 29216 raft_consensus.cc:3060] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.727530 28961 catalog_manager.cc:5697] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.736914 29395 consensus_queue.cc:1048] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.753729 29338 ts_tablet_manager.cc:1434] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.000s
I20260709 12:21:38.757272 29338 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:38.768393 29337 tablet_bootstrap.cc:492] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:38.769203 29337 ts_tablet_manager.cc:1403] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.196s	user 0.018s	sys 0.011s
I20260709 12:21:38.780071 29398 leader_election.cc:290] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.780345 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:38.782944 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fecfd39d27743c9aec3e98b7f9162b2" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.783700 29341 tablet_bootstrap.cc:492] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:38.792622 29142 raft_consensus.cc:2468] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:38.803207 29337 raft_consensus.cc:359] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.804068 29337 raft_consensus.cc:385] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.804374 29337 raft_consensus.cc:740] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.805166 29337 consensus_queue.cc:260] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.807817 29216 raft_consensus.cc:2468] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:38.809943 29336 tablet_bootstrap.cc:654] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.809769 29031 leader_election.cc:304] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:38.812372 29404 raft_consensus.cc:2804] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.812886 29404 raft_consensus.cc:697] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:38.813782 29404 consensus_queue.cc:237] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:38.819972 29341 tablet_bootstrap.cc:654] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.831087 29412 raft_consensus.cc:493] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.831799 29336 tablet_bootstrap.cc:492] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:38.832674 29336 ts_tablet_manager.cc:1403] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.003s
I20260709 12:21:38.832090 29412 raft_consensus.cc:515] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.835870 29412 leader_election.cc:290] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:38.836532 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:38.838920 29066 raft_consensus.cc:2468] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:38.836647 29336 raft_consensus.cc:359] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.841925 29336 raft_consensus.cc:385] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.842317 29336 raft_consensus.cc:740] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.843921 29337 ts_tablet_manager.cc:1434] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:21:38.844257 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:38.844923 29288 raft_consensus.cc:2468] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:38.845062 29337 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:38.846279 29180 leader_election.cc:304] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:38.847498 29412 raft_consensus.cc:2804] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.847894 29412 raft_consensus.cc:493] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.848212 29412 raft_consensus.cc:3060] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.843205 29336 consensus_queue.cc:260] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.858457 29336 ts_tablet_manager.cc:1434] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:21:38.860059 29360 raft_consensus.cc:493] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.860750 29360 raft_consensus.cc:515] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.864427 29360 leader_election.cc:290] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:38.867688 29414 raft_consensus.cc:493] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.868163 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd34001bec34add96fbddfbb1a9b54a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:38.868286 29414 raft_consensus.cc:515] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.876395 29336 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:38.880242 29338 tablet_bootstrap.cc:654] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.874593 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd34001bec34add96fbddfbb1a9b54a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:38.874773 29256 leader_election.cc:343] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.885346 29414 leader_election.cc:290] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.886129 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:38.887010 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:38.887658 29181 leader_election.cc:343] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.887750 29289 raft_consensus.cc:2468] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:38.883877 29214 raft_consensus.cc:2468] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:38.896039 29341 tablet_bootstrap.cc:492] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:38.896579 29341 ts_tablet_manager.cc:1403] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.004s
I20260709 12:21:38.900063 29179 leader_election.cc:304] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:38.900987 29344 raft_consensus.cc:2804] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.901414 29344 raft_consensus.cc:493] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.902141 29344 raft_consensus.cc:3060] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.904973 29412 raft_consensus.cc:515] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.907197 29412 leader_election.cc:290] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:38.910295 29336 tablet_bootstrap.cc:654] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.913228 29337 tablet_bootstrap.cc:654] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.915023 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:38.915693 29066 raft_consensus.cc:3060] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.912256 29256 leader_election.cc:343] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.918448 29256 leader_election.cc:304] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:38.919324 29360 raft_consensus.cc:2749] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.923015 29341 raft_consensus.cc:359] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.926455 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.931977 29289 raft_consensus.cc:3060] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.927129 29360 consensus_queue.cc:1048] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:38.937465 29107 leader_election.cc:304] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:38.941522 29499 raft_consensus.cc:2804] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:38.942008 29499 raft_consensus.cc:697] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:38.942904 29499 consensus_queue.cc:237] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.947250 28960 catalog_manager.cc:5697] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.950896 29344 raft_consensus.cc:515] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.956084 29066 raft_consensus.cc:2468] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:38.957425 29412 consensus_queue.cc:1048] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.959628 29180 leader_election.cc:304] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:38.960793 29412 raft_consensus.cc:2804] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.961279 29412 raft_consensus.cc:697] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:38.962272 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:38.962119 29412 consensus_queue.cc:237] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:38.962949 29288 raft_consensus.cc:3060] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.959658 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
W20260709 12:21:38.965555 29181 leader_election.cc:343] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.969718 29289 raft_consensus.cc:2468] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:38.976341 29401 consensus_queue.cc:1048] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.986085 29288 raft_consensus.cc:2468] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:38.987493 29179 leader_election.cc:304] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:38.988497 29412 raft_consensus.cc:2804] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.988994 29412 raft_consensus.cc:697] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:38.931326 29341 raft_consensus.cc:385] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.989902 29412 consensus_queue.cc:237] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.990374 29341 raft_consensus.cc:740] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.992132 29341 consensus_queue.cc:260] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:38.994704 29337 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:38.997963 29338 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:38.999001 29337 ts_tablet_manager.cc:1403] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.013s
I20260709 12:21:38.996922 28959 catalog_manager.cc:5697] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.997888 29344 leader_election.cc:290] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:38.998984 29338 ts_tablet_manager.cc:1403] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.002s
I20260709 12:21:39.007323 29337 raft_consensus.cc:359] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.008054 29337 raft_consensus.cc:385] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.008369 29337 raft_consensus.cc:740] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.008677 29336 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:39.009289 29336 ts_tablet_manager.cc:1403] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.001s
I20260709 12:21:39.009713 29338 raft_consensus.cc:359] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.010438 29338 raft_consensus.cc:385] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.010721 29338 raft_consensus.cc:740] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.011637 29338 consensus_queue.cc:260] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.012265 29336 raft_consensus.cc:359] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.011643 28962 catalog_manager.cc:5697] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.013020 29336 raft_consensus.cc:385] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.013375 29336 raft_consensus.cc:740] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.014299 29336 consensus_queue.cc:260] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.016656 29338 ts_tablet_manager.cc:1434] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:39.016790 29336 ts_tablet_manager.cc:1434] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:21:39.017385 29346 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.017864 29336 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:39.017838 29346 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.020962 29346 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.021891 29341 ts_tablet_manager.cc:1434] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.125s	user 0.004s	sys 0.004s
I20260709 12:21:39.020884 29338 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:39.022114 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.022921 29341 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
W20260709 12:21:39.023700 29031 leader_election.cc:343] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.023437 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:39.024881 29288 raft_consensus.cc:2468] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:39.026196 29029 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:39.029604 29346 raft_consensus.cc:2804] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.030028 29338 tablet_bootstrap.cc:654] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.030259 29346 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.030795 29346 raft_consensus.cc:3060] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.040787 29412 consensus_queue.cc:1048] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.045528 29341 tablet_bootstrap.cc:654] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.039479 29336 tablet_bootstrap.cc:654] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.009200 29337 consensus_queue.cc:260] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.062567 29337 ts_tablet_manager.cc:1434] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:21:39.068608 29341 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.069154 29341 ts_tablet_manager.cc:1403] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.011s
I20260709 12:21:39.072013 29337 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:39.074311 29336 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:39.074841 29336 ts_tablet_manager.cc:1403] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.003s
I20260709 12:21:39.075963 29338 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:39.076475 29338 ts_tablet_manager.cc:1403] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.011s
I20260709 12:21:39.079113 29337 tablet_bootstrap.cc:654] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.079360 29338 raft_consensus.cc:359] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.080204 29338 raft_consensus.cc:385] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.079885 29341 raft_consensus.cc:359] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.080538 29338 raft_consensus.cc:740] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.080713 29341 raft_consensus.cc:385] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.081082 29341 raft_consensus.cc:740] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.081846 29341 consensus_queue.cc:260] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.082929 29336 raft_consensus.cc:359] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.083870 29336 raft_consensus.cc:385] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.084201 29336 raft_consensus.cc:740] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.084154 29346 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.085024 28960 catalog_manager.cc:5697] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.085323 29336 consensus_queue.cc:260] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.087059 29346 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.087400 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:39.087618 29338 consensus_queue.cc:260] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.088295 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:39.089329 29341 ts_tablet_manager.cc:1434] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:21:39.092819 29336 ts_tablet_manager.cc:1434] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:21:39.109719 29288 raft_consensus.cc:3060] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.111334 29338 ts_tablet_manager.cc:1434] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:21:39.114537 29336 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:39.114552 29341 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.123243 29341 tablet_bootstrap.cc:654] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:39.124963 29031 leader_election.cc:343] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.126528 29338 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:39.131682 29288 raft_consensus.cc:2468] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:39.133220 29029 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:39.133898 29338 tablet_bootstrap.cc:654] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.134831 29346 raft_consensus.cc:2804] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.135600 29341 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.152112 29341 ts_tablet_manager.cc:1403] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 12:21:39.152009 29346 raft_consensus.cc:697] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:39.153509 29346 consensus_queue.cc:237] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.142974 29336 tablet_bootstrap.cc:654] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.145901 29337 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:39.155581 29341 raft_consensus.cc:359] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.156356 29337 ts_tablet_manager.cc:1403] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.016s
I20260709 12:21:39.156322 29341 raft_consensus.cc:385] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.156975 29341 raft_consensus.cc:740] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.157876 29341 consensus_queue.cc:260] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.160146 29341 ts_tablet_manager.cc:1434] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:39.163146 29341 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.164161 29337 raft_consensus.cc:359] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.164882 29337 raft_consensus.cc:385] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.165189 29337 raft_consensus.cc:740] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.165994 29337 consensus_queue.cc:260] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.169005 29337 ts_tablet_manager.cc:1434] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:21:39.170120 29337 tablet_bootstrap.cc:492] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:39.171842 29341 tablet_bootstrap.cc:654] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.175982 29401 raft_consensus.cc:493] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.176692 29401 raft_consensus.cc:515] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.180478 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa12ef41f343476a8228cd78fe0db9bb" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.181161 29066 raft_consensus.cc:2468] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:39.181556 29401 leader_election.cc:290] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.181833 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa12ef41f343476a8228cd78fe0db9bb" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.182507 29255 leader_election.cc:304] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.183403 29401 raft_consensus.cc:2804] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:39.183434 29256 leader_election.cc:343] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.183982 29401 raft_consensus.cc:493] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.184384 29401 raft_consensus.cc:3060] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.185171 29337 tablet_bootstrap.cc:654] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.192622 29338 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:39.193140 29338 ts_tablet_manager.cc:1403] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.014s
I20260709 12:21:39.195505 29401 raft_consensus.cc:515] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.196394 29341 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.196292 29338 raft_consensus.cc:359] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.196946 29341 ts_tablet_manager.cc:1403] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.006s
I20260709 12:21:39.197156 29338 raft_consensus.cc:385] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.197602 29338 raft_consensus.cc:740] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.198518 29338 consensus_queue.cc:260] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.200268 29341 raft_consensus.cc:359] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.200955 29341 raft_consensus.cc:385] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.201243 29341 raft_consensus.cc:740] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.202142 29341 consensus_queue.cc:260] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.204847 29341 ts_tablet_manager.cc:1434] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:39.205555 29336 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:39.205843 29341 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.206190 29336 ts_tablet_manager.cc:1403] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.003s
I20260709 12:21:39.206247 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa12ef41f343476a8228cd78fe0db9bb" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:39.206988 29066 raft_consensus.cc:3060] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.209501 29336 raft_consensus.cc:359] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:39.210583 29336 raft_consensus.cc:385] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.212294 29341 tablet_bootstrap.cc:654] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.213210 29336 raft_consensus.cc:740] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.212208 28962 catalog_manager.cc:5697] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.215026 29066 raft_consensus.cc:2468] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:39.217025 29401 leader_election.cc:290] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.217294 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa12ef41f343476a8228cd78fe0db9bb" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:39.217916 29138 raft_consensus.cc:3060] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.218256 29255 leader_election.cc:304] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.218715 29338 ts_tablet_manager.cc:1434] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:21:39.219290 29401 raft_consensus.cc:2804] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.219834 29401 raft_consensus.cc:697] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:39.220544 29338 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:39.220678 29401 consensus_queue.cc:237] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.212889 29337 tablet_bootstrap.cc:492] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:39.223537 29337 ts_tablet_manager.cc:1403] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 12:21:39.226195 29138 raft_consensus.cc:2468] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:39.228155 29336 consensus_queue.cc:260] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:39.237298 29341 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.237869 29341 ts_tablet_manager.cc:1403] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.000s
I20260709 12:21:39.233816 29337 raft_consensus.cc:359] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.242661 29337 raft_consensus.cc:385] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.242988 29337 raft_consensus.cc:740] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.243422 29341 raft_consensus.cc:359] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.242293 29336 ts_tablet_manager.cc:1434] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:21:39.245755 29341 raft_consensus.cc:385] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.244059 29337 consensus_queue.cc:260] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.246083 29341 raft_consensus.cc:740] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.247068 29341 consensus_queue.cc:260] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.248584 29341 ts_tablet_manager.cc:1434] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:39.249487 29341 tablet_bootstrap.cc:492] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.251458 29338 tablet_bootstrap.cc:654] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.256060 29341 tablet_bootstrap.cc:654] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.256716 29414 raft_consensus.cc:493] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.257318 29414 raft_consensus.cc:515] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.259933 29414 leader_election.cc:290] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.260879 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.261559 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.261813 29066 raft_consensus.cc:2468] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:39.262406 29138 raft_consensus.cc:2468] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:39.263782 29180 leader_election.cc:304] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.265091 29414 raft_consensus.cc:2804] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.265461 29414 raft_consensus.cc:493] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.265786 29414 raft_consensus.cc:3060] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.266891 29338 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:39.267427 29338 ts_tablet_manager.cc:1403] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.007s
I20260709 12:21:39.270049 29341 tablet_bootstrap.cc:492] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.270538 29341 ts_tablet_manager.cc:1403] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 12:21:39.270291 29346 consensus_queue.cc:1048] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.271613 29337 ts_tablet_manager.cc:1434] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:21:39.272765 29336 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:39.278429 29341 raft_consensus.cc:359] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.279152 29341 raft_consensus.cc:385] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.278749 29414 raft_consensus.cc:515] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.279458 29341 raft_consensus.cc:740] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.283546 29341 consensus_queue.cc:260] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.284368 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:39.284970 29066 raft_consensus.cc:3060] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.285702 29341 ts_tablet_manager.cc:1434] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:39.286194 29337 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:39.286800 29341 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.287467 29499 raft_consensus.cc:493] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.288040 29499 raft_consensus.cc:515] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.290145 29499 leader_election.cc:290] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:39.292383 29336 tablet_bootstrap.cc:654] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.293080 29066 raft_consensus.cc:2468] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:39.295265 29180 leader_election.cc:304] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.295693 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:39.293226 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.297152 29065 raft_consensus.cc:2468] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:39.297523 29344 raft_consensus.cc:2804] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.297762 29337 tablet_bootstrap.cc:654] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.298035 29344 raft_consensus.cc:697] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:39.298772 29106 leader_election.cc:304] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.293718 29341 tablet_bootstrap.cc:654] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.299016 29344 consensus_queue.cc:237] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.300663 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:39.301323 29142 raft_consensus.cc:3060] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.303548 29398 raft_consensus.cc:2804] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.303977 29398 raft_consensus.cc:493] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:39.304245 29107 leader_election.cc:343] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.304333 29398 raft_consensus.cc:3060] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.312568 29406 raft_consensus.cc:493] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.313205 29406 raft_consensus.cc:515] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.317385 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd34001bec34add96fbddfbb1a9b54a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:39.318126 29214 raft_consensus.cc:2468] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:39.318048 29444 consensus_queue.cc:1048] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.320094 29406 leader_election.cc:290] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:39.320984 29107 leader_election.cc:304] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:39.321776 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd34001bec34add96fbddfbb1a9b54a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:39.322431 29406 raft_consensus.cc:2804] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.322471 29288 raft_consensus.cc:2468] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:39.323915 29406 raft_consensus.cc:493] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.324812 29406 raft_consensus.cc:3060] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.325419 28961 catalog_manager.cc:5697] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.336725 29398 raft_consensus.cc:515] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.339186 29398 leader_election.cc:290] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:39.294023 29414 leader_election.cc:290] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.339985 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:39.340642 29065 raft_consensus.cc:3060] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.353245 29341 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.353888 29341 ts_tablet_manager.cc:1403] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.024s
I20260709 12:21:39.353700 28960 catalog_manager.cc:5697] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.356042 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:39.357127 29341 raft_consensus.cc:359] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:39.357465 29107 leader_election.cc:343] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.357821 29341 raft_consensus.cc:385] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.358180 29341 raft_consensus.cc:740] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.358927 29341 consensus_queue.cc:260] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.361184 29341 ts_tablet_manager.cc:1434] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:39.362787 29341 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.369134 29341 tablet_bootstrap.cc:654] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.371019 29338 raft_consensus.cc:359] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.372051 29338 raft_consensus.cc:385] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.372359 29338 raft_consensus.cc:740] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
W20260709 12:21:39.360450 29523 log.cc:927] Time spent T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:21:39.375087 29065 raft_consensus.cc:2468] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:39.380336 29414 consensus_queue.cc:1048] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.382221 29106 leader_election.cc:304] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:39.375945 29338 consensus_queue.cc:260] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.385898 29338 ts_tablet_manager.cc:1434] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.118s	user 0.006s	sys 0.000s
I20260709 12:21:39.389197 29338 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:39.389317 29398 raft_consensus.cc:2804] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.396427 29398 raft_consensus.cc:697] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:39.397318 29398 consensus_queue.cc:237] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.388882 29142 raft_consensus.cc:2468] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:39.424731 28960 catalog_manager.cc:5697] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.430001 29338 tablet_bootstrap.cc:654] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.444615 29406 raft_consensus.cc:515] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.448567 29341 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.449465 29341 ts_tablet_manager.cc:1403] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.008s
I20260709 12:21:39.451601 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd34001bec34add96fbddfbb1a9b54a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:39.452273 29216 raft_consensus.cc:3060] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.448626 29336 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:39.452828 29341 raft_consensus.cc:359] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.453578 29341 raft_consensus.cc:385] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.453678 29336 ts_tablet_manager.cc:1403] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.010s
I20260709 12:21:39.453887 29341 raft_consensus.cc:740] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.448596 29337 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:39.455607 29337 ts_tablet_manager.cc:1403] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.016s
I20260709 12:21:39.456893 29336 raft_consensus.cc:359] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.457649 29336 raft_consensus.cc:385] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.457930 29336 raft_consensus.cc:740] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.458663 29142 raft_consensus.cc:3060] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.458616 29336 consensus_queue.cc:260] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.459169 29337 raft_consensus.cc:359] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.459882 29337 raft_consensus.cc:385] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.460134 29337 raft_consensus.cc:740] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.454705 29341 consensus_queue.cc:260] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.461473 29401 raft_consensus.cc:493] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.461961 29401 raft_consensus.cc:515] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:39.462513 29337 consensus_queue.cc:260] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.463932 29341 ts_tablet_manager.cc:1434] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:39.464339 29401 leader_election.cc:290] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:39.465936 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:39.466852 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:39.468971 29255 leader_election.cc:343] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:39.469753 29256 leader_election.cc:343] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.470217 29256 leader_election.cc:304] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:39.470815 29341 tablet_bootstrap.cc:492] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.471131 29468 raft_consensus.cc:2749] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.471760 29360 raft_consensus.cc:493] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.472270 29360 raft_consensus.cc:515] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.473323 29412 raft_consensus.cc:493] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.473804 29412 raft_consensus.cc:515] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.474433 29360 leader_election.cc:290] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.474859 29338 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:39.475399 29338 ts_tablet_manager.cc:1403] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.002s
I20260709 12:21:39.475968 29412 leader_election.cc:290] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.478214 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.478434 29338 raft_consensus.cc:359] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.479151 29338 raft_consensus.cc:385] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.479802 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:39.469771 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:39.479400 29338 raft_consensus.cc:740] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.480871 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.481684 29065 raft_consensus.cc:2393] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:39.481493 29338 consensus_queue.cc:260] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.482532 29066 raft_consensus.cc:2468] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:39.482841 29444 raft_consensus.cc:493] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.483184 29337 ts_tablet_manager.cc:1434] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 12:21:39.483852 29180 leader_election.cc:304] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:39.484315 29337 tablet_bootstrap.cc:492] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:39.484503 29255 leader_election.cc:304] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.484748 29412 raft_consensus.cc:3060] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.486114 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.486759 29138 raft_consensus.cc:2468] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:39.481379 29336 ts_tablet_manager.cc:1434] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:21:39.491904 29401 raft_consensus.cc:2804] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.492475 29401 raft_consensus.cc:493] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.492871 29401 raft_consensus.cc:3060] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.493328 29336 tablet_bootstrap.cc:492] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:39.483340 29444 raft_consensus.cc:515] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.496871 29337 tablet_bootstrap.cc:654] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.497191 29412 raft_consensus.cc:2749] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.498224 29444 leader_election.cc:290] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:39.500268 29341 tablet_bootstrap.cc:654] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.500388 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:39.501096 29214 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:39.502432 29031 leader_election.cc:304] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.502665 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.503381 29138 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:39.506752 29336 tablet_bootstrap.cc:654] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.507424 29404 raft_consensus.cc:2804] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.507997 29404 raft_consensus.cc:493] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.508404 29404 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.516214 29288 raft_consensus.cc:3060] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:39.523504 29404 raft_consensus.cc:515] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.525501 29338 ts_tablet_manager.cc:1434] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.003s
I20260709 12:21:39.526680 29338 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:39.529664 29499 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.530217 29499 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.530777 29216 raft_consensus.cc:2468] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:39.532326 29107 leader_election.cc:304] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:39.527916 29412 consensus_queue.cc:1048] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.535787 29398 raft_consensus.cc:2804] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.536075 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd34001bec34add96fbddfbb1a9b54a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:39.536744 29290 raft_consensus.cc:3060] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.536998 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.526625 29288 raft_consensus.cc:1275] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:39.535976 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:39.539532 29289 raft_consensus.cc:2393] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cf7766f7e944f41837fd8aa8bde0018 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:39.532430 29499 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:39.546622 29290 raft_consensus.cc:2468] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:39.529238 29401 raft_consensus.cc:515] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.549620 29216 raft_consensus.cc:1275] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:39.553522 29337 tablet_bootstrap.cc:492] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:39.557693 29337 ts_tablet_manager.cc:1403] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.005s
I20260709 12:21:39.558125 29499 consensus_queue.cc:1048] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:39.561770 29337 raft_consensus.cc:359] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.565744 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:39.568665 29337 raft_consensus.cc:385] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.569197 29337 raft_consensus.cc:740] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.529081 29406 leader_election.cc:290] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:39.568837 29401 leader_election.cc:290] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.574651 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:39.575325 29139 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.569736 29066 raft_consensus.cc:3060] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.580510 29337 consensus_queue.cc:260] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.573128 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:39.589872 29138 raft_consensus.cc:3060] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.598855 29406 consensus_queue.cc:1048] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:21:39.600487 29105 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:39.603526 29412 consensus_queue.cc:1048] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.580082 29398 raft_consensus.cc:697] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:39.605966 29140 raft_consensus.cc:3060] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.610996 29414 consensus_queue.cc:1048] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.606005 29398 consensus_queue.cc:237] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.613613 29404 leader_election.cc:290] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:39.614450 29336 tablet_bootstrap.cc:492] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:39.615540 29336 ts_tablet_manager.cc:1403] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.024s
I20260709 12:21:39.598682 29066 raft_consensus.cc:2468] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:39.619812 29337 ts_tablet_manager.cc:1434] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.005s
I20260709 12:21:39.621114 29337 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:39.627274 29338 tablet_bootstrap.cc:654] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.630795 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:39.629611 29138 raft_consensus.cc:2468] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:39.602252 29139 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:39.648180 29255 leader_election.cc:304] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.649605 29468 raft_consensus.cc:2804] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.650276 29468 raft_consensus.cc:697] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:39.642297 29216 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.651378 29540 raft_consensus.cc:493] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.653990 29406 raft_consensus.cc:2749] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.668615 29540 raft_consensus.cc:515] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.671070 29540 leader_election.cc:290] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:39.659945 29031 leader_election.cc:304] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.675349 29395 raft_consensus.cc:2804] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.676191 29346 consensus_queue.cc:1048] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.676980 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbb99959a4d4868936840d4e60bbe83" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.651474 29468 consensus_queue.cc:237] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:39.682776 29106 leader_election.cc:343] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.686967 29341 tablet_bootstrap.cc:492] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.687530 29341 ts_tablet_manager.cc:1403] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.217s	user 0.027s	sys 0.026s
I20260709 12:21:39.690815 29341 raft_consensus.cc:359] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.693073 29341 raft_consensus.cc:385] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.693377 29341 raft_consensus.cc:740] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.694375 29216 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:39.694244 29341 consensus_queue.cc:260] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.698724 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbb99959a4d4868936840d4e60bbe83" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:39.701148 29341 ts_tablet_manager.cc:1434] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:39.703111 29341 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
W20260709 12:21:39.708187 29107 leader_election.cc:343] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.708737 29107 leader_election.cc:304] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:39.706115 28961 catalog_manager.cc:5697] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.715886 29395 raft_consensus.cc:697] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:39.731735 29538 raft_consensus.cc:2749] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.741706 29337 tablet_bootstrap.cc:654] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.747851 29444 consensus_queue.cc:1048] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.747496 29414 consensus_queue.cc:1048] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:39.756398 29336 raft_consensus.cc:359] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.760129 29336 raft_consensus.cc:385] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.760491 29336 raft_consensus.cc:740] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.761288 29336 consensus_queue.cc:260] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.783490 29336 ts_tablet_manager.cc:1434] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.167s	user 0.004s	sys 0.003s
W20260709 12:21:39.788708 29546 log.cc:927] Time spent T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:21:39.789331 29336 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:39.761219 29395 consensus_queue.cc:237] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.797569 29336 tablet_bootstrap.cc:654] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.797348 29414 consensus_queue.cc:1048] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.798312 29541 consensus_queue.cc:1048] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.820144 28960 catalog_manager.cc:5697] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.828536 29468 consensus_queue.cc:1048] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:21:39.828413 29344 raft_consensus.cc:493] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.845001 29338 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:39.845683 29338 ts_tablet_manager.cc:1403] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.319s	user 0.023s	sys 0.019s
I20260709 12:21:39.852496 29341 tablet_bootstrap.cc:654] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.854187 29336 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
W20260709 12:21:39.855873 29544 log.cc:927] Time spent T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:21:39.856797 29336 ts_tablet_manager.cc:1403] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.003s
I20260709 12:21:39.860270 29336 raft_consensus.cc:359] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:39.862895 29336 raft_consensus.cc:385] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.863212 29336 raft_consensus.cc:740] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.841094 29344 raft_consensus.cc:515] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:39.864514 29336 consensus_queue.cc:260] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:39.866919 29338 raft_consensus.cc:359] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.867372 29541 raft_consensus.cc:493] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.867728 29338 raft_consensus.cc:385] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.875684 29338 raft_consensus.cc:740] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.877460 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad25e9fbcd614e4e9eecbb5dc392c165" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:39.878165 29288 raft_consensus.cc:2468] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:39.878649 29338 consensus_queue.cc:260] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.882474 29338 ts_tablet_manager.cc:1434] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:21:39.876293 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad25e9fbcd614e4e9eecbb5dc392c165" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:39.894867 29139 raft_consensus.cc:2468] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:39.867972 29541 raft_consensus.cc:515] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.894677 28960 catalog_manager.cc:5697] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.879501 29179 leader_election.cc:304] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:39.869156 29336 ts_tablet_manager.cc:1434] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:39.875226 29344 leader_election.cc:290] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:39.893959 29337 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:39.900586 29338 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:39.900605 29337 ts_tablet_manager.cc:1403] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.280s	user 0.013s	sys 0.018s
I20260709 12:21:39.901477 29336 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:39.908082 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.908870 29336 tablet_bootstrap.cc:654] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.909088 29066 raft_consensus.cc:2468] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:39.911027 29255 leader_election.cc:304] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:39.914803 29468 raft_consensus.cc:2804] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.915772 29468 raft_consensus.cc:493] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.918628 29414 raft_consensus.cc:2804] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.925158 29414 raft_consensus.cc:493] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.925678 29414 raft_consensus.cc:3060] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.924238 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:39.933168 29256 leader_election.cc:343] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.933897 29468 raft_consensus.cc:3060] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.934559 29401 raft_consensus.cc:493] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.935196 29401 raft_consensus.cc:515] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:39.936065 29406 consensus_queue.cc:1048] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.937479 29401 leader_election.cc:290] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:39.940938 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd03869bf33149b993051af5c8f055eb" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:39.944527 29256 leader_election.cc:343] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.939368 29337 raft_consensus.cc:359] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:39.961644 29337 raft_consensus.cc:385] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.944833 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd03869bf33149b993051af5c8f055eb" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:39.955756 29541 leader_election.cc:290] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:39.961942 29337 raft_consensus.cc:740] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.969681 29341 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:39.970260 29341 ts_tablet_manager.cc:1403] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.267s	user 0.015s	sys 0.002s
I20260709 12:21:39.971642 29406 consensus_queue.cc:1048] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.973205 29341 raft_consensus.cc:359] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.977039 29341 raft_consensus.cc:385] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.977404 29341 raft_consensus.cc:740] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.978276 29341 consensus_queue.cc:260] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:39.997398 29341 ts_tablet_manager.cc:1434] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:21:39.998903 29341 tablet_bootstrap.cc:492] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:39.989912 29337 consensus_queue.cc:260] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:40.004118 29255 leader_election.cc:343] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.004832 29255 leader_election.cc:304] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:40.005831 29336 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:40.006373 29336 ts_tablet_manager.cc:1403] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.109s	user 0.038s	sys 0.025s
I20260709 12:21:40.006855 29401 raft_consensus.cc:2749] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.009565 29336 raft_consensus.cc:359] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.014469 29336 raft_consensus.cc:385] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.014843 29336 raft_consensus.cc:740] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.015800 29336 consensus_queue.cc:260] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.018625 29336 ts_tablet_manager.cc:1434] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:21:40.019714 29336 tablet_bootstrap.cc:492] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:40.020694 29338 tablet_bootstrap.cc:654] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.026752 29336 tablet_bootstrap.cc:654] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.056471 29337 ts_tablet_manager.cc:1434] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.001s
I20260709 12:21:40.058089 29337 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:40.076866 29541 consensus_queue.cc:1048] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.047233 29468 raft_consensus.cc:515] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.101534 29344 raft_consensus.cc:493] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.102272 29344 raft_consensus.cc:515] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.122418 29541 consensus_queue.cc:1048] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.185017 29406 raft_consensus.cc:493] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.185738 29406 raft_consensus.cc:515] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.197326 29414 raft_consensus.cc:515] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.199247 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:40.200342 29067 raft_consensus.cc:2468] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:40.201622 29106 leader_election.cc:304] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:40.205416 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.206303 29288 raft_consensus.cc:2393] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cf7766f7e944f41837fd8aa8bde0018 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:40.207011 29538 raft_consensus.cc:2804] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.207587 29538 raft_consensus.cc:493] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.208104 29538 raft_consensus.cc:3060] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.209602 29398 consensus_queue.cc:1048] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.213061 29338 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:40.213589 29338 ts_tablet_manager.cc:1403] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.321s	user 0.013s	sys 0.006s
I20260709 12:21:40.217845 29398 consensus_queue.cc:1048] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.220081 29338 raft_consensus.cc:359] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.220856 29338 raft_consensus.cc:385] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.221164 29338 raft_consensus.cc:740] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.221928 29338 consensus_queue.cc:260] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.225171 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbb99959a4d4868936840d4e60bbe83" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:40.226270 29337 tablet_bootstrap.cc:654] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:40.228868 29180 leader_election.cc:343] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.229518 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:40.230158 29066 raft_consensus.cc:3060] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.232596 29338 ts_tablet_manager.cc:1434] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:21:40.233691 29338 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:40.235070 29468 leader_election.cc:290] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:40.235697 29406 leader_election.cc:290] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:40.236956 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:40.239553 29066 raft_consensus.cc:2468] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:40.245067 29255 leader_election.cc:304] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:40.246093 29468 raft_consensus.cc:2804] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.248731 29468 raft_consensus.cc:697] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:40.254552 29338 tablet_bootstrap.cc:654] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.250991 29341 tablet_bootstrap.cc:654] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.261770 29468 consensus_queue.cc:237] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.265599 29538 raft_consensus.cc:515] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.251317 29336 tablet_bootstrap.cc:492] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:40.266902 29140 raft_consensus.cc:2393] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91fd10ed5c3e47fcb354c51acbe25286 in current term 1: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:40.270666 29338 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:40.271198 29338 ts_tablet_manager.cc:1403] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 12:21:40.266871 29336 ts_tablet_manager.cc:1403] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.247s	user 0.021s	sys 0.019s
I20260709 12:21:40.284483 29538 leader_election.cc:290] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:40.285811 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:40.286487 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:40.287966 29065 raft_consensus.cc:2393] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6cf7766f7e944f41837fd8aa8bde0018 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:40.289057 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad25e9fbcd614e4e9eecbb5dc392c165" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:40.289705 29140 raft_consensus.cc:3060] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.289745 29106 leader_election.cc:304] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:40.295882 29406 raft_consensus.cc:2749] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.301884 29336 raft_consensus.cc:359] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.302878 29338 raft_consensus.cc:359] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.310197 29336 raft_consensus.cc:385] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.310392 29338 raft_consensus.cc:385] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.310586 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbb99959a4d4868936840d4e60bbe83" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:40.310820 29338 raft_consensus.cc:740] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.311344 29139 raft_consensus.cc:2468] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:40.310774 29336 raft_consensus.cc:740] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.311614 29346 consensus_queue.cc:1048] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.312796 29181 leader_election.cc:304] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:40.313719 29336 consensus_queue.cc:260] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.308765 29341 tablet_bootstrap.cc:492] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:40.314074 29412 raft_consensus.cc:2804] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.311815 29338 consensus_queue.cc:260] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.316200 29414 leader_election.cc:290] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.316850 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad25e9fbcd614e4e9eecbb5dc392c165" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:40.319914 29412 raft_consensus.cc:493] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.318485 29344 leader_election.cc:290] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:40.320459 29291 raft_consensus.cc:3060] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.306612 29140 raft_consensus.cc:2468] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:40.320524 29412 raft_consensus.cc:3060] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.322434 29181 leader_election.cc:304] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:40.321344 29341 ts_tablet_manager.cc:1403] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.323s	user 0.019s	sys 0.015s
I20260709 12:21:40.329773 29291 raft_consensus.cc:2468] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:40.328689 29344 raft_consensus.cc:2804] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.334156 29344 raft_consensus.cc:697] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:40.335100 29344 consensus_queue.cc:237] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.335947 29338 ts_tablet_manager.cc:1434] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 12:21:40.336834 29338 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:40.342026 29336 ts_tablet_manager.cc:1434] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:21:40.345453 29336 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:40.345629 29337 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:40.346181 29337 ts_tablet_manager.cc:1403] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.288s	user 0.021s	sys 0.013s
I20260709 12:21:40.335071 29341 raft_consensus.cc:359] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.347748 29341 raft_consensus.cc:385] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.348048 29341 raft_consensus.cc:740] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.348668 29337 raft_consensus.cc:359] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.349383 29337 raft_consensus.cc:385] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.349706 29346 consensus_queue.cc:1048] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.350672 29341 consensus_queue.cc:260] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.349668 29337 raft_consensus.cc:740] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.353615 29337 consensus_queue.cc:260] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.355676 29341 ts_tablet_manager.cc:1434] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:21:40.355969 29337 ts_tablet_manager.cc:1434] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:40.356761 29341 tablet_bootstrap.cc:492] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:40.357020 29337 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:40.356774 28961 catalog_manager.cc:5697] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.344249 29338 tablet_bootstrap.cc:654] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.372432 28962 catalog_manager.cc:5697] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.349608 29412 raft_consensus.cc:515] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.380677 29412 leader_election.cc:290] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:40.380586 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbb99959a4d4868936840d4e60bbe83" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:40.381568 29065 raft_consensus.cc:3060] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.365379 29336 tablet_bootstrap.cc:654] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.423400 29338 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:40.424024 29338 ts_tablet_manager.cc:1403] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.000s
I20260709 12:21:40.425930 29336 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:40.426585 29336 ts_tablet_manager.cc:1403] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.002s
I20260709 12:21:40.370818 29341 tablet_bootstrap.cc:654] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.427285 29338 raft_consensus.cc:359] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.428221 29338 raft_consensus.cc:385] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.428493 29338 raft_consensus.cc:740] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.429553 29338 consensus_queue.cc:260] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.386463 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbb99959a4d4868936840d4e60bbe83" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:40.430783 29142 raft_consensus.cc:3060] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.431928 29338 ts_tablet_manager.cc:1434] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:21:40.433526 29338 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:40.437748 29065 raft_consensus.cc:2468] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:40.383428 29337 tablet_bootstrap.cc:654] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.439522 29180 leader_election.cc:304] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:40.440385 29338 tablet_bootstrap.cc:654] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.440739 29414 raft_consensus.cc:2804] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.441437 29414 raft_consensus.cc:697] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:40.442447 29414 consensus_queue.cc:237] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.440222 29142 raft_consensus.cc:2468] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:40.444120 29336 raft_consensus.cc:359] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.444873 29336 raft_consensus.cc:385] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.445159 29336 raft_consensus.cc:740] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.445899 29336 consensus_queue.cc:260] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.449542 29336 ts_tablet_manager.cc:1434] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:21:40.454674 29341 tablet_bootstrap.cc:492] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:40.455408 29336 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:40.455591 29341 ts_tablet_manager.cc:1403] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.000s
I20260709 12:21:40.458892 29341 raft_consensus.cc:359] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.459811 29341 raft_consensus.cc:385] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.460186 29341 raft_consensus.cc:740] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.460974 29341 consensus_queue.cc:260] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.469869 29336 tablet_bootstrap.cc:654] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.477255 29341 ts_tablet_manager.cc:1434] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:21:40.478786 29341 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:40.480908 29468 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.481709 29468 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.487210 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:40.489626 29255 leader_election.cc:343] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.492681 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:40.491366 29468 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:40.494640 29256 leader_election.cc:343] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.495151 29256 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:40.492995 29337 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:40.496367 29468 raft_consensus.cc:2749] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.496471 29337 ts_tablet_manager.cc:1403] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.140s	user 0.006s	sys 0.007s
I20260709 12:21:40.499989 29577 raft_consensus.cc:493] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.500598 29577 raft_consensus.cc:515] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.503861 29577 leader_election.cc:290] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.504096 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.503801 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:40.504853 29291 raft_consensus.cc:2468] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:40.504630 29337 raft_consensus.cc:359] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.505096 29214 raft_consensus.cc:2468] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:40.505429 29337 raft_consensus.cc:385] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.506596 29029 leader_election.cc:304] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:40.507596 29576 raft_consensus.cc:2804] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.507993 29576 raft_consensus.cc:493] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.508337 29576 raft_consensus.cc:3060] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.520162 29576 raft_consensus.cc:515] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.522176 29336 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:40.505738 29337 raft_consensus.cc:740] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.522779 29336 ts_tablet_manager.cc:1403] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.068s	user 0.032s	sys 0.021s
I20260709 12:21:40.523193 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:40.523121 28963 catalog_manager.cc:5697] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.528136 29214 raft_consensus.cc:3060] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.528213 29337 consensus_queue.cc:260] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.529417 29341 tablet_bootstrap.cc:654] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.530951 29337 ts_tablet_manager.cc:1434] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 12:21:40.532032 29337 tablet_bootstrap.cc:492] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:40.536777 29214 raft_consensus.cc:2468] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:40.524883 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:40.537595 29291 raft_consensus.cc:3060] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.526705 29338 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:40.544114 29338 ts_tablet_manager.cc:1403] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.111s	user 0.030s	sys 0.024s
I20260709 12:21:40.547036 29468 raft_consensus.cc:493] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.547657 29468 raft_consensus.cc:515] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.549537 29291 raft_consensus.cc:2468] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:40.550114 29468 leader_election.cc:290] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:40.551812 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7496a0c6c1946acad1f4fb97b1ce80b" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:40.552811 29341 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:40.552461 29336 raft_consensus.cc:359] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.524245 29576 leader_election.cc:290] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.553298 29336 raft_consensus.cc:385] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.550181 29338 raft_consensus.cc:359] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.553993 29336 raft_consensus.cc:740] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.553350 29341 ts_tablet_manager.cc:1403] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.004s
I20260709 12:21:40.555151 29336 consensus_queue.cc:260] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.557008 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7496a0c6c1946acad1f4fb97b1ce80b" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:40.554035 29256 leader_election.cc:343] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.557411 29341 raft_consensus.cc:359] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:40.558490 29255 leader_election.cc:343] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.558828 29341 raft_consensus.cc:385] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.558966 29255 leader_election.cc:304] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:40.560214 29360 raft_consensus.cc:2749] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.561642 29029 leader_election.cc:304] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
W20260709 12:21:40.562137 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:40.562700 29336 ts_tablet_manager.cc:1434] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:21:40.563622 29336 tablet_bootstrap.cc:492] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:40.559145 29341 raft_consensus.cc:740] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.567819 29576 raft_consensus.cc:2804] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.568434 29338 raft_consensus.cc:385] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.568104 29341 consensus_queue.cc:260] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.568750 29338 raft_consensus.cc:740] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.569357 29337 tablet_bootstrap.cc:654] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.570189 29576 raft_consensus.cc:697] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:40.571134 29576 consensus_queue.cc:237] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.573033 29538 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.573040 29338 consensus_queue.cc:260] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.573736 29538 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.576973 29336 tablet_bootstrap.cc:654] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.580675 29338 ts_tablet_manager.cc:1434] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:21:40.581737 29338 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:40.582301 29341 ts_tablet_manager.cc:1434] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:21:40.588124 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:40.589577 29106 leader_election.cc:343] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.590562 29338 tablet_bootstrap.cc:654] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.590504 29538 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:40.592304 29341 tablet_bootstrap.cc:492] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:40.599224 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:40.601440 29105 leader_election.cc:343] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.602216 29337 tablet_bootstrap.cc:492] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:40.602036 29105 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:40.603113 29577 raft_consensus.cc:493] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.603295 29538 raft_consensus.cc:2749] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.603701 29577 raft_consensus.cc:515] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.604568 29412 raft_consensus.cc:493] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.605170 29337 ts_tablet_manager.cc:1403] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.006s
I20260709 12:21:40.605077 29412 raft_consensus.cc:515] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.608441 29412 leader_election.cc:290] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:40.608788 29337 raft_consensus.cc:359] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.609499 29337 raft_consensus.cc:385] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.609781 29337 raft_consensus.cc:740] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.610450 29337 consensus_queue.cc:260] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.612553 29341 tablet_bootstrap.cc:654] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.620007 29337 ts_tablet_manager.cc:1434] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:21:40.621106 29337 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:40.622970 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd03869bf33149b993051af5c8f055eb" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:40.623735 29065 raft_consensus.cc:2468] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:40.627792 29577 leader_election.cc:290] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.628705 29180 leader_election.cc:304] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:40.629809 29412 raft_consensus.cc:2804] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.630203 29412 raft_consensus.cc:493] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.630540 29412 raft_consensus.cc:3060] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.631366 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:40.633496 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd03869bf33149b993051af5c8f055eb" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.634254 29291 raft_consensus.cc:2468] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
W20260709 12:21:40.643734 29031 leader_election.cc:343] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.646055 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.650216 29291 raft_consensus.cc:2468] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:40.654515 29029 leader_election.cc:304] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:40.652595 28963 catalog_manager.cc:5697] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.665535 29577 raft_consensus.cc:2804] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.665954 29577 raft_consensus.cc:493] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.666296 29577 raft_consensus.cc:3060] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.668777 29412 raft_consensus.cc:515] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.676918 29336 tablet_bootstrap.cc:492] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:40.675084 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd03869bf33149b993051af5c8f055eb" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:40.683043 29336 ts_tablet_manager.cc:1403] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.120s	user 0.022s	sys 0.006s
I20260709 12:21:40.675050 29577 raft_consensus.cc:515] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.683063 29291 raft_consensus.cc:3060] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.684441 29412 leader_election.cc:290] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:40.686262 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:40.687330 29338 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
W20260709 12:21:40.687748 29031 leader_election.cc:343] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.687883 29338 ts_tablet_manager.cc:1403] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.010s
I20260709 12:21:40.689256 29336 raft_consensus.cc:359] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.689952 29341 tablet_bootstrap.cc:492] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:40.690025 29336 raft_consensus.cc:385] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.690613 29341 ts_tablet_manager.cc:1403] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.008s
I20260709 12:21:40.690575 29336 raft_consensus.cc:740] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.690937 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:40.691520 29577 leader_election.cc:290] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.691804 29336 consensus_queue.cc:260] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.693531 29338 raft_consensus.cc:359] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.694255 29338 raft_consensus.cc:385] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.694530 29338 raft_consensus.cc:740] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.697736 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd03869bf33149b993051af5c8f055eb" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:40.698386 29065 raft_consensus.cc:3060] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.705468 29338 consensus_queue.cc:260] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.707669 29338 ts_tablet_manager.cc:1434] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:21:40.709021 29338 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:40.709807 29288 raft_consensus.cc:3060] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.713474 29406 raft_consensus.cc:493] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.693885 29341 raft_consensus.cc:359] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.714076 29406 raft_consensus.cc:515] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.714946 29341 raft_consensus.cc:385] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.715292 29341 raft_consensus.cc:740] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.716290 29065 raft_consensus.cc:2468] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:40.716986 29338 tablet_bootstrap.cc:654] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.717658 29180 leader_election.cc:304] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:40.718250 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f61f9c9b39417ca1f74cfa4a80f092" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.719026 29289 raft_consensus.cc:2468] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:40.719332 29412 raft_consensus.cc:2804] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.719846 29406 leader_election.cc:290] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.721230 29105 leader_election.cc:304] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:40.720027 29336 ts_tablet_manager.cc:1434] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 12:21:40.721990 29412 raft_consensus.cc:697] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:40.722784 29336 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:40.722930 29412 consensus_queue.cc:237] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.729988 29414 consensus_queue.cc:1048] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.731503 29336 tablet_bootstrap.cc:654] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.731791 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f61f9c9b39417ca1f74cfa4a80f092" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:40.732543 29214 raft_consensus.cc:2468] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:40.720697 29341 consensus_queue.cc:260] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.733542 29406 raft_consensus.cc:2804] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.733969 29406 raft_consensus.cc:493] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.734438 29406 raft_consensus.cc:3060] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.740370 29341 ts_tablet_manager.cc:1434] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:21:40.753186 29341 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:40.758289 29338 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:40.781701 29338 ts_tablet_manager.cc:1403] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 12:21:40.783382 28960 catalog_manager.cc:5697] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.784983 29338 raft_consensus.cc:359] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:40.785751 29338 raft_consensus.cc:385] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.786022 29338 raft_consensus.cc:740] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.762073 29360 consensus_queue.cc:1048] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.787390 29341 tablet_bootstrap.cc:654] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.772600 29406 raft_consensus.cc:515] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.774487 29337 tablet_bootstrap.cc:654] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.774349 29414 consensus_queue.cc:1048] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.775004 29291 raft_consensus.cc:2468] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:40.794754 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f61f9c9b39417ca1f74cfa4a80f092" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:40.775774 29288 raft_consensus.cc:2468] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:40.795996 29538 raft_consensus.cc:493] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.796705 29538 raft_consensus.cc:515] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.802824 29029 leader_election.cc:304] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:40.804968 29576 raft_consensus.cc:2804] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.805495 29576 raft_consensus.cc:697] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:40.806334 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bf6f5ffed54f1fad60a22b102f923d" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.807385 29341 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:40.807950 29341 ts_tablet_manager.cc:1403] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.000s
I20260709 12:21:40.808144 29289 raft_consensus.cc:3060] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:40.809477 29105 leader_election.cc:343] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.811221 29341 raft_consensus.cc:359] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.811949 29341 raft_consensus.cc:385] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.812229 29341 raft_consensus.cc:740] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.799551 29538 leader_election.cc:290] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.806375 29576 consensus_queue.cc:237] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.812911 29341 consensus_queue.cc:260] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.814105 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bf6f5ffed54f1fad60a22b102f923d" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:40.815601 29341 ts_tablet_manager.cc:1434] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:40.815871 29406 leader_election.cc:290] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.816632 29341 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:40.822928 29341 tablet_bootstrap.cc:654] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.826485 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f61f9c9b39417ca1f74cfa4a80f092" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:40.827440 29216 raft_consensus.cc:3060] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.827929 29338 consensus_queue.cc:260] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:40.834839 29107 leader_election.cc:343] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.835832 29107 leader_election.cc:304] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:40.839607 29338 ts_tablet_manager.cc:1434] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.058s	user 0.000s	sys 0.007s
I20260709 12:21:40.841040 29338 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:40.846515 29289 raft_consensus.cc:2468] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:40.846698 29538 raft_consensus.cc:2749] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.850239 29336 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:40.854671 29344 consensus_queue.cc:1048] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.863829 29337 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:40.864542 29337 ts_tablet_manager.cc:1403] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.244s	user 0.012s	sys 0.001s
I20260709 12:21:40.866647 29105 leader_election.cc:304] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:40.868994 29406 raft_consensus.cc:493] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.869727 29406 raft_consensus.cc:515] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.877146 29360 consensus_queue.cc:1048] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.882028 29337 raft_consensus.cc:359] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.883692 29398 raft_consensus.cc:2804] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.892735 29398 raft_consensus.cc:697] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:40.893970 29398 consensus_queue.cc:237] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.886480 29406 leader_election.cc:290] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.888208 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9548af611b534185ae76fa0d4c896962" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:40.870939 29336 ts_tablet_manager.cc:1403] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.016s
I20260709 12:21:40.891386 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9548af611b534185ae76fa0d4c896962" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:40.899361 29337 raft_consensus.cc:385] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.900028 29337 raft_consensus.cc:740] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.899379 29289 raft_consensus.cc:2468] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:40.901026 29337 consensus_queue.cc:260] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:40.902524 29336 raft_consensus.cc:359] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.908492 29105 leader_election.cc:304] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:40.911300 29538 raft_consensus.cc:2804] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.912345 29538 raft_consensus.cc:493] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.912797 29538 raft_consensus.cc:3060] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:40.932369 29107 leader_election.cc:343] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.949018 29216 raft_consensus.cc:2468] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:40.953104 29337 ts_tablet_manager.cc:1434] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.000s
I20260709 12:21:40.954761 29337 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:40.970481 29577 consensus_queue.cc:1048] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.974510 29412 consensus_queue.cc:1048] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.976065 29538 raft_consensus.cc:515] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:40.979121 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9548af611b534185ae76fa0d4c896962" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
W20260709 12:21:40.981179 29107 leader_election.cc:343] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.903360 29336 raft_consensus.cc:385] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.987291 29336 raft_consensus.cc:740] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.988257 29538 leader_election.cc:290] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:40.988677 29338 tablet_bootstrap.cc:654] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.989077 29336 consensus_queue.cc:260] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:40.991041 29337 tablet_bootstrap.cc:654] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.992736 29336 ts_tablet_manager.cc:1434] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.093s	user 0.001s	sys 0.006s
I20260709 12:21:40.993778 29336 tablet_bootstrap.cc:492] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:40.998095 29337 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:40.998616 29337 ts_tablet_manager.cc:1403] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 12:21:41.057554 29341 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:41.096944 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9548af611b534185ae76fa0d4c896962" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:41.109234 29398 raft_consensus.cc:493] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.071877 28963 catalog_manager.cc:5697] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:41.144476 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 44430.4us
I20260709 12:21:41.146526 29341 ts_tablet_manager.cc:1403] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.330s	user 0.061s	sys 0.085s
I20260709 12:21:41.155020 29291 raft_consensus.cc:3060] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.155378 29576 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.156309 29576 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.159235 29398 raft_consensus.cc:515] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.160077 29576 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:41.163338 29398 leader_election.cc:290] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:41.172163 29336 tablet_bootstrap.cc:654] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.173601 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:41.176497 29106 leader_election.cc:343] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.183139 29341 raft_consensus.cc:359] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.209501 29341 raft_consensus.cc:385] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.210505 29341 raft_consensus.cc:740] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.220885 29338 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:41.222883 29338 ts_tablet_manager.cc:1403] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.382s	user 0.013s	sys 0.002s
I20260709 12:21:41.231151 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:41.232189 29290 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
W20260709 12:21:41.219904 29031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 68387.4us
I20260709 12:21:41.241297 29344 raft_consensus.cc:493] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.242152 29344 raft_consensus.cc:515] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.246537 29344 leader_election.cc:290] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:41.245965 29341 consensus_queue.cc:260] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.235970 29029 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:41.250090 29341 ts_tablet_manager.cc:1434] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.103s	user 0.011s	sys 0.001s
I20260709 12:21:41.250771 29576 raft_consensus.cc:2804] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.251130 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:41.251443 29576 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.251997 29576 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:41.253041 29181 leader_election.cc:343] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.254009 29344 consensus_queue.cc:1048] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.255419 29617 raft_consensus.cc:493] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.255990 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:41.256105 29617 raft_consensus.cc:515] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.251957 29341 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:41.263077 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:41.263996 29139 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:41.281746 29337 raft_consensus.cc:359] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.283044 29337 raft_consensus.cc:385] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.283356 29337 raft_consensus.cc:740] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.283753 29577 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.284195 29337 consensus_queue.cc:260] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.284581 29577 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.289348 29398 consensus_queue.cc:1048] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.292894 29336 tablet_bootstrap.cc:492] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:41.295401 29336 ts_tablet_manager.cc:1403] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.302s	user 0.006s	sys 0.027s
W20260709 12:21:41.298578 29107 leader_election.cc:343] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.299192 29107 leader_election.cc:304] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:41.300290 29406 raft_consensus.cc:2749] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.293452 29337 ts_tablet_manager.cc:1434] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.151s	user 0.009s	sys 0.000s
I20260709 12:21:41.326766 29577 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:41.289321 29291 raft_consensus.cc:2468] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:41.329749 29617 leader_election.cc:290] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:41.330844 29341 tablet_bootstrap.cc:654] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.290444 29338 raft_consensus.cc:359] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.331525 29062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:41.330502 29105 leader_election.cc:304] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:41.341338 29398 raft_consensus.cc:2804] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.342160 29398 raft_consensus.cc:697] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:41.343376 29398 consensus_queue.cc:237] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.333400 29338 raft_consensus.cc:385] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.345355 29338 raft_consensus.cc:740] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.351847 29414 consensus_queue.cc:1048] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:41.356160 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:41.356652 29337 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:41.357892 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:41.358662 29140 raft_consensus.cc:2468] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:41.351655 29344 raft_consensus.cc:493] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.363055 29577 consensus_queue.cc:1048] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.363786 29344 raft_consensus.cc:515] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.367466 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7496a0c6c1946acad1f4fb97b1ce80b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:41.368225 29290 raft_consensus.cc:2468] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
W20260709 12:21:41.368923 29180 leader_election.cc:343] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.367491 29255 leader_election.cc:343] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.369449 29180 leader_election.cc:304] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:41.370411 29336 raft_consensus.cc:359] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.371260 29336 raft_consensus.cc:385] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.371794 29414 raft_consensus.cc:2749] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.371971 29338 consensus_queue.cc:260] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.373926 29179 leader_election.cc:304] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:41.374960 29595 raft_consensus.cc:2804] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.375383 29595 raft_consensus.cc:493] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.375774 29595 raft_consensus.cc:3060] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.371184 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:41.375980 29338 ts_tablet_manager.cc:1434] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.153s	user 0.010s	sys 0.001s
I20260709 12:21:41.371798 29336 raft_consensus.cc:740] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.379698 29344 leader_election.cc:290] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:41.381524 29576 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.395318 29336 consensus_queue.cc:260] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.397313 29576 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:41.403817 29029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 104423us
I20260709 12:21:41.409051 29336 ts_tablet_manager.cc:1434] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.003s
I20260709 12:21:41.410301 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:41.411051 29139 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.412349 29338 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:41.421103 29031 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:41.426232 29337 tablet_bootstrap.cc:654] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.422216 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7496a0c6c1946acad1f4fb97b1ce80b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:41.430792 29063 raft_consensus.cc:2468] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:41.428493 29576 raft_consensus.cc:2804] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.432334 29576 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.432744 29576 raft_consensus.cc:3060] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.433270 28962 catalog_manager.cc:5697] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.435137 29595 raft_consensus.cc:515] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.441926 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7496a0c6c1946acad1f4fb97b1ce80b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:41.442749 29289 raft_consensus.cc:3060] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.445739 29336 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
W20260709 12:21:41.448105 29256 leader_election.cc:343] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.449708 29139 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:41.450768 29256 leader_election.cc:304] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:41.460223 29468 raft_consensus.cc:2749] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.462270 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:41.475682 29621 raft_consensus.cc:493] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.476306 29621 raft_consensus.cc:515] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.475009 29406 consensus_queue.cc:1048] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:41.481112 29621 leader_election.cc:290] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:41.481837 29576 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:41.472405 29031 consensus_peers.cc:597] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:41.486917 29031 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:41.451738 29595 leader_election.cc:290] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:41.488095 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7496a0c6c1946acad1f4fb97b1ce80b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:41.488480 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bf6f5ffed54f1fad60a22b102f923d" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:41.488837 29063 raft_consensus.cc:3060] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.489383 29139 raft_consensus.cc:2468] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:41.490267 29341 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:41.490832 29341 ts_tablet_manager.cc:1403] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.239s	user 0.025s	sys 0.002s
I20260709 12:21:41.491462 29256 leader_election.cc:304] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:41.505906 29341 raft_consensus.cc:359] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.506826 29341 raft_consensus.cc:385] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.507124 29341 raft_consensus.cc:740] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.495599 29621 raft_consensus.cc:2804] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.515237 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:41.516079 29288 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.514294 29621 raft_consensus.cc:493] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.517179 29621 raft_consensus.cc:3060] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.519681 29626 raft_consensus.cc:2804] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.520354 29626 raft_consensus.cc:697] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:41.521492 29626 consensus_queue.cc:237] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.531109 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bf6f5ffed54f1fad60a22b102f923d" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:41.538226 29029 leader_election.cc:343] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.538230 29623 consensus_queue.cc:1048] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.541371 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
W20260709 12:21:41.548180 29256 leader_election.cc:343] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.555827 29338 tablet_bootstrap.cc:654] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.559821 29341 consensus_queue.cc:260] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.561285 29621 raft_consensus.cc:515] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.566071 29063 raft_consensus.cc:2468] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:41.572369 29621 leader_election.cc:290] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:41.576530 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bf6f5ffed54f1fad60a22b102f923d" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:41.577215 29139 raft_consensus.cc:3060] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.577378 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1bf6f5ffed54f1fad60a22b102f923d" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:41.600116 28963 catalog_manager.cc:5697] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.543462 29289 raft_consensus.cc:2468] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:41.611253 29179 leader_election.cc:304] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:41.612759 29595 raft_consensus.cc:2804] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.613719 29595 raft_consensus.cc:697] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:41.614744 29595 consensus_queue.cc:237] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:41.619616 29029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 49050.3us
W20260709 12:21:41.631779 29029 leader_election.cc:343] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.598482 29256 leader_election.cc:343] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.624603 29139 raft_consensus.cc:2468] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:41.646081 29256 leader_election.cc:304] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:41.625241 29341 ts_tablet_manager.cc:1434] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:21:41.625741 29336 tablet_bootstrap.cc:654] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.647334 29621 raft_consensus.cc:2804] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.650153 29621 raft_consensus.cc:697] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:41.651360 29621 consensus_queue.cc:237] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.651899 29337 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:41.652588 29337 ts_tablet_manager.cc:1403] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.296s	user 0.014s	sys 0.015s
I20260709 12:21:41.662966 29337 raft_consensus.cc:359] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.663681 29337 raft_consensus.cc:385] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.663950 29337 raft_consensus.cc:740] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.667161 29576 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:41.669764 29337 consensus_queue.cc:260] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.682598 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:41.683288 29140 raft_consensus.cc:3060] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.684346 29341 tablet_bootstrap.cc:492] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:41.693874 29615 raft_consensus.cc:493] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.694494 29615 raft_consensus.cc:515] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:41.678404 29288 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:41.710225 29337 ts_tablet_manager.cc:1434] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.004s
I20260709 12:21:41.714021 29140 raft_consensus.cc:2468] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:41.719316 29615 leader_election.cc:290] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:41.724566 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:41.721411 29031 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:41.727159 29577 raft_consensus.cc:2804] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.727782 29577 raft_consensus.cc:697] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:41.728752 29577 consensus_queue.cc:237] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.744686 29337 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:41.750447 29338 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:41.754119 29341 tablet_bootstrap.cc:654] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.755872 29338 ts_tablet_manager.cc:1403] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.344s	user 0.024s	sys 0.004s
I20260709 12:21:41.755623 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:41.762810 29338 raft_consensus.cc:359] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.764621 28963 catalog_manager.cc:5697] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:41.767946 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:41.771456 29338 raft_consensus.cc:385] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.771869 29338 raft_consensus.cc:740] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.774184 29338 consensus_queue.cc:260] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.777643 29180 leader_election.cc:304] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:41.779132 29341 tablet_bootstrap.cc:492] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:41.781078 29595 raft_consensus.cc:2749] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.782493 29338 ts_tablet_manager.cc:1434] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:21:41.783939 29338 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:41.785625 29341 ts_tablet_manager.cc:1403] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.004s
I20260709 12:21:41.786607 29336 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:41.787166 29336 ts_tablet_manager.cc:1403] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.342s	user 0.018s	sys 0.027s
I20260709 12:21:41.789317 29341 raft_consensus.cc:359] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.790031 29341 raft_consensus.cc:385] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.790412 29341 raft_consensus.cc:740] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.790089 29336 raft_consensus.cc:359] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.790843 29336 raft_consensus.cc:385] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.791107 29336 raft_consensus.cc:740] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.793418 29336 consensus_queue.cc:260] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.794809 28962 catalog_manager.cc:5697] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.802205 29336 ts_tablet_manager.cc:1434] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:21:41.804870 29336 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:41.805778 29341 consensus_queue.cc:260] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.808774 29341 ts_tablet_manager.cc:1434] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:21:41.810076 29341 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:41.812251 29336 tablet_bootstrap.cc:654] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.815749 29337 tablet_bootstrap.cc:654] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.817088 29338 tablet_bootstrap.cc:654] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.837955 28963 catalog_manager.cc:5697] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.841053 29341 tablet_bootstrap.cc:654] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.848934 29616 consensus_queue.cc:1048] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.850482 29338 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:41.860658 29338 ts_tablet_manager.cc:1403] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.003s
W20260709 12:21:41.861186 29107 consensus_peers.cc:597] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:41.864524 29338 raft_consensus.cc:359] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.866875 29338 raft_consensus.cc:385] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.867161 29338 raft_consensus.cc:740] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.867952 29338 consensus_queue.cc:260] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.854911 29337 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:41.870548 29337 ts_tablet_manager.cc:1403] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.026s
I20260709 12:21:41.855213 29336 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:41.873309 29336 ts_tablet_manager.cc:1403] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.006s
I20260709 12:21:41.875710 29338 ts_tablet_manager.cc:1434] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:21:41.879120 29337 raft_consensus.cc:359] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.879956 29337 raft_consensus.cc:385] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.880277 29337 raft_consensus.cc:740] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.881079 29337 consensus_queue.cc:260] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.884150 29337 ts_tablet_manager.cc:1434] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:41.889081 29338 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:41.910308 29341 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:41.910864 29341 ts_tablet_manager.cc:1403] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.007s
I20260709 12:21:41.891099 29337 tablet_bootstrap.cc:492] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:41.914122 29341 raft_consensus.cc:359] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.914851 29341 raft_consensus.cc:385] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.915035 29577 raft_consensus.cc:493] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.915117 29341 raft_consensus.cc:740] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.915726 29577 raft_consensus.cc:515] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:41.893481 29336 raft_consensus.cc:359] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.916754 29336 raft_consensus.cc:385] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.916671 29341 consensus_queue.cc:260] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.917254 29336 raft_consensus.cc:740] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.897974 29621 raft_consensus.cc:493] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.902877 29538 raft_consensus.cc:493] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.918056 29577 leader_election.cc:290] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:41.918547 29338 tablet_bootstrap.cc:654] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.921865 29538 raft_consensus.cc:515] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.923208 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:41.924222 29216 raft_consensus.cc:2468] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:41.924463 29538 leader_election.cc:290] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:41.907857 28960 catalog_manager.cc:5697] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.925441 29031 leader_election.cc:304] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:41.926177 29577 raft_consensus.cc:2804] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.926342 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:41.927060 29140 raft_consensus.cc:2468] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:41.918941 29336 consensus_queue.cc:260] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.928351 29216 raft_consensus.cc:3060] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.928678 29337 tablet_bootstrap.cc:654] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.930445 29336 ts_tablet_manager.cc:1434] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 12:21:41.921140 29621 raft_consensus.cc:515] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.931604 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491de7c08e54ace93f8edaaadfff61a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:41.933434 29621 leader_election.cc:290] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:41.920210 29341 ts_tablet_manager.cc:1434] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:21:41.935277 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491de7c08e54ace93f8edaaadfff61a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:41.935355 29341 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:41.937094 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b774d33d7306413c852622175e13c2cc" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:41.940433 29255 leader_election.cc:343] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.944236 29341 tablet_bootstrap.cc:654] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:41.944491 29107 leader_election.cc:343] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.945724 29105 leader_election.cc:343] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.946189 29105 leader_election.cc:304] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:41.946687 29338 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:41.947217 29338 ts_tablet_manager.cc:1403] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.003s
I20260709 12:21:41.947751 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b774d33d7306413c852622175e13c2cc" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:41.948531 29140 raft_consensus.cc:2468] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:41.951231 29336 tablet_bootstrap.cc:492] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:41.954315 29256 leader_election.cc:304] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:41.926551 29577 raft_consensus.cc:493] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.943521 29337 tablet_bootstrap.cc:492] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:41.978305 29577 raft_consensus.cc:3060] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.978572 29337 ts_tablet_manager.cc:1403] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.009s
I20260709 12:21:41.950304 29338 raft_consensus.cc:359] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.979128 29338 raft_consensus.cc:385] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.979445 29338 raft_consensus.cc:740] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.980309 29338 consensus_queue.cc:260] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.982049 29337 raft_consensus.cc:359] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:41.983008 29337 raft_consensus.cc:385] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.962574 29621 raft_consensus.cc:2804] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.989017 29621 raft_consensus.cc:493] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.989434 29621 raft_consensus.cc:3060] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.996397 29341 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:41.982635 29338 ts_tablet_manager.cc:1434] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.003s
I20260709 12:21:41.998546 29338 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:42.001806 29577 raft_consensus.cc:515] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.002472 29621 raft_consensus.cc:515] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:41.962950 29538 raft_consensus.cc:2749] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.963392 29336 tablet_bootstrap.cc:654] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.004577 29337 raft_consensus.cc:740] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.005330 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:42.005535 29337 consensus_queue.cc:260] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.006047 29140 raft_consensus.cc:3060] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.007881 29337 ts_tablet_manager.cc:1434] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.009s
I20260709 12:21:42.008854 29338 tablet_bootstrap.cc:654] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.013578 29621 leader_election.cc:290] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:42.009090 29337 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:42.015084 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b774d33d7306413c852622175e13c2cc" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:42.009421 29341 ts_tablet_manager.cc:1403] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.001s
I20260709 12:21:42.016014 29138 raft_consensus.cc:3060] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.018162 29140 raft_consensus.cc:2468] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:42.019268 29341 raft_consensus.cc:359] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.020061 29341 raft_consensus.cc:385] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.020125 29577 leader_election.cc:290] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:42.020460 29341 raft_consensus.cc:740] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.021256 29341 consensus_queue.cc:260] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.024710 29336 tablet_bootstrap.cc:492] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:42.025516 29336 ts_tablet_manager.cc:1403] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.007s
I20260709 12:21:42.028211 29337 tablet_bootstrap.cc:654] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.028034 29031 leader_election.cc:304] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:42.028623 29639 raft_consensus.cc:493] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.029189 29639 raft_consensus.cc:515] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.030392 29545 raft_consensus.cc:2804] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.030915 29545 raft_consensus.cc:697] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:42.031414 29341 ts_tablet_manager.cc:1434] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:21:42.031803 29545 consensus_queue.cc:237] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.035499 29341 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:42.036243 29338 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:42.036836 29338 ts_tablet_manager.cc:1403] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.007s
I20260709 12:21:42.036981 29625 raft_consensus.cc:493] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.037497 29625 raft_consensus.cc:515] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.040287 29625 leader_election.cc:290] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:42.040649 29338 raft_consensus.cc:359] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.041373 29338 raft_consensus.cc:385] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.041723 29338 raft_consensus.cc:740] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.041776 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b774d33d7306413c852622175e13c2cc" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:42.042709 29290 raft_consensus.cc:2393] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:42.042804 29338 consensus_queue.cc:260] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.043358 29341 tablet_bootstrap.cc:654] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.045253 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:42.045845 29214 raft_consensus.cc:3060] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.047051 29338 ts_tablet_manager.cc:1434] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:21:42.048332 29338 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:42.048192 29639 leader_election.cc:290] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:42.051522 29337 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:42.052029 29337 ts_tablet_manager.cc:1403] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.003s
I20260709 12:21:42.048660 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:42.054909 29142 raft_consensus.cc:2468] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:42.055190 29336 raft_consensus.cc:359] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.056751 29341 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:42.056598 29181 leader_election.cc:304] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:42.056756 29336 raft_consensus.cc:385] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.057312 29341 ts_tablet_manager.cc:1403] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 12:21:42.057615 29639 raft_consensus.cc:2804] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.058018 29639 raft_consensus.cc:493] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.057898 29337 raft_consensus.cc:359] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.058598 29639 raft_consensus.cc:3060] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.059021 29067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b774d33d7306413c852622175e13c2cc" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:42.059762 29067 raft_consensus.cc:3060] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.061586 29341 raft_consensus.cc:359] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.057348 29336 raft_consensus.cc:740] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.062939 29336 consensus_queue.cc:260] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.064726 29336 ts_tablet_manager.cc:1434] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.039s	user 0.000s	sys 0.006s
I20260709 12:21:42.062276 29341 raft_consensus.cc:385] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.065238 29341 raft_consensus.cc:740] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.065868 29341 consensus_queue.cc:260] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.058678 29337 raft_consensus.cc:385] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.068050 29337 raft_consensus.cc:740] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.068265 29341 ts_tablet_manager.cc:1434] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:42.070005 29341 tablet_bootstrap.cc:492] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:42.069860 29639 raft_consensus.cc:515] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.072161 29639 leader_election.cc:290] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:42.068836 29337 consensus_queue.cc:260] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.075044 29337 ts_tablet_manager.cc:1434] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:21:42.076332 29337 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:42.077708 29341 tablet_bootstrap.cc:654] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.080240 29338 tablet_bootstrap.cc:654] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.087894 29414 consensus_queue.cc:1048] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.097827 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b774d33d7306413c852622175e13c2cc" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:42.102068 29062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:42.102846 29062 raft_consensus.cc:2468] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:42.104292 29062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:42.104895 29062 raft_consensus.cc:3060] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.087901 29337 tablet_bootstrap.cc:654] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.106928 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:42.107865 29140 raft_consensus.cc:3060] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.111900 29626 consensus_queue.cc:1048] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.130295 29538 raft_consensus.cc:493] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.137231 29031 leader_election.cc:304] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:42.141029 29621 consensus_queue.cc:1048] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.144258 29337 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:42.146291 29639 raft_consensus.cc:493] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.146834 29639 raft_consensus.cc:515] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.148730 29336 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:42.149231 29341 tablet_bootstrap.cc:492] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:42.149799 29341 ts_tablet_manager.cc:1403] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.028s
I20260709 12:21:42.149984 29639 leader_election.cc:290] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:42.150281 29337 ts_tablet_manager.cc:1403] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.005s
I20260709 12:21:42.151314 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9548af611b534185ae76fa0d4c896962" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:42.155694 29337 raft_consensus.cc:359] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.156424 29337 raft_consensus.cc:385] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.156755 29337 raft_consensus.cc:740] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.130940 29538 raft_consensus.cc:515] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.161366 29337 consensus_queue.cc:260] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.160939 29336 tablet_bootstrap.cc:654] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.164784 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:42.165518 29291 raft_consensus.cc:2468] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:42.167099 29105 leader_election.cc:304] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:42.168020 29616 raft_consensus.cc:2804] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.167659 29337 ts_tablet_manager.cc:1434] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:21:42.168459 29616 raft_consensus.cc:493] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.168913 29616 raft_consensus.cc:3060] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.169412 29337 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:42.170361 29341 raft_consensus.cc:359] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.170889 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:42.181634 29106 leader_election.cc:343] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.169471 29538 leader_election.cc:290] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:42.178454 29341 raft_consensus.cc:385] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.189482 29341 raft_consensus.cc:740] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.177937 29214 raft_consensus.cc:2468] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:42.177937 29062 raft_consensus.cc:2468] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:42.208351 29067 raft_consensus.cc:2468] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:42.209925 29255 leader_election.cc:304] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:42.211742 29577 raft_consensus.cc:2749] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.213495 29621 raft_consensus.cc:2804] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.191526 29140 raft_consensus.cc:2468] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:42.224329 29180 leader_election.cc:304] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:42.226580 29595 raft_consensus.cc:2804] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.227159 29615 consensus_queue.cc:1048] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.229460 29595 raft_consensus.cc:697] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:42.196094 29576 consensus_queue.cc:1048] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:21:42.230383 29595 consensus_queue.cc:237] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.198464 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9548af611b534185ae76fa0d4c896962" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:42.223074 29341 consensus_queue.cc:260] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.244201 29625 consensus_queue.cc:1048] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.247643 29337 tablet_bootstrap.cc:654] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.197002 29138 raft_consensus.cc:2468] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:42.270167 29341 ts_tablet_manager.cc:1434] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.003s
I20260709 12:21:42.271440 29341 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:42.274374 29179 leader_election.cc:304] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:42.275310 29616 raft_consensus.cc:515] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.278834 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
W20260709 12:21:42.280501 29106 leader_election.cc:343] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.297443 29621 raft_consensus.cc:697] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:42.299008 29621 consensus_queue.cc:237] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.282215 29616 leader_election.cc:290] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:42.293706 29538 raft_consensus.cc:493] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.295464 29639 raft_consensus.cc:2749] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:42.342428 29663 log.cc:927] Time spent T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:21:42.321462 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 47225.5us
I20260709 12:21:42.346428 29336 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:42.349540 29336 ts_tablet_manager.cc:1403] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.201s	user 0.005s	sys 0.035s
I20260709 12:21:42.346802 29538 raft_consensus.cc:515] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:42.356655 29256 consensus_peers.cc:597] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:42.325251 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 49469.2us
I20260709 12:21:42.365988 29338 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:42.366878 29338 ts_tablet_manager.cc:1403] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.319s	user 0.038s	sys 0.050s
I20260709 12:21:42.366021 29341 tablet_bootstrap.cc:654] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.354615 29667 raft_consensus.cc:493] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.416858 29336 raft_consensus.cc:359] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.419715 29336 raft_consensus.cc:385] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.420327 29336 raft_consensus.cc:740] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.422294 29336 consensus_queue.cc:260] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.429280 29338 raft_consensus.cc:359] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.430084 29338 raft_consensus.cc:385] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.430379 29338 raft_consensus.cc:740] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.431095 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:42.431664 29338 consensus_queue.cc:260] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.431795 29291 raft_consensus.cc:3060] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.434715 29338 ts_tablet_manager.cc:1434] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.003s
I20260709 12:21:42.437680 29216 raft_consensus.cc:3060] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.440762 29538 leader_election.cc:290] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:42.441854 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79910b5e01341aea4d305a8d26211eb" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:42.442575 29214 raft_consensus.cc:2468] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:42.445303 29336 ts_tablet_manager.cc:1434] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 12:21:42.444842 29107 leader_election.cc:304] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:42.387732 29667 raft_consensus.cc:515] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.449836 29538 raft_consensus.cc:2804] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.476194 29337 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:42.462292 29538 raft_consensus.cc:493] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.476878 29337 ts_tablet_manager.cc:1403] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.308s	user 0.018s	sys 0.013s
I20260709 12:21:42.482987 29621 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.488961 29621 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.489888 29341 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:42.490469 29341 ts_tablet_manager.cc:1403] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.023s
I20260709 12:21:42.491633 29338 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:42.492775 28963 catalog_manager.cc:5697] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.494378 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:42.498221 29341 raft_consensus.cc:359] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.477777 29538 raft_consensus.cc:3060] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.500383 28960 catalog_manager.cc:5697] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.499191 29341 raft_consensus.cc:385] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.507614 29341 raft_consensus.cc:740] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.508625 29341 consensus_queue.cc:260] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.502177 29336 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:42.491397 29621 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:42.536363 29341 ts_tablet_manager.cc:1434] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.001s
I20260709 12:21:42.530699 29626 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.534760 29412 raft_consensus.cc:493] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.547016 29626 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.560817 29412 raft_consensus.cc:515] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.566555 29412 leader_election.cc:290] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:42.566888 29626 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:42.574272 29337 raft_consensus.cc:359] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.575174 29337 raft_consensus.cc:385] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.559020 29291 raft_consensus.cc:2468] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
W20260709 12:21:42.577728 29678 log.cc:927] Time spent T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:21:42.584435 29341 tablet_bootstrap.cc:492] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:42.589322 29667 leader_election.cc:290] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:42.591406 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491de7c08e54ace93f8edaaadfff61a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:42.592516 29140 raft_consensus.cc:2468] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:42.594718 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:42.575553 29337 raft_consensus.cc:740] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.596208 29256 leader_election.cc:304] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:42.597443 29621 raft_consensus.cc:2804] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.597944 29621 raft_consensus.cc:493] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.598351 29621 raft_consensus.cc:3060] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.601377 29341 tablet_bootstrap.cc:654] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.609038 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491de7c08e54ace93f8edaaadfff61a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:42.611027 29670 raft_consensus.cc:493] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.613853 29670 raft_consensus.cc:515] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.616336 29670 leader_election.cc:290] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:42.629357 29105 leader_election.cc:304] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:42.631706 29672 raft_consensus.cc:2804] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.631872 29338 tablet_bootstrap.cc:654] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.633208 29672 raft_consensus.cc:697] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:42.634308 29672 consensus_queue.cc:237] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:42.637447 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:42.649077 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:42.577927 29336 tablet_bootstrap.cc:654] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.656862 29337 consensus_queue.cc:260] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.672823 29337 ts_tablet_manager.cc:1434] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.195s	user 0.009s	sys 0.000s
W20260709 12:21:42.658694 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 52738.5us
W20260709 12:21:42.689697 29256 leader_election.cc:343] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.697482 29105 leader_election.cc:343] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.759366 29337 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:42.767999 29337 tablet_bootstrap.cc:654] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.768944 29338 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:42.769657 29338 ts_tablet_manager.cc:1403] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.008s
W20260709 12:21:42.774394 29179 leader_election.cc:343] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.774932 29338 raft_consensus.cc:359] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.777031 29338 raft_consensus.cc:385] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.777837 29338 raft_consensus.cc:740] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.776888 29621 raft_consensus.cc:515] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.774163 29538 raft_consensus.cc:515] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.786828 29538 leader_election.cc:290] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:42.778867 29338 consensus_queue.cc:260] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.794816 29338 ts_tablet_manager.cc:1434] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:21:42.811133 29341 tablet_bootstrap.cc:492] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:42.812182 29341 ts_tablet_manager.cc:1403] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.262s	user 0.016s	sys 0.010s
I20260709 12:21:42.802224 29621 leader_election.cc:290] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:42.815516 29341 raft_consensus.cc:359] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.825505 29341 raft_consensus.cc:385] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.826020 29341 raft_consensus.cc:740] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.828949 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491de7c08e54ace93f8edaaadfff61a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:42.826890 29341 consensus_queue.cc:260] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:42.841033 29336 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:42.841727 29336 ts_tablet_manager.cc:1403] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.371s	user 0.022s	sys 0.009s
I20260709 12:21:42.858112 29341 ts_tablet_manager.cc:1434] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:21:42.864595 29336 raft_consensus.cc:359] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.865314 29336 raft_consensus.cc:385] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.865550 29336 raft_consensus.cc:740] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.866161 29336 consensus_queue.cc:260] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:42.870007 29337 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:42.870723 29337 ts_tablet_manager.cc:1403] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.030s
I20260709 12:21:42.878818 29337 raft_consensus.cc:359] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.879985 29337 raft_consensus.cc:385] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.880358 29337 raft_consensus.cc:740] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.881105 29337 consensus_queue.cc:260] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:42.883371 29337 ts_tablet_manager.cc:1434] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:21:42.888882 29341 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:42.896577 29337 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:42.899137 29341 tablet_bootstrap.cc:654] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.904505 29336 ts_tablet_manager.cc:1434] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:21:42.912683 29338 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:42.911442 29062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79910b5e01341aea4d305a8d26211eb" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:42.935365 29062 raft_consensus.cc:2468] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
W20260709 12:21:42.540887 29029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 63676.7us
I20260709 12:21:42.948459 29336 tablet_bootstrap.cc:492] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
W20260709 12:21:43.080163 29381 log.cc:927] Time spent T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 12:21:43.082070 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:43.096870 29620 consensus_queue.cc:1048] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.078s
I20260709 12:21:43.125079 29398 raft_consensus.cc:493] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.177014 29681 consensus_queue.cc:1048] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.177330 29398 raft_consensus.cc:515] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:43.179332 29031 leader_election.cc:343] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.179844 29398 leader_election.cc:290] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
W20260709 12:21:43.142597 29107 leader_election.cc:343] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.088691 29062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.180452 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.181017 29062 raft_consensus.cc:2468] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:43.153162 29290 raft_consensus.cc:3060] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:43.182204 29106 leader_election.cc:343] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.183666 29667 consensus_queue.cc:1048] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.180559 29107 leader_election.cc:304] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
W20260709 12:21:43.190133 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 47601.2us
I20260709 12:21:43.192505 29336 tablet_bootstrap.cc:654] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.197554 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491de7c08e54ace93f8edaaadfff61a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:43.198215 29141 raft_consensus.cc:3060] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.198577 29338 tablet_bootstrap.cc:654] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.203886 29639 consensus_queue.cc:1048] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.204311 29398 raft_consensus.cc:2749] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.209563 29141 raft_consensus.cc:2468] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:43.173772 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79910b5e01341aea4d305a8d26211eb" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:43.212379 29065 raft_consensus.cc:3060] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:43.162000 29256 leader_election.cc:343] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:43.025470 28963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.036s	sys 0.065s
I20260709 12:21:43.218118 29336 tablet_bootstrap.cc:492] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:43.218649 29336 ts_tablet_manager.cc:1403] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.276s	user 0.016s	sys 0.000s
W20260709 12:21:43.224145 28963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.039s	sys 0.066s
W20260709 12:21:43.216279 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 54326.4us
I20260709 12:21:43.238852 29341 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:43.239470 29341 ts_tablet_manager.cc:1403] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.353s	user 0.008s	sys 0.027s
I20260709 12:21:43.113466 29699 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.249033 29621 consensus_queue.cc:1048] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.249436 29256 leader_election.cc:304] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:43.251413 29337 tablet_bootstrap.cc:654] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.252252 29667 raft_consensus.cc:2804] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.252789 29667 raft_consensus.cc:697] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:43.253788 29667 consensus_queue.cc:237] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.264945 29336 raft_consensus.cc:359] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.269032 29336 raft_consensus.cc:385] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.271145 29341 raft_consensus.cc:359] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:43.271737 29341 raft_consensus.cc:385] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.271987 29341 raft_consensus.cc:740] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.269359 29336 raft_consensus.cc:740] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.273387 29336 consensus_queue.cc:260] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.272635 29341 consensus_queue.cc:260] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:43.279436 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:43.279701 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.280293 29212 raft_consensus.cc:2468] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:43.259536 29065 raft_consensus.cc:2468] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:43.260648 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79910b5e01341aea4d305a8d26211eb" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:43.282979 29215 raft_consensus.cc:3060] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.283253 29106 leader_election.cc:304] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:43.284495 29672 raft_consensus.cc:2804] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.270720 29615 consensus_queue.cc:1048] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:21:43.292543 29255 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:43.288914 29341 ts_tablet_manager.cc:1434] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 12:21:43.285107 29672 raft_consensus.cc:697] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:43.300390 29672 consensus_queue.cc:237] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.264027 29699 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.303752 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:43.304657 29216 raft_consensus.cc:2468] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:43.305382 29699 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:43.309859 29031 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:43.311442 29626 raft_consensus.cc:2804] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.312021 29626 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:43.314641 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:43.312482 29626 raft_consensus.cc:3060] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.322799 29707 raft_consensus.cc:493] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.323227 29700 raft_consensus.cc:493] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.324098 29341 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:43.328449 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:43.333818 28959 catalog_manager.cc:5697] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.323539 29707 raft_consensus.cc:515] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.324038 29700 raft_consensus.cc:515] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.341344 29338 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:43.342305 29338 ts_tablet_manager.cc:1403] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.430s	user 0.028s	sys 0.000s
I20260709 12:21:43.348420 29337 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:43.349166 29337 ts_tablet_manager.cc:1403] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.453s	user 0.011s	sys 0.008s
I20260709 12:21:43.353040 29337 raft_consensus.cc:359] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.353806 29337 raft_consensus.cc:385] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.316339 29215 raft_consensus.cc:2468] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:43.357275 29336 ts_tablet_manager.cc:1434] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.138s	user 0.019s	sys 0.036s
I20260709 12:21:43.354190 29337 raft_consensus.cc:740] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.361699 29337 consensus_queue.cc:260] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.362362 29626 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.365049 29707 leader_election.cc:290] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:43.376015 29181 leader_election.cc:343] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:43.372161 29255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 79717.1us
I20260709 12:21:43.374281 29617 raft_consensus.cc:2749] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.388682 29336 tablet_bootstrap.cc:492] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:43.393157 29700 leader_election.cc:290] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:43.395282 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.396036 29065 raft_consensus.cc:2468] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:43.403088 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:43.374998 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 107995us
I20260709 12:21:43.432845 29338 raft_consensus.cc:359] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.433274 29255 leader_election.cc:304] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:43.434238 29336 tablet_bootstrap.cc:654] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.434403 29711 raft_consensus.cc:2804] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.434813 29711 raft_consensus.cc:493] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.435158 29711 raft_consensus.cc:3060] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.436313 29338 raft_consensus.cc:385] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.436677 29338 raft_consensus.cc:740] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.437644 29338 consensus_queue.cc:260] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:43.439934 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 172430us
I20260709 12:21:43.444310 29337 ts_tablet_manager.cc:1434] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.001s
I20260709 12:21:43.441030 29700 consensus_queue.cc:1048] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:43.446552 29337 tablet_bootstrap.cc:492] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:43.447868 29338 ts_tablet_manager.cc:1434] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.006s
I20260709 12:21:43.453480 29341 tablet_bootstrap.cc:654] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.458551 29338 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:43.454994 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:43.462803 29215 raft_consensus.cc:2468] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:43.464437 29626 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:43.449329 29180 leader_election.cc:304] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:43.468832 29639 raft_consensus.cc:493] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.469938 29639 raft_consensus.cc:515] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.470885 29712 raft_consensus.cc:2804] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.471004 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:43.471383 29712 raft_consensus.cc:493] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.471666 29212 raft_consensus.cc:3060] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.471796 29712 raft_consensus.cc:3060] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.472476 29639 leader_election.cc:290] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:43.460345 29681 consensus_queue.cc:1048] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 12:21:43.473743 29105 leader_election.cc:343] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.481173 29667 raft_consensus.cc:493] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.481699 29667 raft_consensus.cc:515] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.483906 29667 leader_election.cc:290] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:43.484499 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:43.485241 29142 raft_consensus.cc:2468] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:43.485404 29213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:43.487231 29256 leader_election.cc:343] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.487993 29256 leader_election.cc:304] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:43.489084 29707 raft_consensus.cc:2804] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.489499 29707 raft_consensus.cc:493] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.489858 29707 raft_consensus.cc:3060] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.496284 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
W20260709 12:21:43.503257 29031 leader_election.cc:343] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.504251 29107 leader_election.cc:304] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:43.505498 29672 raft_consensus.cc:2804] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.505880 29672 raft_consensus.cc:493] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.506256 29672 raft_consensus.cc:3060] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:43.513094 29106 consensus_peers.cc:597] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.520449 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.518915 29707 raft_consensus.cc:515] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.552377 29286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:43.553191 29286 raft_consensus.cc:2468] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:43.557181 29179 leader_election.cc:304] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:43.558277 29701 raft_consensus.cc:2804] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.558657 29701 raft_consensus.cc:493] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.559002 29701 raft_consensus.cc:3060] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.554095 29337 tablet_bootstrap.cc:654] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.535992 29626 raft_consensus.cc:493] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.585642 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.597013 29707 leader_election.cc:290] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:43.551224 29711 raft_consensus.cc:515] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.605520 29711 leader_election.cc:290] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:43.577384 29066 raft_consensus.cc:2393] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:43.609083 29626 raft_consensus.cc:515] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.617825 29626 leader_election.cc:290] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
W20260709 12:21:43.621701 29180 leader_election.cc:343] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.623008 29180 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:43.625072 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:43.627108 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:43.627930 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:43.628744 29066 raft_consensus.cc:3060] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.634178 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:43.548218 29672 raft_consensus.cc:515] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.627904 29137 raft_consensus.cc:3060] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.637158 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:43.643460 29211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:43.644213 29211 raft_consensus.cc:2468] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
W20260709 12:21:43.647864 29720 log.cc:927] Time spent T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:21:43.654960 29031 leader_election.cc:304] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:43.656705 29336 tablet_bootstrap.cc:492] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:43.657449 29336 ts_tablet_manager.cc:1403] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.276s	user 0.014s	sys 0.044s
I20260709 12:21:43.658264 29623 raft_consensus.cc:2804] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.658708 29623 raft_consensus.cc:493] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.659075 29623 raft_consensus.cc:3060] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.665292 29672 leader_election.cc:290] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:43.637423 29212 raft_consensus.cc:2468] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:43.666586 29412 raft_consensus.cc:2749] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:43.668301 29107 leader_election.cc:343] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.668946 29107 leader_election.cc:304] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:43.669409 29211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:43.670096 29211 raft_consensus.cc:3060] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.670147 29065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:43.670502 29538 raft_consensus.cc:2749] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.676824 29031 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:21:43.683422 29681 raft_consensus.cc:2804] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.684077 29681 raft_consensus.cc:697] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:43.685043 29681 consensus_queue.cc:237] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.689098 29336 raft_consensus.cc:359] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.689908 29336 raft_consensus.cc:385] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.690181 29336 raft_consensus.cc:740] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.690989 29336 consensus_queue.cc:260] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.640107 29712 raft_consensus.cc:515] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.679368 29701 raft_consensus.cc:515] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.704166 29701 leader_election.cc:290] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:43.712230 29256 leader_election.cc:343] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.719031 29214 raft_consensus.cc:2393] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91fd10ed5c3e47fcb354c51acbe25286 in current term 1: Already voted for candidate 7e87f64602ef465cb6288f69964235a9 in this term.
I20260709 12:21:43.731547 29341 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:43.732343 29341 ts_tablet_manager.cc:1403] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.415s	user 0.026s	sys 0.016s
I20260709 12:21:43.733330 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:43.734278 29142 raft_consensus.cc:2393] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in current term 1: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:43.734810 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:43.735494 29285 raft_consensus.cc:3060] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.738337 29712 leader_election.cc:290] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:43.740931 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:43.741794 29290 raft_consensus.cc:2393] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:43.721035 29211 raft_consensus.cc:2468] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:43.760999 29336 ts_tablet_manager.cc:1434] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.001s
I20260709 12:21:43.762284 29336 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:43.759799 29341 raft_consensus.cc:359] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.764014 29341 raft_consensus.cc:385] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.764247 29700 raft_consensus.cc:493] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.764920 29700 raft_consensus.cc:515] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:43.766131 29066 raft_consensus.cc:2468] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:43.767091 29700 leader_election.cc:290] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:43.767519 29255 leader_election.cc:304] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:43.768814 29707 raft_consensus.cc:2804] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.769302 29707 raft_consensus.cc:697] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:43.769474 29064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:43.770192 29707 consensus_queue.cc:237] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:43.771109 29106 leader_election.cc:343] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.764356 29341 raft_consensus.cc:740] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.776994 29538 consensus_queue.cc:1048] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.778246 29341 consensus_queue.cc:260] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.782119 29623 raft_consensus.cc:515] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.784336 29065 raft_consensus.cc:2393] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6cf7766f7e944f41837fd8aa8bde0018 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:43.781440 29341 ts_tablet_manager.cc:1434] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:21:43.785391 29107 leader_election.cc:304] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:43.786633 29338 tablet_bootstrap.cc:654] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.787901 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:43.788272 29538 raft_consensus.cc:2804] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.807003 29341 tablet_bootstrap.cc:492] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:43.788822 29538 raft_consensus.cc:697] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
W20260709 12:21:43.806476 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 69551.7us
W20260709 12:21:43.807945 29180 leader_election.cc:343] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.824239 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:43.832530 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:43.838668 29538 consensus_queue.cc:237] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:43.841306 29336 tablet_bootstrap.cc:654] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.842972 29337 tablet_bootstrap.cc:492] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
W20260709 12:21:43.841938 29256 consensus_peers.cc:597] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.843699 29337 ts_tablet_manager.cc:1403] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.397s	user 0.041s	sys 0.044s
I20260709 12:21:43.843950 29063 raft_consensus.cc:2393] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e87f64602ef465cb6288f69964235a9 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:43.843087 29623 leader_election.cc:290] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:43.857034 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:43.858443 29212 raft_consensus.cc:2393] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in current term 1: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:43.860268 29137 raft_consensus.cc:2468] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:43.862042 29256 leader_election.cc:304] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:43.868237 29716 raft_consensus.cc:2804] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.868760 29716 raft_consensus.cc:697] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:43.869237 29338 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:43.870041 29338 ts_tablet_manager.cc:1403] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.417s	user 0.015s	sys 0.004s
I20260709 12:21:43.869680 29716 consensus_queue.cc:237] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:43.876817 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
W20260709 12:21:43.878914 29105 leader_election.cc:343] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.879433 29105 leader_election.cc:304] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:43.880282 29734 raft_consensus.cc:2749] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.884812 29031 leader_election.cc:304] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:43.888329 29338 raft_consensus.cc:359] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.889571 29338 raft_consensus.cc:385] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.889766 29338 raft_consensus.cc:740] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.891047 29626 raft_consensus.cc:2749] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:43.896903 29338 consensus_queue.cc:260] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:43.909384 29338 ts_tablet_manager.cc:1434] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 12:21:43.910562 29338 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:43.913858 29341 tablet_bootstrap.cc:654] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.915719 28959 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42088 (request call id 72) took 1229 ms. Trace:
W20260709 12:21:43.928380 29736 log.cc:927] Time spent T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:21:43.916915 29711 consensus_queue.cc:1048] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:21:43.891829 29285 raft_consensus.cc:2468] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
W20260709 12:21:43.978181 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 59817.9us
I20260709 12:21:43.984259 29338 tablet_bootstrap.cc:654] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:43.983397 29163 debug-util.cc:398] Leaking SignalData structure 0x7b08002c47c0 after lost signal to thread 18964
I20260709 12:21:43.992921 29179 leader_election.cc:304] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:43.988497 29181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 68561.6us
W20260709 12:21:43.998155 29163 debug-util.cc:398] Leaking SignalData structure 0x7b080026d6a0 after lost signal to thread 28998
I20260709 12:21:43.916291 28959 rpcz_store.cc:276] 0709 12:21:42.686376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.021328 (+334952us) service_pool.cc:224] Handling call
0709 12:21:43.915648 (+894320us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:43.485062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:43.485686 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:43.485731 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:21:43.485756 (+    25us) tablet.cc:662] Decoding operations
0709 12:21:43.486226 (+   470us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:43.486291 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:43.486319 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:43.486642 (+   323us) tablet.cc:701] Row locks acquired
0709 12:21:43.486655 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:21:43.486819 (+   164us) write_op.cc:270] Start()
0709 12:21:43.486928 (+   109us) write_op.cc:276] Timestamp: P: 1783599703486772 usec, L: 0
0709 12:21:43.486944 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:21:43.491879 (+  4935us) log.cc:844] Serialized 540 byte log entry
0709 12:21:43.650459 (+158580us) op_driver.cc:464] REPLICATION: finished
0709 12:21:43.809639 (+159180us) write_op.cc:301] APPLY: starting
0709 12:21:43.810818 (+  1179us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:43.813893 (+  3075us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:43.828373 (+ 14480us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:43.855125 (+ 26752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:43.876553 (+ 21428us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:43.884674 (+  8121us) write_op.cc:312] APPLY: finished
0709 12:21:43.891177 (+  6503us) log.cc:844] Serialized 22 byte log entry
0709 12:21:43.894120 (+  2943us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:43.895910 (+  1790us) write_op.cc:454] Released schema lock
0709 12:21:43.896905 (+   995us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":119063,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":135152,"apply.run_cpu_time_us":3008,"apply.run_wall_time_us":98569,"num_ops":1,"prepare.queue_time_us":101812,"prepare.run_cpu_time_us":2983,"prepare.run_wall_time_us":54747,"replication_time_us":163343,"thread_start_us":129517,"threads_started":2}]]}
I20260709 12:21:43.985774 29180 leader_election.cc:304] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:44.015627 29615 raft_consensus.cc:2804] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.031818 29337 raft_consensus.cc:359] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.034220 29337 raft_consensus.cc:385] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.034499 29337 raft_consensus.cc:740] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.036386 29337 consensus_queue.cc:260] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.041381 29412 raft_consensus.cc:2749] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.038380 29615 raft_consensus.cc:697] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:44.044142 29615 consensus_queue.cc:237] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.045499 29337 ts_tablet_manager.cc:1434] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.201s	user 0.009s	sys 0.004s
I20260709 12:21:44.046686 29337 tablet_bootstrap.cc:492] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
W20260709 12:21:44.039331 29163 debug-util.cc:398] Leaking SignalData structure 0x7b080023ba40 after lost signal to thread 29091
W20260709 12:21:44.057240 29163 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9b40 after lost signal to thread 29166
W20260709 12:21:44.059342 29163 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8880 after lost signal to thread 29241
I20260709 12:21:44.059906 29337 tablet_bootstrap.cc:654] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:44.062343 29163 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef3e0 after lost signal to thread 29315
I20260709 12:21:44.066375 29341 tablet_bootstrap.cc:492] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:44.066913 29341 ts_tablet_manager.cc:1403] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.278s	user 0.014s	sys 0.034s
I20260709 12:21:44.090615 29341 raft_consensus.cc:359] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.091737 29341 raft_consensus.cc:385] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.092096 29341 raft_consensus.cc:740] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.093483 29341 consensus_queue.cc:260] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.110783 29341 ts_tablet_manager.cc:1434] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 12:21:44.111651 29398 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:44.073076 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 144078us
I20260709 12:21:44.119510 29336 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:44.120163 29336 ts_tablet_manager.cc:1403] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.358s	user 0.037s	sys 0.050s
I20260709 12:21:44.116518 29398 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:44.122807 29398 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:44.125238 29341 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
W20260709 12:21:44.114013 29163 debug-util.cc:398] Leaking SignalData structure 0x7b080003df40 after lost signal to thread 29618
I20260709 12:21:44.140214 29066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:44.141768 29106 leader_election.cc:343] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.142587 29734 consensus_queue.cc:1048] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.144126 29211 raft_consensus.cc:3060] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.157565 29337 tablet_bootstrap.cc:492] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:44.158154 29337 ts_tablet_manager.cc:1403] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.025s
I20260709 12:21:44.161295 29337 raft_consensus.cc:359] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.162007 29337 raft_consensus.cc:385] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.162267 29337 raft_consensus.cc:740] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.163018 29337 consensus_queue.cc:260] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.166960 29621 raft_consensus.cc:493] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.168381 29336 raft_consensus.cc:359] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.169754 29336 raft_consensus.cc:385] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.170117 29336 raft_consensus.cc:740] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.171510 29336 consensus_queue.cc:260] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.179845 29337 ts_tablet_manager.cc:1434] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:21:44.167496 29621 raft_consensus.cc:515] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.191828 29337 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:44.193663 29621 leader_election.cc:290] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:44.199311 29337 tablet_bootstrap.cc:654] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.201309 28963 catalog_manager.cc:5697] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:44.204404 29031 consensus_peers.cc:597] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:44.206811 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:44.207533 29138 raft_consensus.cc:2468] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:44.208950 29338 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:44.209517 29338 ts_tablet_manager.cc:1403] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.299s	user 0.014s	sys 0.040s
I20260709 12:21:44.208316 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:44.209728 29256 leader_election.cc:304] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:44.210654 29716 raft_consensus.cc:2804] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.211176 29716 raft_consensus.cc:493] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.211696 29716 raft_consensus.cc:3060] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.216336 29672 raft_consensus.cc:493] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.217082 29672 raft_consensus.cc:515] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
W20260709 12:21:44.220888 29256 leader_election.cc:343] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.239126 29338 raft_consensus.cc:359] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.240473 29338 raft_consensus.cc:385] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.240752 29338 raft_consensus.cc:740] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.241430 29338 consensus_queue.cc:260] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.257006 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:44.258721 29746 log.cc:927] Time spent T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:21:44.259205 29672 leader_election.cc:290] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:44.256619 29626 consensus_queue.cc:1048] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:44.261768 29338 ts_tablet_manager.cc:1434] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 12:21:44.263016 29338 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:44.270117 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:44.272086 29623 raft_consensus.cc:493] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.272605 29623 raft_consensus.cc:515] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.275031 29623 leader_election.cc:290] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:44.276398 29213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:44.277189 29105 leader_election.cc:343] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.279480 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:44.279649 29716 raft_consensus.cc:515] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.292397 29716 leader_election.cc:290] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:44.296187 29338 tablet_bootstrap.cc:654] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.343962 29336 ts_tablet_manager.cc:1434] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.131s	user 0.010s	sys 0.000s
I20260709 12:21:44.345305 29336 tablet_bootstrap.cc:492] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:44.342036 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:44.347713 29137 raft_consensus.cc:3060] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.348619 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b638bc90c6b4ca4a599a9104e10af3b" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:44.315367 29217 raft_consensus.cc:3060] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.355050 29290 raft_consensus.cc:2393] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in current term 1: Already voted for candidate 7e87f64602ef465cb6288f69964235a9 in this term.
W20260709 12:21:44.363823 29107 leader_election.cc:343] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.371951 29337 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:44.415069 29337 ts_tablet_manager.cc:1403] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.223s	user 0.066s	sys 0.059s
I20260709 12:21:44.416004 29107 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:44.313624 29538 consensus_queue.cc:1048] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 12:21:44.386992 29341 tablet_bootstrap.cc:654] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.422291 29672 raft_consensus.cc:2749] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:44.397552 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:44.398793 29714 raft_consensus.cc:493] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.362780 29621 consensus_queue.cc:1048] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:21:44.400557 29029 leader_election.cc:304] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:44.404706 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
W20260709 12:21:44.442253 29029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 54758.2us
I20260709 12:21:44.444263 29625 raft_consensus.cc:3060] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.446033 29341 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:44.446693 29341 ts_tablet_manager.cc:1403] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.332s	user 0.019s	sys 0.000s
I20260709 12:21:44.418069 29680 raft_consensus.cc:493] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.448836 29680 raft_consensus.cc:515] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.441428 29714 raft_consensus.cc:515] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.454632 29716 consensus_queue.cc:1048] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 12:21:44.465768 29256 leader_election.cc:343] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.463129 29714 leader_election.cc:290] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:44.473106 29341 raft_consensus.cc:359] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:44.481303 29341 raft_consensus.cc:385] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.481760 29341 raft_consensus.cc:740] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.482833 29341 consensus_queue.cc:260] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:44.417284 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 53527.3us
W20260709 12:21:44.490163 29107 leader_election.cc:343] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.490633 29107 leader_election.cc:304] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:44.492905 29338 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:44.493675 29338 ts_tablet_manager.cc:1403] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.231s	user 0.010s	sys 0.008s
W20260709 12:21:44.496526 29256 consensus_peers.cc:597] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:44.495983 29538 raft_consensus.cc:2749] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.512192 29341 ts_tablet_manager.cc:1434] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.002s
I20260709 12:21:44.516762 29337 raft_consensus.cc:359] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.523821 29337 raft_consensus.cc:385] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.524096 29337 raft_consensus.cc:740] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.526130 29337 consensus_queue.cc:260] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.528297 29625 raft_consensus.cc:2749] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.529465 29064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:44.532928 29338 raft_consensus.cc:359] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.534257 29338 raft_consensus.cc:385] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.534605 29338 raft_consensus.cc:740] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.535173 29338 consensus_queue.cc:260] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.536919 29336 tablet_bootstrap.cc:654] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.550289 29337 ts_tablet_manager.cc:1434] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.135s	user 0.011s	sys 0.000s
I20260709 12:21:44.552255 29337 tablet_bootstrap.cc:492] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:44.552506 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:44.553294 29141 raft_consensus.cc:2468] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:44.554595 29680 leader_election.cc:290] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:44.556981 29137 raft_consensus.cc:2468] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:44.557868 29341 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:44.559007 29337 tablet_bootstrap.cc:654] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.549222 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:44.559820 29338 ts_tablet_manager.cc:1434] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.004s
I20260709 12:21:44.561002 29256 leader_election.cc:304] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:44.562172 29256 leader_election.cc:304] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:44.569119 29714 raft_consensus.cc:2804] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.569693 29714 raft_consensus.cc:697] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:44.564883 29716 raft_consensus.cc:2804] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.570775 29338 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:44.570604 29714 consensus_queue.cc:237] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.571170 29716 raft_consensus.cc:493] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.579082 29716 raft_consensus.cc:3060] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.594476 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:44.568681 29707 consensus_queue.cc:1048] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:21:44.605690 29061 raft_consensus.cc:3060] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.570658 29064 raft_consensus.cc:2468] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:44.628041 29341 tablet_bootstrap.cc:654] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:44.625610 29758 log.cc:927] Time spent T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:21:44.613757 29029 leader_election.cc:304] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:44.645076 29712 consensus_queue.cc:1048] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 12:21:44.660825 29029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 62149.7us
W20260709 12:21:44.673842 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 70655.9us
I20260709 12:21:44.681866 29700 consensus_queue.cc:1048] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.650331 29701 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.684391 29701 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.694590 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:44.698480 29179 leader_election.cc:343] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.687243 29701 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:44.739439 29338 tablet_bootstrap.cc:654] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.766546 29336 tablet_bootstrap.cc:492] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:44.767239 29336 ts_tablet_manager.cc:1403] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.422s	user 0.017s	sys 0.003s
I20260709 12:21:44.775874 29336 raft_consensus.cc:359] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.777673 29064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:44.776671 29336 raft_consensus.cc:385] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.782617 29336 raft_consensus.cc:740] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.783257 29701 consensus_queue.cc:1048] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.783360 29336 consensus_queue.cc:260] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.786158 29336 ts_tablet_manager.cc:1434] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:21:44.787343 29336 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
W20260709 12:21:44.809648 29180 leader_election.cc:343] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.810228 29180 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:44.815183 29615 raft_consensus.cc:2749] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.845607 29681 raft_consensus.cc:2749] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.854455 29337 tablet_bootstrap.cc:492] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:44.855018 29341 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:44.855120 29337 ts_tablet_manager.cc:1403] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.303s	user 0.014s	sys 0.015s
I20260709 12:21:44.855690 29341 ts_tablet_manager.cc:1403] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.320s	user 0.053s	sys 0.036s
I20260709 12:21:44.858657 29341 raft_consensus.cc:359] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:44.859370 29341 raft_consensus.cc:385] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.859830 29341 raft_consensus.cc:740] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.859133 29337 raft_consensus.cc:359] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.860499 29341 consensus_queue.cc:260] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:44.861229 29337 raft_consensus.cc:385] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.861552 29337 raft_consensus.cc:740] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.862337 29337 consensus_queue.cc:260] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:44.864626 29337 ts_tablet_manager.cc:1434] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:44.865727 29337 tablet_bootstrap.cc:492] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:44.869076 29341 ts_tablet_manager.cc:1434] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:44.869954 29716 raft_consensus.cc:515] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.870483 29341 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:44.872526 29337 tablet_bootstrap.cc:654] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.888038 29338 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:44.888572 29338 ts_tablet_manager.cc:1403] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.318s	user 0.017s	sys 0.011s
I20260709 12:21:44.889719 29672 raft_consensus.cc:493] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.890275 29672 raft_consensus.cc:515] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:44.890595 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:44.891319 29061 raft_consensus.cc:3060] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.891636 29338 raft_consensus.cc:359] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.892346 29338 raft_consensus.cc:385] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.892656 29338 raft_consensus.cc:740] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.893395 29338 consensus_queue.cc:260] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.894375 29716 leader_election.cc:290] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:44.895881 29338 ts_tablet_manager.cc:1434] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:44.896080 29336 tablet_bootstrap.cc:654] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.897389 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:44.898008 29142 raft_consensus.cc:3060] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.899880 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2294d7212b244ba80173c04a7ae214e" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:44.904366 29107 leader_election.cc:343] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.906061 29672 leader_election.cc:290] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:44.906733 29142 raft_consensus.cc:2468] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:44.907323 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2294d7212b244ba80173c04a7ae214e" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:44.909432 29106 leader_election.cc:343] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.909557 29256 leader_election.cc:304] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:44.909899 29106 leader_election.cc:304] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:44.907692 29338 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:44.910880 29621 raft_consensus.cc:2804] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.910910 29672 raft_consensus.cc:2749] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.911548 29621 raft_consensus.cc:697] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:44.914907 28963 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42066 (request call id 85) took 1568 ms. Trace:
I20260709 12:21:44.915299 28963 rpcz_store.cc:276] 0709 12:21:43.346934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.347164 (+   230us) service_pool.cc:224] Handling call
0709 12:21:44.914813 (+1567649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:44.440391 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:44.472111 (+ 31720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:44.474327 (+  2216us) write_op.cc:435] Acquired schema lock
0709 12:21:44.480239 (+  5912us) tablet.cc:662] Decoding operations
0709 12:21:44.518162 (+ 37923us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:44.520069 (+  1907us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:44.522436 (+  2367us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:44.531671 (+  9235us) tablet.cc:701] Row locks acquired
0709 12:21:44.531687 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:21:44.531856 (+   169us) write_op.cc:270] Start()
0709 12:21:44.531984 (+   128us) write_op.cc:276] Timestamp: P: 1783599704531803 usec, L: 0
0709 12:21:44.532012 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:21:44.532783 (+   771us) log.cc:844] Serialized 540 byte log entry
0709 12:21:44.720626 (+187843us) op_driver.cc:464] REPLICATION: finished
0709 12:21:44.885487 (+164861us) write_op.cc:301] APPLY: starting
0709 12:21:44.896755 (+ 11268us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:44.896867 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:44.896999 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:44.897241 (+   242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:44.897412 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:44.897462 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:44.897676 (+   214us) log.cc:844] Serialized 22 byte log entry
0709 12:21:44.901920 (+  4244us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:44.902016 (+    96us) write_op.cc:454] Released schema lock
0709 12:21:44.902060 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":12956,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":143737,"num_ops":1,"prepare.queue_time_us":209216,"prepare.run_cpu_time_us":3776,"prepare.run_wall_time_us":95801,"replication_time_us":137242,"thread_start_us":203361,"threads_started":2}]]}
I20260709 12:21:44.918385 29338 tablet_bootstrap.cc:654] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.918911 28960 catalog_manager.cc:5697] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.919344 29621 consensus_queue.cc:237] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.920957 28960 catalog_manager.cc:5697] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.918197 29061 raft_consensus.cc:2468] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:44.932192 29337 tablet_bootstrap.cc:492] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:44.932747 29337 ts_tablet_manager.cc:1403] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.008s
I20260709 12:21:44.922856 28960 catalog_manager.cc:5697] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:44.941642 29341 tablet_bootstrap.cc:654] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.947969 28962 catalog_manager.cc:5697] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.950026 29336 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:44.950613 29336 ts_tablet_manager.cc:1403] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.002s
I20260709 12:21:44.950273 28962 catalog_manager.cc:5697] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } }
I20260709 12:21:44.962414 29336 raft_consensus.cc:359] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.967741 29336 raft_consensus.cc:385] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.971957 29336 raft_consensus.cc:740] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.972834 29336 consensus_queue.cc:260] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:44.979384 29577 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.988842 29336 ts_tablet_manager.cc:1434] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:21:44.988910 29577 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:44.990036 29336 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:44.964769 29337 raft_consensus.cc:359] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.067970 29337 raft_consensus.cc:385] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.068831 29337 raft_consensus.cc:740] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.022013 29341 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:44.991389 29577 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:45.024478 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:45.048834 29716 raft_consensus.cc:493] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.076103 29716 raft_consensus.cc:515] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.076583 29741 consensus_queue.cc:1048] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.018208 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:45.075407 29029 leader_election.cc:343] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.051903 29412 raft_consensus.cc:493] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.080084 29341 ts_tablet_manager.cc:1403] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.210s	user 0.020s	sys 0.010s
I20260709 12:21:45.080488 29412 raft_consensus.cc:515] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.083434 29212 raft_consensus.cc:2468] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:45.086179 29031 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:45.086985 29577 raft_consensus.cc:2804] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.087373 29577 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.087731 29577 raft_consensus.cc:3060] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.069783 29337 consensus_queue.cc:260] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.100232 29337 ts_tablet_manager.cc:1434] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.167s	user 0.010s	sys 0.011s
I20260709 12:21:45.127102 29538 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.127770 29538 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:45.129339 29213 raft_consensus.cc:3060] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.131402 29538 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:45.132249 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:45.134727 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:45.135289 29412 leader_election.cc:290] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:45.135447 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:45.139257 29337 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:45.144699 29106 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:45.147360 29338 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:45.147708 29700 raft_consensus.cc:2749] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.147921 29338 ts_tablet_manager.cc:1403] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.240s	user 0.033s	sys 0.031s
I20260709 12:21:45.049800 28959 catalog_manager.cc:5697] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.152760 29336 tablet_bootstrap.cc:654] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:45.164243 29031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 78176.6us
I20260709 12:21:45.166133 29142 raft_consensus.cc:3060] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.173054 28962 catalog_manager.cc:5697] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.175016 29337 tablet_bootstrap.cc:654] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.178002 29338 raft_consensus.cc:359] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:45.178740 29338 raft_consensus.cc:385] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.178999 29338 raft_consensus.cc:740] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.179684 29338 consensus_queue.cc:260] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:45.181600 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:45.182381 29141 raft_consensus.cc:2468] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:45.183810 29256 leader_election.cc:304] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:45.203971 29217 raft_consensus.cc:3060] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.218281 29716 leader_election.cc:290] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:45.221203 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:45.193723 29621 raft_consensus.cc:2804] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.222440 29621 raft_consensus.cc:493] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.222805 29621 raft_consensus.cc:3060] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.239954 29341 raft_consensus.cc:359] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.240832 29341 raft_consensus.cc:385] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.241099 29341 raft_consensus.cc:740] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.241828 29341 consensus_queue.cc:260] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.244393 29179 leader_election.cc:304] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:45.256567 29338 ts_tablet_manager.cc:1434] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.001s
I20260709 12:21:45.268095 29341 ts_tablet_manager.cc:1434] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.188s	user 0.006s	sys 0.005s
I20260709 12:21:45.274313 29338 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:45.271153 29680 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.245517 29716 consensus_queue.cc:1048] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:21:45.279062 29680 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:45.287338 29680 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:45.291199 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:45.291915 29137 raft_consensus.cc:2468] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 0.
I20260709 12:21:45.272519 29577 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.268344 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:45.295266 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:45.296969 29256 leader_election.cc:343] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.301537 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
W20260709 12:21:45.303043 29029 leader_election.cc:343] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.303719 29341 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018: Bootstrap starting.
I20260709 12:21:45.305759 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:45.306366 29577 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:45.307948 29217 raft_consensus.cc:3060] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:45.318449 29031 leader_election.cc:343] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.320272 29741 raft_consensus.cc:493] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.320859 29741 raft_consensus.cc:515] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.323411 29031 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:45.326936 29784 raft_consensus.cc:2804] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.332477 29412 raft_consensus.cc:2749] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.332401 29784 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.336467 29784 raft_consensus.cc:3060] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.303413 29621 raft_consensus.cc:515] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.341473 29621 leader_election.cc:290] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:45.348838 29336 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:45.349555 29336 ts_tablet_manager.cc:1403] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.360s	user 0.033s	sys 0.029s
I20260709 12:21:45.353417 29741 leader_election.cc:290] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:45.354110 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341064dd172e4bfc87467b2395fcad6b" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:45.354324 29213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:45.354758 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341064dd172e4bfc87467b2395fcad6b" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:45.355891 29255 leader_election.cc:343] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:45.356582 29256 leader_election.cc:343] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.357012 29256 leader_election.cc:304] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:45.359083 29256 leader_election.cc:343] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.349905 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:45.361129 29142 raft_consensus.cc:3060] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.361361 29741 raft_consensus.cc:2749] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.362661 29338 tablet_bootstrap.cc:654] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.366904 29217 raft_consensus.cc:2468] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:45.371977 29336 raft_consensus.cc:359] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.372740 29336 raft_consensus.cc:385] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.376585 29142 raft_consensus.cc:2468] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:45.377823 29256 leader_election.cc:304] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:45.373092 29336 raft_consensus.cc:740] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.381027 29031 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:45.380872 29741 raft_consensus.cc:2804] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.385040 29620 raft_consensus.cc:2804] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.387243 29336 consensus_queue.cc:260] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.391503 29620 raft_consensus.cc:697] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:45.407757 29620 consensus_queue.cc:237] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.416123 29336 ts_tablet_manager.cc:1434] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:21:45.392711 29741 raft_consensus.cc:697] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:45.418952 29707 consensus_queue.cc:1048] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:21:45.418996 28959 catalog_manager.cc:5697] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } }
I20260709 12:21:45.435209 29336 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:45.442694 29336 tablet_bootstrap.cc:654] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.444350 29341 tablet_bootstrap.cc:654] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.429289 29741 consensus_queue.cc:237] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.443445 29784 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:45.464605 28960 catalog_manager.cc:5697] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.480803 29337 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:45.481459 29337 ts_tablet_manager.cc:1403] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.342s	user 0.021s	sys 0.016s
W20260709 12:21:45.485675 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:45.501422 29341 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018: No bootstrap required, opened a new log
I20260709 12:21:45.505441 29341 ts_tablet_manager.cc:1403] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018: Time spent bootstrapping tablet: real 0.233s	user 0.010s	sys 0.008s
I20260709 12:21:45.510159 29337 raft_consensus.cc:359] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.512341 29337 raft_consensus.cc:385] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.512651 29337 raft_consensus.cc:740] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.522403 29337 consensus_queue.cc:260] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.533123 29337 ts_tablet_manager.cc:1434] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.004s
I20260709 12:21:45.552654 29338 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:45.554257 29338 ts_tablet_manager.cc:1403] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.282s	user 0.020s	sys 0.004s
I20260709 12:21:45.557945 29337 tablet_bootstrap.cc:492] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:45.559028 29341 raft_consensus.cc:359] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.561157 29341 raft_consensus.cc:385] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.561403 29341 raft_consensus.cc:740] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.565886 29341 consensus_queue.cc:260] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.574868 29784 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:45.576913 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:45.577252 29733 raft_consensus.cc:493] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.577654 29141 raft_consensus.cc:3060] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.577978 29733 raft_consensus.cc:515] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.581102 29707 consensus_queue.cc:1048] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.584841 29733 leader_election.cc:290] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:45.589737 29141 raft_consensus.cc:2468] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 1.
I20260709 12:21:45.590328 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341064dd172e4bfc87467b2395fcad6b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:45.591133 29031 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
W20260709 12:21:45.591948 29106 leader_election.cc:343] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.592043 29784 raft_consensus.cc:2804] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.592762 29784 raft_consensus.cc:697] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:21:45.593647 29784 consensus_queue.cc:237] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:45.597767 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:45.597831 29338 raft_consensus.cc:359] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.598651 29338 raft_consensus.cc:385] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.598950 29338 raft_consensus.cc:740] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.599640 29341 ts_tablet_manager.cc:1434] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.003s
I20260709 12:21:45.599973 29338 consensus_queue.cc:260] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.602931 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341064dd172e4bfc87467b2395fcad6b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:45.603869 29338 ts_tablet_manager.cc:1434] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
W20260709 12:21:45.608191 29031 leader_election.cc:343] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.605501 29285 raft_consensus.cc:2468] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:45.604377 29733 raft_consensus.cc:493] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.617513 29105 leader_election.cc:304] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:45.617906 29733 raft_consensus.cc:515] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.618332 29700 raft_consensus.cc:2804] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.618805 29700 raft_consensus.cc:493] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.619153 29700 raft_consensus.cc:3060] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.620332 29733 leader_election.cc:290] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:45.621218 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67bcd4012bb45829241ae1389b6afa3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:45.621924 29289 raft_consensus.cc:2468] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 0.
I20260709 12:21:45.623129 29105 leader_election.cc:304] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:45.624166 29733 raft_consensus.cc:2804] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.624522 29733 raft_consensus.cc:493] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.624862 29733 raft_consensus.cc:3060] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.625514 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67bcd4012bb45829241ae1389b6afa3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
W20260709 12:21:45.627743 29106 leader_election.cc:343] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.629812 29336 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:45.630370 29336 ts_tablet_manager.cc:1403] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.198s	user 0.034s	sys 0.006s
I20260709 12:21:45.638411 29336 raft_consensus.cc:359] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.639209 29336 raft_consensus.cc:385] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.648679 29700 raft_consensus.cc:515] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.639484 29336 raft_consensus.cc:740] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.655966 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341064dd172e4bfc87467b2395fcad6b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:45.659313 29289 raft_consensus.cc:3060] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.656584 29338 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:45.663440 29336 consensus_queue.cc:260] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.664139 28960 catalog_manager.cc:5697] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.668238 29337 tablet_bootstrap.cc:654] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.667814 28961 catalog_manager.cc:5697] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.671612 29336 ts_tablet_manager.cc:1434] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:21:45.672979 29336 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:45.633896 29733 raft_consensus.cc:515] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.682304 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67bcd4012bb45829241ae1389b6afa3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:45.682971 29733 leader_election.cc:290] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:45.683171 29285 raft_consensus.cc:3060] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.682364 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67bcd4012bb45829241ae1389b6afa3" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:45.683002 29289 raft_consensus.cc:2468] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:45.692214 29105 leader_election.cc:304] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:45.695390 29733 raft_consensus.cc:2804] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.697058 29733 raft_consensus.cc:697] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
W20260709 12:21:45.697296 29106 leader_election.cc:343] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.697978 29733 consensus_queue.cc:237] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.723981 29639 raft_consensus.cc:493] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.724617 29639 raft_consensus.cc:515] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.728096 29336 tablet_bootstrap.cc:654] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.728396 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:45.728538 29639 leader_election.cc:290] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:45.729668 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:45.737385 29180 leader_election.cc:343] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:45.737947 29179 leader_election.cc:343] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.738387 29179 leader_election.cc:304] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:45.739351 29790 raft_consensus.cc:2749] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.740144 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341064dd172e4bfc87467b2395fcad6b" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:45.734570 29700 leader_election.cc:290] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:45.743283 29106 leader_election.cc:343] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.781580 29338 tablet_bootstrap.cc:654] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.722530 29285 raft_consensus.cc:2468] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:45.797590 29105 leader_election.cc:304] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:45.798985 29700 raft_consensus.cc:2804] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.799592 29700 raft_consensus.cc:697] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:45.800493 29700 consensus_queue.cc:237] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.802538 28959 catalog_manager.cc:5697] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.810189 28961 catalog_manager.cc:5697] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.819991 29337 tablet_bootstrap.cc:492] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:45.822162 29337 ts_tablet_manager.cc:1403] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.264s	user 0.015s	sys 0.011s
I20260709 12:21:45.847546 29711 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.848269 29711 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.854210 29337 raft_consensus.cc:359] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.855067 29337 raft_consensus.cc:385] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.855295 29337 raft_consensus.cc:740] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.862035 29336 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:45.862787 29336 ts_tablet_manager.cc:1403] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.190s	user 0.015s	sys 0.006s
I20260709 12:21:45.861171 29711 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:45.863873 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:45.866001 29214 raft_consensus.cc:2393] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91fd10ed5c3e47fcb354c51acbe25286 in current term 1: Already voted for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in this term.
I20260709 12:21:45.866888 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:45.869952 29256 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:45.869644 28961 catalog_manager.cc:5697] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.871395 29337 consensus_queue.cc:260] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:45.871330 29711 raft_consensus.cc:3060] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.877336 29337 ts_tablet_manager.cc:1434] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:21:45.878394 29337 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:45.887015 29784 raft_consensus.cc:493] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.887669 29784 raft_consensus.cc:515] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.888965 29338 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:45.891052 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5356a7d1c64926aeed795d25f96c0c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:45.891588 29338 ts_tablet_manager.cc:1403] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.280s	user 0.033s	sys 0.019s
I20260709 12:21:45.895445 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5356a7d1c64926aeed795d25f96c0c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:45.895704 29031 leader_election.cc:343] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.896282 29784 leader_election.cc:290] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
W20260709 12:21:45.896904 29029 leader_election.cc:343] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.898070 29029 leader_election.cc:304] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:45.900441 29338 raft_consensus.cc:359] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.901906 29338 raft_consensus.cc:385] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.900825 29784 raft_consensus.cc:2749] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.902388 29338 raft_consensus.cc:740] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.903673 29338 consensus_queue.cc:260] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:45.913053 29337 tablet_bootstrap.cc:654] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.911101 29336 raft_consensus.cc:359] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.915787 29336 raft_consensus.cc:385] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.916127 29336 raft_consensus.cc:740] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.910936 29338 ts_tablet_manager.cc:1434] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:21:45.918051 29338 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:45.916980 29336 consensus_queue.cc:260] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.920861 29211 raft_consensus.cc:3060] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.940428 29336 ts_tablet_manager.cc:1434] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 12:21:45.941278 29714 consensus_queue.cc:1048] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.944509 29711 raft_consensus.cc:2749] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.945670 29766 consensus_queue.cc:1048] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.949116 29621 raft_consensus.cc:493] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.949613 29621 raft_consensus.cc:515] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:45.949919 29680 consensus_queue.cc:1048] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.951967 29621 leader_election.cc:290] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:45.952723 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:45.953409 29217 raft_consensus.cc:2468] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:45.954735 29256 leader_election.cc:304] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:45.955745 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:45.957901 29621 raft_consensus.cc:2804] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.958325 29621 raft_consensus.cc:493] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.958674 29621 raft_consensus.cc:3060] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:45.958489 29255 leader_election.cc:343] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.962845 29336 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286: Bootstrap starting.
I20260709 12:21:45.978698 29336 tablet_bootstrap.cc:654] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.978819 29338 tablet_bootstrap.cc:654] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.996650 29621 raft_consensus.cc:515] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.000154 29061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
W20260709 12:21:46.001629 29255 leader_election.cc:343] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.003993 29337 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:46.004616 29337 ts_tablet_manager.cc:1403] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.000s
I20260709 12:21:46.009003 29336 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286: No bootstrap required, opened a new log
I20260709 12:21:46.009553 29336 ts_tablet_manager.cc:1403] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.003s
I20260709 12:21:46.009888 29337 raft_consensus.cc:359] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.010667 29337 raft_consensus.cc:385] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.010946 29337 raft_consensus.cc:740] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.011641 29337 consensus_queue.cc:260] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.012681 29336 raft_consensus.cc:359] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.013376 29336 raft_consensus.cc:385] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.013617 29336 raft_consensus.cc:740] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.014240 29336 consensus_queue.cc:260] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.015184 29621 leader_election.cc:290] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:46.015309 29338 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:46.016355 29338 ts_tablet_manager.cc:1403] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.018s
I20260709 12:21:46.019475 29338 raft_consensus.cc:359] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:46.020183 29338 raft_consensus.cc:385] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.020463 29338 raft_consensus.cc:740] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.026618 29784 consensus_queue.cc:1048] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.027165 29338 consensus_queue.cc:260] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:46.034322 29337 ts_tablet_manager.cc:1434] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:21:46.035812 29337 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:46.035928 29211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:46.036635 29211 raft_consensus.cc:3060] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.043081 29337 tablet_bootstrap.cc:654] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.049404 29338 ts_tablet_manager.cc:1434] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:21:46.050622 29338 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:46.057344 29337 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:46.057993 29337 ts_tablet_manager.cc:1403] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:21:46.062856 29337 raft_consensus.cc:359] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.063730 29337 raft_consensus.cc:385] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.064035 29337 raft_consensus.cc:740] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.065441 29337 consensus_queue.cc:260] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.066530 29336 ts_tablet_manager.cc:1434] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:21:46.072811 29337 ts_tablet_manager.cc:1434] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:21:46.074574 29337 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9: Bootstrap starting.
I20260709 12:21:46.079249 29338 tablet_bootstrap.cc:654] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.095491 29784 consensus_queue.cc:1048] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.098398 29337 tablet_bootstrap.cc:654] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.105132 29711 raft_consensus.cc:493] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.114171 29711 raft_consensus.cc:515] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.125974 29711 leader_election.cc:290] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:46.136314 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5356a7d1c64926aeed795d25f96c0c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:46.137426 29063 raft_consensus.cc:2468] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 0.
I20260709 12:21:46.140730 29255 leader_election.cc:304] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:46.143321 29741 raft_consensus.cc:2804] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.148893 29211 raft_consensus.cc:2468] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:46.152905 29741 raft_consensus.cc:493] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.166427 29213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5356a7d1c64926aeed795d25f96c0c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:46.168169 29338 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:46.168766 29338 ts_tablet_manager.cc:1403] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.003s
I20260709 12:21:46.170653 29741 raft_consensus.cc:3060] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.170773 29063 raft_consensus.cc:3060] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.173066 29338 raft_consensus.cc:359] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.173828 29338 raft_consensus.cc:385] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.174081 29338 raft_consensus.cc:740] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.179817 29639 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.180353 29639 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.180878 29338 consensus_queue.cc:260] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.182629 29639 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:46.188944 29337 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9: No bootstrap required, opened a new log
I20260709 12:21:46.189803 29337 ts_tablet_manager.cc:1403] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.016s
W20260709 12:21:46.196981 29256 leader_election.cc:343] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.199239 29061 raft_consensus.cc:3060] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.199906 29256 leader_election.cc:304] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:46.201872 29714 raft_consensus.cc:2804] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.203784 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:46.209409 29714 raft_consensus.cc:697] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:46.210361 29714 consensus_queue.cc:237] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.212848 29700 consensus_queue.cc:1048] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.221527 29338 ts_tablet_manager.cc:1434] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 12:21:46.222599 29338 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:46.223170 29815 log.cc:927] Time spent T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:21:46.227555 29700 consensus_queue.cc:1048] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:46.230489 29741 raft_consensus.cc:515] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.234228 29538 consensus_queue.cc:1048] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.246587 29741 leader_election.cc:290] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:46.250146 29213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5356a7d1c64926aeed795d25f96c0c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:46.251453 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d5356a7d1c64926aeed795d25f96c0c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:46.252180 29063 raft_consensus.cc:3060] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.270843 29338 tablet_bootstrap.cc:654] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.299165 28961 catalog_manager.cc:5697] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.300081 29538 consensus_queue.cc:1048] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:46.340281 29106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 63996.4us
I20260709 12:21:46.237552 29337 raft_consensus.cc:359] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.343829 29337 raft_consensus.cc:385] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.344177 29337 raft_consensus.cc:740] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.345140 29337 consensus_queue.cc:260] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.346113 29213 raft_consensus.cc:3060] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.354357 29337 ts_tablet_manager.cc:1434] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.001s
I20260709 12:21:46.354679 29213 raft_consensus.cc:2468] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
W20260709 12:21:46.364655 29031 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 129807us
I20260709 12:21:46.368348 29338 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: No bootstrap required, opened a new log
I20260709 12:21:46.368992 29338 ts_tablet_manager.cc:1403] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.020s
I20260709 12:21:46.370545 29256 leader_election.cc:304] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:46.375382 29707 raft_consensus.cc:2804] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.376458 29338 raft_consensus.cc:359] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.377337 29338 raft_consensus.cc:385] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.377712 29338 raft_consensus.cc:740] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.377192 29707 raft_consensus.cc:697] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:46.378914 29338 consensus_queue.cc:260] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.384243 29064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:46.380223 29063 raft_consensus.cc:2468] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:46.390002 29707 consensus_queue.cc:237] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.397500 29338 ts_tablet_manager.cc:1434] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 12:21:46.405553 29214 raft_consensus.cc:3060] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.407514 29180 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:46.446214 28959 catalog_manager.cc:5697] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 1 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.450079 29701 raft_consensus.cc:2749] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.464198 29784 consensus_queue.cc:1048] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.499732 29701 raft_consensus.cc:493] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.500375 29701 raft_consensus.cc:515] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.503456 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2294d7212b244ba80173c04a7ae214e" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" is_pre_election: true
I20260709 12:21:46.504314 29063 raft_consensus.cc:2468] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:46.505741 29180 leader_election.cc:304] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:21:46.507098 29817 raft_consensus.cc:2804] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.507133 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2294d7212b244ba80173c04a7ae214e" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:46.507637 29817 raft_consensus.cc:493] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.507975 29142 raft_consensus.cc:2468] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 0.
I20260709 12:21:46.508051 29817 raft_consensus.cc:3060] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.518059 29817 raft_consensus.cc:515] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.521507 29063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2294d7212b244ba80173c04a7ae214e" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
I20260709 12:21:46.504251 29701 leader_election.cc:290] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:46.522172 29063 raft_consensus.cc:3060] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.529951 29626 raft_consensus.cc:493] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.530755 29626 raft_consensus.cc:515] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:46.534754 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:46.535703 29217 raft_consensus.cc:2393] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in current term 1: Already voted for candidate 91fd10ed5c3e47fcb354c51acbe25286 in this term.
I20260709 12:21:46.538848 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:46.541091 29029 leader_election.cc:304] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:46.542065 29824 raft_consensus.cc:3060] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.544868 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2294d7212b244ba80173c04a7ae214e" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:46.545598 29142 raft_consensus.cc:3060] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.554031 29142 raft_consensus.cc:2468] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:46.555163 29181 leader_election.cc:304] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:46.556609 29701 raft_consensus.cc:2804] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.557194 29701 raft_consensus.cc:697] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:46.557590 29817 leader_election.cc:290] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 1 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:46.538404 29063 raft_consensus.cc:2468] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:46.558189 29701 consensus_queue.cc:237] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:46.573467 29824 raft_consensus.cc:2749] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:46.538829 29626 leader_election.cc:290] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
W20260709 12:21:46.581450 29012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:46.586628 28962 catalog_manager.cc:5697] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.616786 29741 consensus_queue.cc:1048] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.634769 29711 consensus_queue.cc:1048] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.803983 29741 consensus_queue.cc:1048] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.832233 29711 consensus_queue.cc:1048] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.975201 29701 consensus_queue.cc:1048] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:47.000583 29790 consensus_queue.cc:1048] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.671496 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
W20260709 12:21:47.706920 29180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:21:47.741086 29180 consensus_peers.cc:597] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:47.741784 29180 consensus_peers.cc:597] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:47.741869 29255 consensus_peers.cc:597] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:47.744462 29255 consensus_peers.cc:597] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:47.744612 29180 consensus_peers.cc:597] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.756886 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:47.758209 18961 tablet_replica.cc:333] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.759262 18961 raft_consensus.cc:2243] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.759929 18961 raft_consensus.cc:2272] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.760811 29106 consensus_peers.cc:597] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.770481 18961 tablet_replica.cc:333] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
W20260709 12:21:47.781740 29106 consensus_peers.cc:597] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.782972 18961 raft_consensus.cc:2243] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.785562 18961 raft_consensus.cc:2272] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.787801 18961 tablet_replica.cc:333] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.788548 18961 raft_consensus.cc:2243] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.788983 18961 raft_consensus.cc:2272] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.791100 18961 tablet_replica.cc:333] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.791759 18961 raft_consensus.cc:2243] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.792178 18961 raft_consensus.cc:2272] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.794149 18961 tablet_replica.cc:333] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.794756 18961 raft_consensus.cc:2243] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.795173 18961 raft_consensus.cc:2272] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.802825 18961 tablet_replica.cc:333] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.803843 18961 raft_consensus.cc:2243] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.804432 18961 raft_consensus.cc:2272] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.806413 29255 consensus_peers.cc:597] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.807194 18961 tablet_replica.cc:333] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
W20260709 12:21:47.808163 29180 consensus_peers.cc:597] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.808251 18961 raft_consensus.cc:2243] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.809122 18961 raft_consensus.cc:2272] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.811935 18961 tablet_replica.cc:333] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.812839 18961 raft_consensus.cc:2243] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.814504 18961 raft_consensus.cc:2272] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.817260 18961 tablet_replica.cc:333] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.818164 18961 raft_consensus.cc:2243] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.818724 18961 raft_consensus.cc:2272] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.821647 18961 tablet_replica.cc:333] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.822487 18961 raft_consensus.cc:2243] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.824505 18961 raft_consensus.cc:2272] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.827509 18961 tablet_replica.cc:333] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.829569 18961 raft_consensus.cc:2243] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.830670 18961 raft_consensus.cc:2272] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.833756 18961 tablet_replica.cc:333] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.834642 18961 raft_consensus.cc:2243] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.835273 18961 raft_consensus.cc:2272] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.838156 18961 tablet_replica.cc:333] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
W20260709 12:21:47.838321 29106 consensus_peers.cc:597] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.839017 18961 raft_consensus.cc:2243] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.839722 18961 raft_consensus.cc:2272] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.844532 18961 tablet_replica.cc:333] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
W20260709 12:21:47.845382 29106 consensus_peers.cc:597] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.845395 18961 raft_consensus.cc:2243] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.847445 18961 raft_consensus.cc:2272] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.852756 18961 tablet_replica.cc:333] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.853652 18961 raft_consensus.cc:2243] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.854684 18961 raft_consensus.cc:2272] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.858170 18961 tablet_replica.cc:333] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.859014 18961 raft_consensus.cc:2243] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.859575 18961 raft_consensus.cc:2272] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.862902 18961 tablet_replica.cc:333] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.863732 18961 raft_consensus.cc:2243] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.864790 18961 raft_consensus.cc:2272] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.867311 18961 tablet_replica.cc:333] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.868173 18961 raft_consensus.cc:2243] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.869082 18961 raft_consensus.cc:2272] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.871361 18961 tablet_replica.cc:333] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
W20260709 12:21:47.871275 29255 consensus_peers.cc:597] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.872519 18961 raft_consensus.cc:2243] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.873725 18961 raft_consensus.cc:2272] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.875711 29180 consensus_peers.cc:597] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.876511 18961 tablet_replica.cc:333] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.877465 18961 raft_consensus.cc:2243] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.878027 18961 raft_consensus.cc:2272] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.880896 18961 tablet_replica.cc:333] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.881562 18961 raft_consensus.cc:2243] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.882005 18961 raft_consensus.cc:2272] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.884472 18961 tablet_replica.cc:333] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.885298 18961 raft_consensus.cc:2243] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:21:47.885891 29255 consensus_peers.cc:597] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.886293 18961 raft_consensus.cc:2272] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.888609 18961 tablet_replica.cc:333] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.889222 18961 raft_consensus.cc:2243] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.889664 18961 raft_consensus.cc:2272] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.892161 18961 tablet_replica.cc:333] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.892827 18961 raft_consensus.cc:2243] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.893332 18961 raft_consensus.cc:2272] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.894788 29106 consensus_peers.cc:597] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.895815 18961 tablet_replica.cc:333] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.896507 18961 raft_consensus.cc:2243] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.896963 18961 raft_consensus.cc:2272] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.899484 18961 tablet_replica.cc:333] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.900290 18961 raft_consensus.cc:2243] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.900820 18961 raft_consensus.cc:2272] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.903126 18961 tablet_replica.cc:333] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.903854 18961 raft_consensus.cc:2243] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.904326 18961 raft_consensus.cc:2272] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.906563 18961 tablet_replica.cc:333] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.907176 18961 raft_consensus.cc:2243] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.908077 18961 raft_consensus.cc:2272] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.910239 18961 tablet_replica.cc:333] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.910897 18961 raft_consensus.cc:2243] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.911437 18961 raft_consensus.cc:2272] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.913971 18961 tablet_replica.cc:333] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.914765 18961 raft_consensus.cc:2243] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.916110 18961 raft_consensus.cc:2272] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.917812 29180 consensus_peers.cc:597] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.918951 18961 tablet_replica.cc:333] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.919649 18961 raft_consensus.cc:2243] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.920595 18961 raft_consensus.cc:2272] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.923030 18961 tablet_replica.cc:333] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.923805 18961 raft_consensus.cc:2243] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.924366 18961 raft_consensus.cc:2272] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.926666 29255 consensus_peers.cc:597] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.927258 18961 tablet_replica.cc:333] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.928155 18961 raft_consensus.cc:2243] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.929221 18961 raft_consensus.cc:2272] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.931968 18961 tablet_replica.cc:333] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.932765 18961 raft_consensus.cc:2243] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.933405 18961 raft_consensus.cc:2272] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.935514 18961 tablet_replica.cc:333] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.936107 18961 raft_consensus.cc:2243] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.936933 18961 raft_consensus.cc:2272] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.939173 18961 tablet_replica.cc:333] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.939795 18961 raft_consensus.cc:2243] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.940583 18961 raft_consensus.cc:2272] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.943029 18961 tablet_replica.cc:333] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.943789 18961 raft_consensus.cc:2243] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.944339 18961 raft_consensus.cc:2272] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.946584 18961 tablet_replica.cc:333] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.947147 18961 raft_consensus.cc:2243] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.947602 18961 raft_consensus.cc:2272] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.950358 18961 tablet_replica.cc:333] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.951076 18961 raft_consensus.cc:2243] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.951637 18961 raft_consensus.cc:2272] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.954499 18961 tablet_replica.cc:333] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.955070 18961 raft_consensus.cc:2243] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.955935 18961 raft_consensus.cc:2272] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.958432 18961 tablet_replica.cc:333] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.959070 18961 raft_consensus.cc:2243] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.959638 18961 raft_consensus.cc:2272] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.962697 18961 tablet_replica.cc:333] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.963285 18961 raft_consensus.cc:2243] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:47.964351 18961 raft_consensus.cc:2272] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.967142 18961 tablet_replica.cc:333] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.967890 18961 raft_consensus.cc:2243] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.969592 18961 raft_consensus.cc:2272] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.973256 18961 tablet_replica.cc:333] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
W20260709 12:21:47.987196 29180 consensus_peers.cc:597] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:47.987286 18961 raft_consensus.cc:2243] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.988523 18961 raft_consensus.cc:2272] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:47.991415 18961 tablet_replica.cc:333] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: stopping tablet replica
I20260709 12:21:47.992110 18961 raft_consensus.cc:2243] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:47.992719 18961 raft_consensus.cc:2272] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:47.994024 29106 consensus_peers.cc:597] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:47.999185 29180 consensus_peers.cc:597] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.003013 29255 consensus_peers.cc:597] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.023154 29106 consensus_peers.cc:597] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.071938 29255 consensus_peers.cc:597] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.080839 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
W20260709 12:21:48.081893 29180 consensus_peers.cc:597] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.131485 29106 consensus_peers.cc:597] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:48.165473 29255 consensus_peers.cc:597] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.178957 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:48.193636 29847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:48.201028 29848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:48.205440 29850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:48.207813 18961 server_base.cc:1061] running on GCE node
I20260709 12:21:48.210414 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:48.210693 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:48.210915 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599708210891 us; error 0 us; skew 500 ppm
I20260709 12:21:48.211762 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:21:48.212322 29255 consensus_peers.cc:597] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.216188 18961 webserver.cc:533] Webserver started at http://127.18.132.65:34935/ using document root <none> and password file <none>
I20260709 12:21:48.216877 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:48.217132 18961 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:21:48.221710 18961 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.001s
W20260709 12:21:48.229213 29180 consensus_peers.cc:597] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.233040 29855 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:48.234040 18961 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.004s
I20260709 12:21:48.234441 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-xbvc"
I20260709 12:21:48.234997 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:48.286917 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:48.288802 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:48.307173 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:48.326110 29863 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:21:48.678519 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:21:48.678982 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.360s	user 0.013s	sys 0.004s
I20260709 12:21:48.679366 18961 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:21:48.700340 29863 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:48.736816 29733 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.737530 29733 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.740638 29733 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:48.745323 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:48.743400 29863 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:48.747583 29863 tablet_bootstrap.cc:492] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:48.748413 29863 ts_tablet_manager.cc:1403] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.000s
I20260709 12:21:48.762614 29863 raft_consensus.cc:359] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:48.765636 29863 raft_consensus.cc:740] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.766594 29863 consensus_queue.cc:260] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:48.781212 29863 ts_tablet_manager.cc:1434] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:21:48.782277 29863 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:48.791507 29106 leader_election.cc:336] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:48.792150 29106 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:48.792953 29864 raft_consensus.cc:2749] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:48.821631 29863 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:48.822777 29863 tablet_bootstrap.cc:492] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:48.823555 29863 ts_tablet_manager.cc:1403] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.012s
I20260709 12:21:48.826433 29863 raft_consensus.cc:359] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:48.827178 29863 raft_consensus.cc:740] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.827975 29863 consensus_queue.cc:260] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:48.830215 29863 ts_tablet_manager.cc:1434] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:48.831076 29863 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:48.852550 29863 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:48.853675 29863 tablet_bootstrap.cc:492] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:48.854478 29863 ts_tablet_manager.cc:1403] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:21:48.857390 29863 raft_consensus.cc:359] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.858148 29863 raft_consensus.cc:740] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.858937 29863 consensus_queue.cc:260] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.861109 29863 ts_tablet_manager.cc:1434] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:48.862021 29863 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:48.890372 29863 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:48.891441 29863 tablet_bootstrap.cc:492] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:48.892180 29863 ts_tablet_manager.cc:1403] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 12:21:48.895709 29863 raft_consensus.cc:359] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:48.896453 29863 raft_consensus.cc:740] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.897329 29863 consensus_queue.cc:260] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:48.899227 29863 ts_tablet_manager.cc:1434] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:21:48.900058 29701 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.900741 29701 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.900152 29863 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:48.915457 29701 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:48.935202 29711 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.917542 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:48.927718 29180 leader_election.cc:336] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:48.938068 29142 raft_consensus.cc:2468] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:48.939672 29181 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:48.941602 29863 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:48.941736 29864 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.942729 29863 tablet_bootstrap.cc:492] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:48.942416 29864 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.943519 29863 ts_tablet_manager.cc:1403] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.004s
I20260709 12:21:48.944747 29864 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:48.941768 29837 raft_consensus.cc:2804] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:48.945619 29837 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.945981 29837 raft_consensus.cc:3060] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.946483 29863 raft_consensus.cc:359] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:48.947203 29863 raft_consensus.cc:740] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:48.947741 29714 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.948283 29714 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:48.950552 29714 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:48.951241 29860 raft_consensus.cc:493] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.951848 29860 raft_consensus.cc:515] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.953904 29860 leader_election.cc:290] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:48.956048 29863 consensus_queue.cc:260] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:48.956907 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:48.958230 29863 ts_tablet_manager.cc:1434] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:21:48.959079 29863 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:48.962885 29837 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.965039 29837 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:48.972289 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:48.935875 29711 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:48.977154 29711 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:48.977964 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:48.981710 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:48.982465 29701 raft_consensus.cc:493] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:48.989949 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:48.990677 29142 raft_consensus.cc:3060] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.983037 29701 raft_consensus.cc:515] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:48.998004 29701 leader_election.cc:290] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:49.000541 29106 leader_election.cc:336] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.001338 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.003981 29138 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:49.007141 29107 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:49.002858 29180 leader_election.cc:336] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.008554 29180 leader_election.cc:304] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:49.009544 29180 leader_election.cc:336] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.009785 29255 leader_election.cc:336] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.010591 29255 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:49.011754 29255 leader_election.cc:336] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.012140 29255 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.012308 29864 raft_consensus.cc:2749] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.012876 29714 raft_consensus.cc:2749] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.013568 29714 raft_consensus.cc:2749] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.016402 29864 raft_consensus.cc:493] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.017001 29864 raft_consensus.cc:515] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.010023 29837 raft_consensus.cc:2749] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.023485 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.024307 29863 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.025313 29863 tablet_bootstrap.cc:492] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:49.025995 29863 ts_tablet_manager.cc:1403] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.000s
I20260709 12:21:49.028872 29863 raft_consensus.cc:359] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.029544 29863 raft_consensus.cc:740] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.030400 29863 consensus_queue.cc:260] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.039518 29863 ts_tablet_manager.cc:1434] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:49.040548 29863 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:49.042753 29733 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.043341 29733 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.046248 29711 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.046844 29711 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.047061 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.047832 29285 raft_consensus.cc:2468] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:49.049007 29711 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:49.049225 29105 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.046526 29733 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.050158 29827 raft_consensus.cc:2804] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.050577 29827 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.050930 29827 raft_consensus.cc:3060] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:49.055222 29255 leader_election.cc:336] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.056260 29837 raft_consensus.cc:493] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.056809 29837 raft_consensus.cc:515] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.058885 29837 leader_election.cc:290] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.058946 29181 leader_election.cc:304] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:49.059948 29837 raft_consensus.cc:2804] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.060312 29837 raft_consensus.cc:493] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.060670 29837 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.061089 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.066342 29860 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.066524 18961 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:21:49.066959 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.388s	user 0.274s	sys 0.011s
I20260709 12:21:49.066875 29860 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.068116 29837 raft_consensus.cc:515] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.069237 29860 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:49.070441 29106 leader_election.cc:336] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.088541 29106 leader_election.cc:304] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.081231 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.082710 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:49.090283 29141 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.099758 29733 raft_consensus.cc:2749] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:49.103085 29106 leader_election.cc:336] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.104763 29837 leader_election.cc:290] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:49.086611 29180 leader_election.cc:336] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.058844 29827 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.108459 29138 raft_consensus.cc:2393] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91fd10ed5c3e47fcb354c51acbe25286 in current term 2: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:49.087545 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.111650 29701 raft_consensus.cc:493] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.112017 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:49.112284 29701 raft_consensus.cc:515] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.112735 29285 raft_consensus.cc:3060] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.039369 29864 leader_election.cc:290] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.115218 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.117331 29701 leader_election.cc:290] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.122960 29285 raft_consensus.cc:2468] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:49.124523 29256 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.124361 29142 raft_consensus.cc:2468] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:49.126524 29181 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.131193 29105 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.132274 29865 raft_consensus.cc:2804] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.127807 29711 raft_consensus.cc:2749] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.132962 29865 raft_consensus.cc:697] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:49.134150 29860 raft_consensus.cc:2804] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.134892 29860 raft_consensus.cc:697] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:49.134227 29865 consensus_queue.cc:237] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.143635 29827 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.144647 29714 raft_consensus.cc:493] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.146148 29714 raft_consensus.cc:515] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.149001 29714 leader_election.cc:290] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:49.154523 29255 leader_election.cc:336] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.157094 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.157827 29142 raft_consensus.cc:2468] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:49.157886 29860 consensus_queue.cc:237] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.158968 29711 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.159598 29711 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.107311 29141 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:49.162839 29711 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:49.161146 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 74565us
W20260709 12:21:49.167012 29255 leader_election.cc:336] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.167930 29863 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.168969 29863 tablet_bootstrap.cc:492] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:49.169696 29863 ts_tablet_manager.cc:1403] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.129s	user 0.018s	sys 0.004s
I20260709 12:21:49.169931 29880 raft_consensus.cc:493] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.170490 29880 raft_consensus.cc:515] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.171972 29256 leader_election.cc:304] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.173521 29181 leader_election.cc:304] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:49.174284 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.174484 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.173198 29880 leader_election.cc:290] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.176149 29837 raft_consensus.cc:2804] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.177569 29837 raft_consensus.cc:697] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:49.179082 29837 consensus_queue.cc:237] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.181922 29256 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.182688 29711 raft_consensus.cc:2804] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.183313 29711 raft_consensus.cc:493] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.183979 29714 raft_consensus.cc:2749] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.194172 29863 raft_consensus.cc:359] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.195046 29863 raft_consensus.cc:740] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.198609 29863 consensus_queue.cc:260] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.184109 29711 raft_consensus.cc:3060] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:49.200742 29180 leader_election.cc:336] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.201267 29180 leader_election.cc:304] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.204694 29863 ts_tablet_manager.cc:1434] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:21:49.205596 29863 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:49.193045 29860 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.209436 29860 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:49.214622 29180 leader_election.cc:336] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.215154 29880 raft_consensus.cc:2749] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.217061 29860 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:49.217329 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.225993 29141 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:49.215149 29180 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.218293 29827 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.226725 29733 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
W20260709 12:21:49.218901 29106 leader_election.cc:336] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.220321 28959 catalog_manager.cc:5697] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:49.227415 29180 leader_election.cc:336] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.227293 29733 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.230459 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.231068 29289 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:49.222716 28960 catalog_manager.cc:5697] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:49.232192 29105 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.233001 29865 raft_consensus.cc:2804] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.233393 29865 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.233757 29865 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.234633 29860 raft_consensus.cc:2749] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.227232 29827 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:49.237085 29180 leader_election.cc:336] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.237546 29180 leader_election.cc:304] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.238585 29827 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:49.239305 29880 raft_consensus.cc:2749] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.242055 29733 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:49.245406 29180 leader_election.cc:336] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.245908 29180 leader_election.cc:304] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9; no voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.247712 29880 raft_consensus.cc:2749] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.249161 29827 raft_consensus.cc:493] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.254068 29827 raft_consensus.cc:515] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.256067 29741 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.256551 29741 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:49.257834 29180 leader_election.cc:336] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.258328 29741 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.259910 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.260726 29181 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.261905 29880 raft_consensus.cc:2804] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.262288 29880 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.262892 29880 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.270256 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.271739 29714 raft_consensus.cc:493] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.272454 29714 raft_consensus.cc:515] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.275591 29714 leader_election.cc:290] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.278136 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.285132 29217 raft_consensus.cc:2468] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:49.259651 29865 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.287170 29256 leader_election.cc:304] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.288070 29866 raft_consensus.cc:2804] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.288486 29866 raft_consensus.cc:493] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.288862 29866 raft_consensus.cc:3060] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.284030 29863 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.292430 29863 tablet_bootstrap.cc:492] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:49.293258 29863 ts_tablet_manager.cc:1403] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.007s
W20260709 12:21:49.293884 29106 leader_election.cc:336] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.296288 29863 raft_consensus.cc:359] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.297670 29863 raft_consensus.cc:740] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.298136 29106 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.298565 29863 consensus_queue.cc:260] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.301324 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:49.302317 29289 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.302582 29864 raft_consensus.cc:2749] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.303580 29863 ts_tablet_manager.cc:1434] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:49.304461 29863 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:49.305160 29106 leader_election.cc:336] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.299695 29711 raft_consensus.cc:515] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.310389 29289 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:49.306881 29827 leader_election.cc:290] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:49.297266 29866 raft_consensus.cc:515] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.311681 29105 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
W20260709 12:21:49.312685 29255 leader_election.cc:336] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.313308 29866 leader_election.cc:290] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.313645 29860 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.314100 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719ec61ba174acdbffd0d8a8f691142" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:49.314198 29860 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.314991 29217 raft_consensus.cc:3060] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.316818 29860 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:49.323786 29180 leader_election.cc:336] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.313205 29255 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.325186 29866 raft_consensus.cc:2749] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:49.327713 29217 raft_consensus.cc:2468] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 2.
I20260709 12:21:49.329063 29865 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.329712 29865 raft_consensus.cc:2804] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.330372 29865 raft_consensus.cc:697] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:49.331830 29701 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.332408 29701 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.334664 29701 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:49.336889 29256 leader_election.cc:304] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.337970 29866 raft_consensus.cc:2804] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.338502 29866 raft_consensus.cc:697] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:49.339396 29866 consensus_queue.cc:237] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.342829 29714 raft_consensus.cc:493] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.343556 29714 raft_consensus.cc:515] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.344903 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.345741 29289 raft_consensus.cc:2468] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:49.346890 29714 leader_election.cc:290] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.348850 29864 raft_consensus.cc:493] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
W20260709 12:21:49.343991 29180 leader_election.cc:336] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.349575 29864 raft_consensus.cc:515] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.353569 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.354256 29138 raft_consensus.cc:2468] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:49.354296 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26215fc88fd545f290fbaaff9ae467f6" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:49.355147 29142 raft_consensus.cc:3060] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.355680 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.350806 29179 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.355171 29864 leader_election.cc:290] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:49.352329 29733 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.359189 29733 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.363106 29733 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.364130 29701 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.364879 29701 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.367947 29701 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.370102 29875 raft_consensus.cc:2804] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.371618 29875 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.372090 29875 raft_consensus.cc:3060] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.370738 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.376080 29290 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:49.380314 29864 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.370864 29860 raft_consensus.cc:493] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.384081 29880 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.384230 29860 raft_consensus.cc:515] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.386598 29880 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:49.349304 29711 leader_election.cc:290] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.387346 29860 leader_election.cc:290] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.391875 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.392781 29289 raft_consensus.cc:2468] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:49.398603 29105 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.402251 29711 raft_consensus.cc:493] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.403389 29711 raft_consensus.cc:515] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.400321 29179 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.410558 29142 raft_consensus.cc:2468] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 2.
W20260709 12:21:49.412364 29255 leader_election.cc:336] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.352147 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.418344 29217 raft_consensus.cc:2468] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:49.405110 29733 raft_consensus.cc:2804] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.448434 29875 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.440238 29733 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.451047 29875 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.451903 29733 raft_consensus.cc:3060] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.331357 29865 consensus_queue.cc:237] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.380908 29864 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.451907 29863 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.412237 29701 raft_consensus.cc:2804] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:49.461922 29255 leader_election.cc:336] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.471524 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 60952us
W20260709 12:21:49.483176 29255 leader_election.cc:336] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.474056 29827 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
W20260709 12:21:49.474256 29180 leader_election.cc:336] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.493332 29256 leader_election.cc:304] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.477089 28962 catalog_manager.cc:5697] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 2 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:49.472445 29711 leader_election.cc:290] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.484465 29181 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.486543 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:49.494968 29256 leader_election.cc:304] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.495337 29142 raft_consensus.cc:2468] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 1.
I20260709 12:21:49.495723 29711 raft_consensus.cc:2804] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:49.486404 29255 leader_election.cc:336] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.498239 29900 raft_consensus.cc:2804] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.496308 29711 raft_consensus.cc:697] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:49.498703 29900 raft_consensus.cc:493] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.499156 29900 raft_consensus.cc:3060] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.499627 29711 consensus_queue.cc:237] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.505918 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.506737 29217 raft_consensus.cc:2468] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 1.
I20260709 12:21:49.536057 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.536535 29863 tablet_bootstrap.cc:492] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:49.508961 29866 raft_consensus.cc:2804] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.540777 29181 leader_election.cc:304] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:21:49.512063 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:49.480883 29701 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.552564 29863 ts_tablet_manager.cc:1403] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.248s	user 0.019s	sys 0.008s
I20260709 12:21:49.540777 29256 leader_election.cc:304] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:49.552070 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:49.558712 29741 raft_consensus.cc:2804] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.503983 29827 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.558806 29289 raft_consensus.cc:3060] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.552067 29214 raft_consensus.cc:2468] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:49.559180 29741 raft_consensus.cc:493] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.562929 29741 raft_consensus.cc:3060] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.555543 29866 raft_consensus.cc:493] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.558257 29701 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.558261 29138 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.565539 29907 raft_consensus.cc:2804] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.617002 29289 raft_consensus.cc:2468] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:49.567111 29866 raft_consensus.cc:3060] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.645087 29863 raft_consensus.cc:359] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.645916 29863 raft_consensus.cc:740] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.646919 29863 consensus_queue.cc:260] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:49.647027 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 89926.8us
W20260709 12:21:49.652776 29180 leader_election.cc:336] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.653244 29863 ts_tablet_manager.cc:1434] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.096s	user 0.003s	sys 0.004s
W20260709 12:21:49.653651 29180 leader_election.cc:336] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.654194 29863 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:49.654670 29180 leader_election.cc:336] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.619349 29907 raft_consensus.cc:493] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.664198 29741 raft_consensus.cc:515] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.660449 29907 raft_consensus.cc:3060] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.712193 29741 leader_election.cc:290] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:49.713429 29255 leader_election.cc:336] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.714219 29701 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.714723 29138 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:49.717547 29827 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.719306 29701 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:49.741832 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 86652.6us
I20260709 12:21:49.718453 29733 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.780237 29179 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:49.789610 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 230525us
I20260709 12:21:49.718870 29900 raft_consensus.cc:515] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:49.788332 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 225773us
W20260709 12:21:49.794296 29181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 253588us
I20260709 12:21:49.778719 29864 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:49.799460 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:49.800228 29290 raft_consensus.cc:2468] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
I20260709 12:21:49.784586 29911 raft_consensus.cc:2804] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.807279 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:49.807878 29290 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.812682 29733 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:49.816888 29255 leader_election.cc:336] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.818712 29180 consensus_peers.cc:597] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.825038 29180 consensus_peers.cc:597] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.826035 29106 leader_election.cc:336] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.826424 29900 leader_election.cc:290] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:49.826573 29106 leader_election.cc:304] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.827888 29915 raft_consensus.cc:2749] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:49.827122 29180 leader_election.cc:336] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.830812 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 270002us
I20260709 12:21:49.810892 29911 raft_consensus.cc:697] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:49.834021 29911 consensus_queue.cc:237] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:49.835034 29866 raft_consensus.cc:515] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:49.835927 29180 leader_election.cc:336] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.845788 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:49.846462 29217 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 1.
W20260709 12:21:49.836793 29106 leader_election.cc:336] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.830835 29907 raft_consensus.cc:515] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:49.852586 29106 leader_election.cc:336] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.853135 29106 leader_election.cc:336] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.854600 29106 leader_election.cc:336] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.855078 29106 leader_election.cc:336] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.857787 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0254afbe554de5bda48bee078dc4b8" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:49.858484 29212 raft_consensus.cc:3060] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.858731 29290 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:49.859530 29866 leader_election.cc:290] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.862468 29907 leader_election.cc:290] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:49.874676 29141 raft_consensus.cc:1275] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:49.877696 29106 leader_election.cc:336] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.878628 29106 consensus_peers.cc:597] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.880324 29181 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.881855 29701 raft_consensus.cc:2804] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.882356 29701 raft_consensus.cc:697] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:49.882601 29107 leader_election.cc:304] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.883253 29701 consensus_queue.cc:237] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:49.894080 29107 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.895071 29915 raft_consensus.cc:2804] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.895460 29915 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.895864 29915 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.903620 29898 consensus_queue.cc:1048] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:49.896436 29918 raft_consensus.cc:2804] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:49.912034 29918 raft_consensus.cc:493] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:49.912460 29918 raft_consensus.cc:3060] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.915822 29214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6469c0ade3804810b53702577319456c" candidate_uuid: "91fd10ed5c3e47fcb354c51acbe25286" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:49.916594 29214 raft_consensus.cc:3060] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.926855 29214 raft_consensus.cc:2468] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 2.
I20260709 12:21:49.942487 29918 raft_consensus.cc:515] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:49.868532 29255 leader_election.cc:336] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:49.948458 29255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 79957.8us
I20260709 12:21:49.949663 29142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f15092329a634992ba6d44f5e89b40db" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:49.866636 29212 raft_consensus.cc:2468] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91fd10ed5c3e47fcb354c51acbe25286 in term 2.
I20260709 12:21:49.947372 29863 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.947399 29141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "172799b8ec7c4d32905d6b02f0728846" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:21:49.951087 29141 raft_consensus.cc:3060] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:49.951817 29863 tablet_bootstrap.cc:492] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
W20260709 12:21:49.870195 29180 leader_election.cc:336] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.952744 29863 ts_tablet_manager.cc:1403] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.299s	user 0.018s	sys 0.028s
I20260709 12:21:49.950730 29142 raft_consensus.cc:3060] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:49.953225 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 83058us
I20260709 12:21:49.951279 29138 raft_consensus.cc:1275] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.959260 29863 raft_consensus.cc:359] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.960417 29863 raft_consensus.cc:740] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:49.962519 29142 raft_consensus.cc:2468] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:49.964140 29179 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:49.963832 29863 consensus_queue.cc:260] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:49.969980 29863 ts_tablet_manager.cc:1434] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:21:49.970892 29863 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:49.968261 29911 raft_consensus.cc:2804] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:49.971894 29911 raft_consensus.cc:697] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:49.972769 29915 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:49.983072 29106 leader_election.cc:336] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:49.972937 29911 consensus_queue.cc:237] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:49.986241 29255 consensus_peers.cc:597] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:49.988189 29915 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:49.991364 29141 raft_consensus.cc:2468] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:21:50.002028 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:50.002904 29212 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:50.003868 28959 catalog_manager.cc:5697] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.009541 29181 leader_election.cc:304] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
W20260709 12:21:50.012483 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 46686.4us
I20260709 12:21:50.015120 29880 raft_consensus.cc:2804] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.015738 29880 raft_consensus.cc:697] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:50.016726 29880 consensus_queue.cc:237] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.018070 28962 catalog_manager.cc:5697] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.020231 29875 consensus_queue.cc:1048] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:50.021945 28960 catalog_manager.cc:5697] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 2 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.025509 28962 catalog_manager.cc:5697] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:50.033219 29255 consensus_peers.cc:597] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:49.966910 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 167778us
I20260709 12:21:50.043002 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:50.043871 29289 raft_consensus.cc:3060] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:50.044994 29918 leader_election.cc:290] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
W20260709 12:21:50.051002 29106 leader_election.cc:336] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:21:50.056064 29289 raft_consensus.cc:2468] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:50.061710 29181 leader_election.cc:304] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.066888 29285 raft_consensus.cc:1275] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.071269 29875 raft_consensus.cc:2804] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.071916 29875 raft_consensus.cc:697] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:21:50.073055 29875 consensus_queue.cc:237] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.088668 29214 raft_consensus.cc:1275] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 91fd10ed5c3e47fcb354c51acbe25286: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.064419 29105 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.091233 29137 raft_consensus.cc:1275] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 91fd10ed5c3e47fcb354c51acbe25286: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.099085 29256 leader_election.cc:304] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.104121 29256 leader_election.cc:304] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.109452 29211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73311071016949569f4b68732a970667" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:21:50.110198 29211 raft_consensus.cc:3060] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:50.108654 29866 raft_consensus.cc:2804] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.116657 29866 raft_consensus.cc:697] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:50.117714 29866 consensus_queue.cc:237] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:50.119490 29863 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:50.108788 29714 raft_consensus.cc:2804] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.120443 29714 raft_consensus.cc:697] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Becoming Leader. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:21:50.123000 29863 tablet_bootstrap.cc:492] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:50.124032 29863 ts_tablet_manager.cc:1403] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.003s
I20260709 12:21:50.121743 29917 consensus_queue.cc:1048] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:50.121613 29714 consensus_queue.cc:237] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:50.103521 29918 raft_consensus.cc:2804] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:50.135187 29903 consensus_queue.cc:1048] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:50.139364 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 75082.2us
I20260709 12:21:50.144452 29105 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.130831 29918 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:21:50.151103 29863 raft_consensus.cc:359] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:50.153645 29863 raft_consensus.cc:740] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.155406 29931 consensus_queue.cc:1048] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:21:50.160467 29919 raft_consensus.cc:2804] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.161139 29919 raft_consensus.cc:697] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:50.162179 29919 consensus_queue.cc:237] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:50.165750 29935 log.cc:927] Time spent T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:21:50.155063 29863 consensus_queue.cc:260] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:50.177668 29863 ts_tablet_manager.cc:1434] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 12:21:50.180385 29863 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:50.190244 29285 raft_consensus.cc:1275] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.151631 29918 raft_consensus.cc:3060] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:50.197288 29106 consensus_peers.cc:597] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:50.199083 29211 raft_consensus.cc:2468] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:50.231195 29902 consensus_queue.cc:1048] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:21:50.236613 29107 leader_election.cc:304] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.233209 29868 raft_consensus.cc:493] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.240108 29902 raft_consensus.cc:2804] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.276798 29902 raft_consensus.cc:697] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:50.239960 29868 raft_consensus.cc:515] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:50.363843 29902 consensus_queue.cc:237] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
W20260709 12:21:50.417755 29105 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 122659us
I20260709 12:21:50.438299 28960 catalog_manager.cc:5697] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 2 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.453176 28960 catalog_manager.cc:5697] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68). New cstate: current_term: 2 leader_uuid: "91fd10ed5c3e47fcb354c51acbe25286" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.367210 29918 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:50.473919 29212 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:50.491209 29868 leader_election.cc:290] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:50.529450 29954 raft_consensus.cc:493] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.530202 29954 raft_consensus.cc:515] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:50.609239 29107 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:21:50.612126 29863 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:50.616681 29863 tablet_bootstrap.cc:492] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:50.617617 29863 ts_tablet_manager.cc:1403] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.438s	user 0.026s	sys 0.008s
I20260709 12:21:50.606552 29868 raft_consensus.cc:493] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.641028 29954 leader_election.cc:290] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:50.646482 29106 consensus_peers.cc:597] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:50.647729 29106 consensus_peers.cc:597] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:50.648595 29142 raft_consensus.cc:1275] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.656204 29918 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:21:50.657423 29961 log.cc:927] Time spent T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:21:50.666590 29863 raft_consensus.cc:359] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.667809 29863 raft_consensus.cc:740] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:50.668867 29863 consensus_queue.cc:260] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.674307 29863 ts_tablet_manager.cc:1434] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:21:50.675828 29863 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:50.654026 29957 log.cc:927] Time spent T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:21:50.645354 29954 raft_consensus.cc:493] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.632695 29868 raft_consensus.cc:515] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:50.704698 29905 raft_consensus.cc:2804] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.705797 29905 raft_consensus.cc:697] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:50.712117 29954 raft_consensus.cc:515] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:50.718847 29868 leader_election.cc:290] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:50.722486 29868 raft_consensus.cc:493] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.724067 29288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:21:50.724797 29288 raft_consensus.cc:3060] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:50.723274 29868 raft_consensus.cc:515] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
W20260709 12:21:50.752736 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 190700us
I20260709 12:21:50.707363 29905 consensus_queue.cc:237] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.752563 29954 leader_election.cc:290] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:21:50.769801 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 125038us
I20260709 12:21:50.770510 29289 raft_consensus.cc:1275] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:50.764523 29255 consensus_peers.cc:597] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:50.804719 29954 raft_consensus.cc:493] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.805398 29954 raft_consensus.cc:515] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.807720 29954 leader_election.cc:290] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:50.808676 29954 raft_consensus.cc:493] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.809113 29954 raft_consensus.cc:515] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:50.811177 29954 leader_election.cc:290] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:50.811658 29288 raft_consensus.cc:2468] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:21:50.813133 28962 catalog_manager.cc:5697] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.815321 28962 catalog_manager.cc:5697] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:50.817798 28962 catalog_manager.cc:5697] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.819967 28962 catalog_manager.cc:5697] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.833412 29105 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:21:50.835628 29733 raft_consensus.cc:2804] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:50.836109 29733 raft_consensus.cc:697] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:21:50.836836 29733 consensus_queue.cc:237] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:50.786145 29968 consensus_queue.cc:1048] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:21:50.862968 29290 raft_consensus.cc:1275] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.864259 29701 consensus_queue.cc:1048] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:50.842821 29954 raft_consensus.cc:493] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.896276 29868 leader_election.cc:290] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:50.876119 29954 raft_consensus.cc:515] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:50.917842 29141 raft_consensus.cc:1275] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.922688 29982 raft_consensus.cc:493] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:50.923513 29982 raft_consensus.cc:515] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:50.923355 29965 log.cc:927] Time spent T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.290s	user 0.004s	sys 0.000s
W20260709 12:21:50.935194 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 69549us
W20260709 12:21:50.941376 29180 consensus_peers.cc:597] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:50.937906 29982 leader_election.cc:290] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:50.959712 29212 raft_consensus.cc:1275] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 91fd10ed5c3e47fcb354c51acbe25286: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.956252 29215 raft_consensus.cc:1275] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 91fd10ed5c3e47fcb354c51acbe25286: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:50.970152 29922 consensus_queue.cc:1048] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:50.973651 29941 log.cc:927] Time spent T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
W20260709 12:21:50.976166 29180 consensus_peers.cc:597] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.036936 29180 consensus_peers.cc:597] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:51.037575 29180 consensus_peers.cc:597] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.038097 29180 consensus_peers.cc:597] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.038633 29180 consensus_peers.cc:597] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:51.039037 29180 consensus_peers.cc:597] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:51.039744 29180 consensus_peers.cc:597] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.015064 29954 leader_election.cc:290] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:51.013474 29866 consensus_queue.cc:1048] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:21:51.064024 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
W20260709 12:21:51.040825 29180 consensus_peers.cc:597] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:51.067036 29180 consensus_peers.cc:597] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.018599 29981 consensus_queue.cc:1048] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:21:51.069049 29136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:51.070425 29284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "494a1a011a1c49d9845829b1a5858c4a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.070761 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:51.072021 29213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:51.072402 29216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:51.073180 29290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.101189 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:51.072837 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ff826b27146f8b266ae26e03dc775" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:51.092670 29282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c79ddf0b439489197763183ae8553e4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.094020 29291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.074133 29283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.072062 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ecfc448993b45138c2cda5213e934c1" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:51.103689 29215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:51.119419 29138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c2675a26a2453487ff7fa3eb4a4441" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:51.119057 29140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fffd97d1134dc9addffe91d5d5e5d4" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:51.123692 29856 leader_election.cc:304] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.125335 29954 raft_consensus.cc:2749] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.125962 29863 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:51.127244 29863 tablet_bootstrap.cc:492] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:51.128244 29863 ts_tablet_manager.cc:1403] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.453s	user 0.034s	sys 0.029s
I20260709 12:21:51.122269 29283 raft_consensus.cc:2393] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in current term 2: Already voted for candidate 6cf7766f7e944f41837fd8aa8bde0018 in this term.
I20260709 12:21:51.132954 29863 raft_consensus.cc:359] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:51.133737 29863 raft_consensus.cc:740] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:51.134547 29863 consensus_queue.cc:260] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:51.137465 29863 ts_tablet_manager.cc:1434] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:21:51.137804 29858 leader_election.cc:304] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.138536 29863 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:51.104513 29286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc247c119e4c099657c60c961aa37d" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:51.158979 29179 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.68:45807, user_credentials={real_user=slave}} blocked reactor thread for 63611.9us
W20260709 12:21:51.163791 29180 consensus_peers.cc:597] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.164495 29180 consensus_peers.cc:597] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.174481 29285 raft_consensus.cc:1275] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:51.167722 29954 raft_consensus.cc:3060] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:51.176288 29858 leader_election.cc:304] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:51.177179 29982 raft_consensus.cc:2749] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.177680 29858 leader_election.cc:304] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.178989 29858 leader_election.cc:304] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.185587 29982 raft_consensus.cc:2749] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.185827 29868 raft_consensus.cc:2749] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:51.194730 29997 log.cc:927] Time spent T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: Append to log took a long time: real 0.178s	user 0.003s	sys 0.000s
I20260709 12:21:51.195204 29858 leader_election.cc:304] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.196205 29980 raft_consensus.cc:2749] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.196632 29858 leader_election.cc:304] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:51.198262 29982 raft_consensus.cc:2749] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.205646 29954 raft_consensus.cc:2749] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.275015 29733 consensus_queue.cc:1048] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:21:51.287012 29858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 90341.1us
I20260709 12:21:51.289330 29858 leader_election.cc:304] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.286952 29287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7483cd4c0e99450089e2c3aef8f1524a" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.312594 29954 raft_consensus.cc:2749] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:51.316141 29106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 485549us
W20260709 12:21:51.283233 29255 consensus_peers.cc:597] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.326504 29106 consensus_peers.cc:597] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.331357 29255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 176573us
I20260709 12:21:51.363590 29856 leader_election.cc:304] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.366243 29137 raft_consensus.cc:1275] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:51.366659 30012 raft_consensus.cc:2749] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.391021 30012 raft_consensus.cc:493] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:51.395885 29255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 52007us
I20260709 12:21:51.391938 30012 raft_consensus.cc:515] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
W20260709 12:21:51.429806 29106 leader_election.cc:336] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:21:51.437418 29106 consensus_peers.cc:597] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.439523 30009 consensus_queue.cc:1048] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:51.440380 30012 leader_election.cc:290] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:51.447152 29991 consensus_queue.cc:1048] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:51.453961 29106 consensus_peers.cc:597] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.486318 29255 consensus_peers.cc:597] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.499666 29106 consensus_peers.cc:597] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.521536 29863 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:51.522974 29863 tablet_bootstrap.cc:492] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:51.538967 29217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:51.532851 29863 ts_tablet_manager.cc:1403] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.395s	user 0.031s	sys 0.019s
W20260709 12:21:51.553493 29106 consensus_peers.cc:597] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.538914 29282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa3802b77714deab6889b0c74f08f50" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
W20260709 12:21:51.560267 30017 log.cc:927] Time spent T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: Append to log took a long time: real 0.092s	user 0.005s	sys 0.000s
W20260709 12:21:51.569315 29106 consensus_peers.cc:597] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:51.572846 29106 consensus_peers.cc:597] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.631276 29255 consensus_peers.cc:597] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.633464 29255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 90938.2us
W20260709 12:21:51.643877 29255 consensus_peers.cc:597] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.662056 29214 raft_consensus.cc:1275] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:51.663483 30014 log.cc:927] Time spent T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: Append to log took a long time: real 0.261s	user 0.004s	sys 0.000s
W20260709 12:21:51.672137 29255 consensus_peers.cc:597] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.683388 29106 consensus_peers.cc:597] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.687517 29856 leader_election.cc:304] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.689399 30012 raft_consensus.cc:2749] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:51.696342 29106 consensus_peers.cc:597] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.700192 29217 raft_consensus.cc:1275] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:51.723655 29255 consensus_peers.cc:597] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.680166 29863 raft_consensus.cc:359] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:51.739889 29863 raft_consensus.cc:740] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:51.761080 29285 raft_consensus.cc:1275] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:51.752594 29863 consensus_queue.cc:260] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:51.784154 29918 consensus_queue.cc:1048] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:51.801587 29733 raft_consensus.cc:493] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 91fd10ed5c3e47fcb354c51acbe25286)
I20260709 12:21:51.802417 29733 raft_consensus.cc:515] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:21:51.803547 30012 raft_consensus.cc:493] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:51.804322 30012 raft_consensus.cc:515] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:51.806777 30012 leader_election.cc:290] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:21:51.810303 29863 ts_tablet_manager.cc:1434] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.262s	user 0.011s	sys 0.002s
I20260709 12:21:51.813573 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:51.823709 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf4de06f0641c5bedbc8eb813a7f97" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.826447 29733 leader_election.cc:290] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:21:51.828599 29733 consensus_queue.cc:1048] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:51.830413 29106 consensus_peers.cc:597] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.844038 29856 leader_election.cc:304] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286
I20260709 12:21:51.844434 29865 consensus_queue.cc:1048] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:51.843679 28962 catalog_manager.cc:5697] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.845276 30012 raft_consensus.cc:2749] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:51.847509 28962 catalog_manager.cc:5697] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.852449 28962 catalog_manager.cc:5697] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.854192 28962 catalog_manager.cc:5697] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:51.849201 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286" is_pre_election: true
I20260709 12:21:51.860585 29863 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:51.892165 29180 consensus_peers.cc:597] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.895897 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 102522us
W20260709 12:21:51.900754 29255 consensus_peers.cc:597] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:51.906155 29255 consensus_peers.cc:597] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.913827 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c070504fe245aba727845758bbca34" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
W20260709 12:21:51.958984 29180 consensus_peers.cc:597] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.960704 29107 leader_election.cc:304] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018; no voters: 7e87f64602ef465cb6288f69964235a9, 91fd10ed5c3e47fcb354c51acbe25286
W20260709 12:21:51.961241 29255 consensus_peers.cc:597] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.969086 29255 consensus_peers.cc:597] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:51.962738 29180 consensus_peers.cc:597] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:51.963217 29918 raft_consensus.cc:2749] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:52.194049 29863 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.205788 29863 tablet_bootstrap.cc:492] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:52.206534 29863 ts_tablet_manager.cc:1403] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.395s	user 0.021s	sys 0.013s
I20260709 12:21:52.218744 29863 raft_consensus.cc:359] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:52.219486 29863 raft_consensus.cc:740] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:52.220453 29863 consensus_queue.cc:260] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:52.223289 29863 ts_tablet_manager.cc:1434] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:21:52.224514 29863 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:52.283097 29255 consensus_peers.cc:597] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:52.285220 29180 consensus_peers.cc:597] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:52.291414 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:42483
I20260709 12:21:52.291558 29863 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.291580 30065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:42483 every 8 connection(s)
I20260709 12:21:52.292812 29863 tablet_bootstrap.cc:492] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:52.293453 29863 ts_tablet_manager.cc:1403] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.002s
I20260709 12:21:52.295831 29863 raft_consensus.cc:359] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:52.296617 29863 raft_consensus.cc:740] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:52.299839 29863 consensus_queue.cc:260] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:52.304519 29863 ts_tablet_manager.cc:1434] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:21:52.305723 29863 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:52.378072 29863 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.379168 29863 tablet_bootstrap.cc:492] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:52.379938 29863 ts_tablet_manager.cc:1403] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.035s
I20260709 12:21:52.385094 29863 raft_consensus.cc:359] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:52.386227 29863 raft_consensus.cc:740] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:52.387001 29863 consensus_queue.cc:260] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:52.389468 29863 ts_tablet_manager.cc:1434] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:52.394572 30012 raft_consensus.cc:493] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:52.395236 30012 raft_consensus.cc:515] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:52.397467 30012 leader_election.cc:290] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:21:52.402035 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e87f64602ef465cb6288f69964235a9" is_pre_election: true
I20260709 12:21:52.401299 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018" is_pre_election: true
I20260709 12:21:52.405054 30013 raft_consensus.cc:3060] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.411051 29863 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:52.419059 30008 raft_consensus.cc:3060] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.419137 29858 leader_election.cc:304] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9
I20260709 12:21:52.431053 30073 raft_consensus.cc:2749] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:52.443210 29999 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.517795 29863 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:21:52.527376 29858 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 108340us
I20260709 12:21:52.548457 29863 tablet_bootstrap.cc:492] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:52.549758 29863 ts_tablet_manager.cc:1403] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.149s	user 0.022s	sys 0.004s
I20260709 12:21:52.583602 29863 raft_consensus.cc:359] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:52.584476 29863 raft_consensus.cc:740] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:52.585242 29863 consensus_queue.cc:260] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:52.600878 30066 heartbeater.cc:344] Connected to a master server at 127.18.132.126:45601
I20260709 12:21:52.602746 29863 ts_tablet_manager.cc:1434] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:21:52.604074 30066 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:52.611649 30013 raft_consensus.cc:3060] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.612154 30008 raft_consensus.cc:3060] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.616334 29993 raft_consensus.cc:3060] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:52.620388 30066 heartbeater.cc:507] Master 127.18.132.126:45601 requested a full tablet report, sending...
I20260709 12:21:52.623965 29863 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:52.689522 29255 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 48572.1us
W20260709 12:21:52.689019 29107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 61156.1us
W20260709 12:21:52.692291 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 45699.5us
W20260709 12:21:52.724661 29181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 61303.6us
I20260709 12:21:52.728806 29973 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:52.777015 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 81728.1us
W20260709 12:21:52.867036 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 68814.1us
I20260709 12:21:52.910768 29863 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.912170 29863 tablet_bootstrap.cc:492] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:52.914168 29863 ts_tablet_manager.cc:1403] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.308s	user 0.032s	sys 0.017s
I20260709 12:21:52.943288 29863 raft_consensus.cc:359] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:52.944105 29863 raft_consensus.cc:740] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:52.956076 29863 consensus_queue.cc:260] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:52.977931 29863 ts_tablet_manager.cc:1434] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:21:52.979097 29863 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.009758 29255 consensus_peers.cc:597] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.058148 29863 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.059430 29863 tablet_bootstrap.cc:492] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.060315 29863 ts_tablet_manager.cc:1403] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.008s
I20260709 12:21:53.073235 29863 raft_consensus.cc:359] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.075114 29863 raft_consensus.cc:740] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.076021 29863 consensus_queue.cc:260] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.078856 29863 ts_tablet_manager.cc:1434] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:53.079941 29863 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.086828 28959 ts_manager.cc:194] Re-registered known tserver with Master: 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
I20260709 12:21:53.126521 29863 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.127907 29863 tablet_bootstrap.cc:492] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.128751 29863 ts_tablet_manager.cc:1403] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.015s
I20260709 12:21:53.132390 29863 raft_consensus.cc:359] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.133337 29863 raft_consensus.cc:740] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.134236 29863 consensus_queue.cc:260] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.136942 29863 ts_tablet_manager.cc:1434] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:53.148314 29863 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.145187 28959 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33294
I20260709 12:21:53.155894 30066 heartbeater.cc:499] Master 127.18.132.126:45601 was elected leader, sending a full tablet report...
W20260709 12:21:53.181416 29255 consensus_peers.cc:597] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.194031 29863 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.195188 29863 tablet_bootstrap.cc:492] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.195950 29863 ts_tablet_manager.cc:1403] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 12:21:53.214975 29863 raft_consensus.cc:359] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.215888 29863 raft_consensus.cc:740] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.216708 29863 consensus_queue.cc:260] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.219488 29863 ts_tablet_manager.cc:1434] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:21:53.220536 29863 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.225440 29106 consensus_peers.cc:597] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.280153 29863 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.281495 29863 tablet_bootstrap.cc:492] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.282299 29863 ts_tablet_manager.cc:1403] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.006s
I20260709 12:21:53.285786 29863 raft_consensus.cc:359] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.286597 29863 raft_consensus.cc:740] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.304183 29863 consensus_queue.cc:260] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.306800 29863 ts_tablet_manager.cc:1434] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:21:53.307775 29863 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.342530 29180 consensus_peers.cc:597] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:53.383075 29180 consensus_peers.cc:597] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.392972 29863 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.394233 29863 tablet_bootstrap.cc:492] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.395009 29863 ts_tablet_manager.cc:1403] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.007s
I20260709 12:21:53.398272 29863 raft_consensus.cc:359] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.399048 29863 raft_consensus.cc:740] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.399854 29863 consensus_queue.cc:260] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.407749 29863 ts_tablet_manager.cc:1434] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.007s
I20260709 12:21:53.408670 29863 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.452946 29863 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.453877 29863 tablet_bootstrap.cc:492] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.455256 29863 ts_tablet_manager.cc:1403] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.005s
I20260709 12:21:53.461474 29863 raft_consensus.cc:359] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.462347 29863 raft_consensus.cc:740] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.463219 29863 consensus_queue.cc:260] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.465931 29863 ts_tablet_manager.cc:1434] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:53.466960 29863 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.521610 29863 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.522709 29863 tablet_bootstrap.cc:492] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.523447 29863 ts_tablet_manager.cc:1403] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.057s	user 0.032s	sys 0.007s
I20260709 12:21:53.526419 29863 raft_consensus.cc:359] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.527156 29863 raft_consensus.cc:740] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.534641 29863 consensus_queue.cc:260] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.537078 29863 ts_tablet_manager.cc:1434] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:21:53.537964 29863 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.546268 29180 consensus_peers.cc:597] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:53.563757 29180 consensus_peers.cc:597] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.566419 29863 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.567395 29863 tablet_bootstrap.cc:492] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.568015 29863 ts_tablet_manager.cc:1403] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 12:21:53.570487 29863 raft_consensus.cc:359] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.571036 29863 raft_consensus.cc:740] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.571739 29863 consensus_queue.cc:260] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.573465 29863 ts_tablet_manager.cc:1434] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:21:53.574864 29863 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.594214 29863 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.595275 29863 tablet_bootstrap.cc:492] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.596051 29863 ts_tablet_manager.cc:1403] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 12:21:53.598989 29863 raft_consensus.cc:359] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.599731 29863 raft_consensus.cc:740] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.600450 29863 consensus_queue.cc:260] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.602845 29863 ts_tablet_manager.cc:1434] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:53.604271 29863 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.612238 29180 consensus_peers.cc:597] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.622037 29863 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.623179 29863 tablet_bootstrap.cc:492] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.623998 29863 ts_tablet_manager.cc:1403] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 12:21:53.627079 29863 raft_consensus.cc:359] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.627853 29863 raft_consensus.cc:740] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.628589 29863 consensus_queue.cc:260] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.631047 29863 ts_tablet_manager.cc:1434] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:53.633386 29863 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.650543 29255 consensus_peers.cc:597] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.665755 29863 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.666937 29863 tablet_bootstrap.cc:492] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.667754 29863 ts_tablet_manager.cc:1403] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.012s
I20260709 12:21:53.670852 29863 raft_consensus.cc:359] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.671682 29863 raft_consensus.cc:740] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.672447 29863 consensus_queue.cc:260] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.674961 29863 ts_tablet_manager.cc:1434] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:53.676123 29863 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.680667 29973 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.704598 29863 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.705823 29863 tablet_bootstrap.cc:492] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.706624 29863 ts_tablet_manager.cc:1403] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.011s
I20260709 12:21:53.710044 29863 raft_consensus.cc:359] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.710937 29863 raft_consensus.cc:740] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.712415 29863 consensus_queue.cc:260] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.714679 29863 ts_tablet_manager.cc:1434] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:21:53.715615 29863 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.739349 29863 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.740499 29863 tablet_bootstrap.cc:492] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.741206 29863 ts_tablet_manager.cc:1403] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 12:21:53.744520 29863 raft_consensus.cc:359] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.745294 29863 raft_consensus.cc:740] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.746071 29863 consensus_queue.cc:260] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.748871 29863 ts_tablet_manager.cc:1434] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:21:53.749820 29863 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.781111 29863 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.782255 29863 tablet_bootstrap.cc:492] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.783041 29863 ts_tablet_manager.cc:1403] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 12:21:53.786378 29863 raft_consensus.cc:359] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.787264 29863 raft_consensus.cc:740] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.788138 29863 consensus_queue.cc:260] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.803705 29863 ts_tablet_manager.cc:1434] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.004s
I20260709 12:21:53.816027 29973 raft_consensus.cc:3060] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.816221 30013 raft_consensus.cc:3060] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:53.821492 29255 consensus_peers.cc:597] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.819123 29863 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.855213 29180 consensus_peers.cc:597] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:53.864846 29863 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.867218 29863 tablet_bootstrap.cc:492] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.868019 29863 ts_tablet_manager.cc:1403] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.010s
I20260709 12:21:53.871187 29863 raft_consensus.cc:359] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.871958 29863 raft_consensus.cc:740] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.872845 29863 consensus_queue.cc:260] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:53.877458 29863 ts_tablet_manager.cc:1434] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:21:53.878652 29863 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
W20260709 12:21:53.881500 29256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:41735, user_credentials={real_user=slave}} blocked reactor thread for 68761.9us
W20260709 12:21:53.905524 29255 consensus_peers.cc:597] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:53.916492 29973 raft_consensus.cc:3060] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:53.924753 29863 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.925973 29863 tablet_bootstrap.cc:492] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.926836 29863 ts_tablet_manager.cc:1403] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.011s
I20260709 12:21:53.932099 29863 raft_consensus.cc:359] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.932852 29863 raft_consensus.cc:740] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.933558 29863 consensus_queue.cc:260] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:53.936167 29863 ts_tablet_manager.cc:1434] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:21:53.937063 29863 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:53.970211 29863 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:53.971324 29863 tablet_bootstrap.cc:492] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:53.972157 29863 ts_tablet_manager.cc:1403] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.008s
I20260709 12:21:53.975253 29863 raft_consensus.cc:359] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.976068 29863 raft_consensus.cc:740] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:53.976817 29863 consensus_queue.cc:260] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:53.979532 29863 ts_tablet_manager.cc:1434] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:53.980505 29863 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.009933 29863 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.011132 29863 tablet_bootstrap.cc:492] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.011948 29863 ts_tablet_manager.cc:1403] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.005s
I20260709 12:21:54.015005 29863 raft_consensus.cc:359] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:54.015870 29863 raft_consensus.cc:740] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.016614 29863 consensus_queue.cc:260] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:54.018419 29863 ts_tablet_manager.cc:1434] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:54.019404 29863 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.026773 30013 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.043800 29863 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.045051 29863 tablet_bootstrap.cc:492] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.045818 29863 ts_tablet_manager.cc:1403] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 12:21:54.049131 29863 raft_consensus.cc:359] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:54.049916 29863 raft_consensus.cc:740] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.050797 29863 consensus_queue.cc:260] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:54.053306 29863 ts_tablet_manager.cc:1434] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:54.054313 29863 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.065019 30013 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.084870 29863 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.086125 29863 tablet_bootstrap.cc:492] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.087591 29863 ts_tablet_manager.cc:1403] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.012s
I20260709 12:21:54.090353 29863 raft_consensus.cc:359] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:54.091034 29863 raft_consensus.cc:740] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.092777 29863 consensus_queue.cc:260] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:21:54.098006 29863 ts_tablet_manager.cc:1434] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:54.098910 29863 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.109186 29973 raft_consensus.cc:3060] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.144829 29863 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.146041 29863 tablet_bootstrap.cc:492] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.146804 29863 ts_tablet_manager.cc:1403] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.016s
I20260709 12:21:54.150177 29863 raft_consensus.cc:359] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.150892 29863 raft_consensus.cc:740] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.151772 29863 consensus_queue.cc:260] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.154723 29863 ts_tablet_manager.cc:1434] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:21:54.155644 29863 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.185170 29863 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.186326 29863 tablet_bootstrap.cc:492] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.187233 29863 ts_tablet_manager.cc:1403] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.005s
I20260709 12:21:54.190893 29863 raft_consensus.cc:359] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:54.191756 29863 raft_consensus.cc:740] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.192665 29863 consensus_queue.cc:260] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:21:54.195802 29863 ts_tablet_manager.cc:1434] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:54.196801 29863 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.242614 29863 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.243892 29863 tablet_bootstrap.cc:492] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.250308 29863 ts_tablet_manager.cc:1403] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.008s
I20260709 12:21:54.253209 29863 raft_consensus.cc:359] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.253893 29863 raft_consensus.cc:740] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.254515 29863 consensus_queue.cc:260] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.256799 29863 ts_tablet_manager.cc:1434] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:54.257622 29863 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.324116 29863 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.325206 29863 tablet_bootstrap.cc:492] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.325843 29863 ts_tablet_manager.cc:1403] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.007s
I20260709 12:21:54.329461 29863 raft_consensus.cc:359] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.331511 29863 raft_consensus.cc:740] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.332373 29863 consensus_queue.cc:260] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.334412 29863 ts_tablet_manager.cc:1434] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:54.335753 29863 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.408427 29863 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.409499 29863 tablet_bootstrap.cc:492] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.410293 29863 ts_tablet_manager.cc:1403] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.075s	user 0.035s	sys 0.032s
I20260709 12:21:54.419418 29863 raft_consensus.cc:359] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.420275 29863 raft_consensus.cc:740] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.421262 29863 consensus_queue.cc:260] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.424010 29863 ts_tablet_manager.cc:1434] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:21:54.425576 29863 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap starting.
I20260709 12:21:54.458161 29863 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:54.459318 29863 tablet_bootstrap.cc:492] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Bootstrap complete.
I20260709 12:21:54.460351 29863 ts_tablet_manager.cc:1403] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.004s
I20260709 12:21:54.463109 29863 raft_consensus.cc:359] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.463797 29863 raft_consensus.cc:740] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Initialized, Role: FOLLOWER
I20260709 12:21:54.464462 29863 consensus_queue.cc:260] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:21:54.466846 29863 ts_tablet_manager.cc:1434] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:54.510464 29973 raft_consensus.cc:3060] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:54.534848 30013 raft_consensus.cc:3060] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:01.502904 29180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:42483, user_credentials={real_user=slave}} blocked reactor thread for 60568.6us
I20260709 12:22:02.312731 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:02.376246 29133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "092eec00ed674936b54daf8589efe743"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:22:02.377206 29133 raft_consensus.cc:606] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:02.380558 29137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:22:02.381057 29137 raft_consensus.cc:606] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:02.383621 29137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:22:02.384114 29137 raft_consensus.cc:606] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:02.400641 29212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:60264
I20260709 12:22:02.401298 29212 raft_consensus.cc:606] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:02.415606 29289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593"
dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:42400
I20260709 12:22:02.416285 29289 raft_consensus.cc:606] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:02.419813 29137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:22:02.420452 29137 raft_consensus.cc:606] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:02.422133 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:02.424443 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:02.425412 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:02.455924 30161 raft_consensus.cc:993] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.456796 30146 raft_consensus.cc:1081] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.459317 29999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:22:02.460031 29999 raft_consensus.cc:493] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.460579 29999 raft_consensus.cc:3060] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.473218 29999 raft_consensus.cc:515] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.475296 29999 leader_election.cc:290] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:02.476289 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:02.476418 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa18dc25644cc6976f09ff3dfce4f8" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:02.477167 29137 raft_consensus.cc:3055] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.477276 29212 raft_consensus.cc:3060] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.477452 29137 raft_consensus.cc:740] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:02.478530 29137 consensus_queue.cc:260] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.480161 29137 raft_consensus.cc:3060] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.484776 29212 raft_consensus.cc:2468] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.486429 29858 leader_election.cc:304] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:02.488430 29137 raft_consensus.cc:2468] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.490432 30166 raft_consensus.cc:2804] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.492897 30166 raft_consensus.cc:697] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:02.493954 30166 consensus_queue.cc:237] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.509840 28960 catalog_manager.cc:5697] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.528548 30161 raft_consensus.cc:993] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.529179 30161 raft_consensus.cc:1081] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.530783 29999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "092eec00ed674936b54daf8589efe743"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:22:02.531481 29999 raft_consensus.cc:493] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.531936 29999 raft_consensus.cc:3060] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.538518 29999 raft_consensus.cc:515] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.540534 29999 leader_election.cc:290] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:02.541273 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:02.541697 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "092eec00ed674936b54daf8589efe743" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:02.542141 29133 raft_consensus.cc:3055] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.542353 29210 raft_consensus.cc:3060] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.542513 29133 raft_consensus.cc:740] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:02.543629 29133 consensus_queue.cc:260] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.544883 30146 raft_consensus.cc:993] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.545433 30146 raft_consensus.cc:1081] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.547322 30008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:22:02.547904 30008 raft_consensus.cc:493] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.548252 30008 raft_consensus.cc:3060] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.548723 29133 raft_consensus.cc:3060] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.551820 29210 raft_consensus.cc:2468] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.553561 29858 leader_election.cc:304] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:02.554466 30166 raft_consensus.cc:2804] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.554993 30166 raft_consensus.cc:697] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:02.556092 30166 consensus_queue.cc:237] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.560540 29133 raft_consensus.cc:2468] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.563632 30008 raft_consensus.cc:515] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:02.567764 30008 leader_election.cc:290] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:22:02.569307 29289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:02.570096 29289 raft_consensus.cc:3060] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.572832 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1973cb4352f14b628c856d7f58cea0da" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:02.573599 29133 raft_consensus.cc:3055] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.574478 29133 raft_consensus.cc:740] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:02.573716 28960 catalog_manager.cc:5697] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.575408 29133 consensus_queue.cc:260] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:02.577451 29133 raft_consensus.cc:3060] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.583866 29289 raft_consensus.cc:2468] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.586301 29133 raft_consensus.cc:2468] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.586822 29856 leader_election.cc:304] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:02.588636 30166 raft_consensus.cc:2804] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.589144 30166 raft_consensus.cc:697] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:02.590248 30166 consensus_queue.cc:237] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:02.615962 28960 catalog_manager.cc:5697] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.752965 29898 raft_consensus.cc:993] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.753479 29898 raft_consensus.cc:1081] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.756120 29973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48452
I20260709 12:22:02.756722 29973 raft_consensus.cc:493] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.757122 29973 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.764024 29973 raft_consensus.cc:515] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:02.765897 29973 leader_election.cc:290] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:02.766589 29286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:02.766964 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e39ebaf09f44b5fafafbcc94e7b50a7" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:02.767341 29286 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.767653 29210 raft_consensus.cc:3055] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:02.768049 29210 raft_consensus.cc:740] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:02.768878 29210 consensus_queue.cc:260] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:02.770100 29210 raft_consensus.cc:3060] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.775133 29286 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:02.776427 29856 leader_election.cc:304] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:02.776958 29210 raft_consensus.cc:2468] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:02.777418 30166 raft_consensus.cc:2804] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:02.777976 30166 raft_consensus.cc:697] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:02.778882 30166 consensus_queue.cc:237] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:02.792286 28960 catalog_manager.cc:5697] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 2 to 3, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:02.811241 30147 raft_consensus.cc:993] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.811760 30146 raft_consensus.cc:1081] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.813529 29973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:22:02.814222 29973 raft_consensus.cc:493] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.814608 29973 raft_consensus.cc:3060] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.823922 29973 raft_consensus.cc:515] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.826515 29973 leader_election.cc:290] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:02.827739 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:02.828506 29212 raft_consensus.cc:3060] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.829165 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b9624100bda4f399b25c0c5fe5206f3" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:02.829921 29133 raft_consensus.cc:3055] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.830247 29133 raft_consensus.cc:740] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:02.831218 29133 consensus_queue.cc:260] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.832801 29133 raft_consensus.cc:3060] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.837046 29212 raft_consensus.cc:2468] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.838248 29858 leader_election.cc:304] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:02.839138 30166 raft_consensus.cc:2804] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.839668 30166 raft_consensus.cc:697] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:02.840580 30166 consensus_queue.cc:237] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:02.855178 29133 raft_consensus.cc:2468] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.869519 28960 catalog_manager.cc:5697] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.891755 30156 raft_consensus.cc:993] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.892418 30149 raft_consensus.cc:1081] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:02.893846 29973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48434
I20260709 12:22:02.894328 29973 raft_consensus.cc:493] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.894619 29973 raft_consensus.cc:3060] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.901346 29973 raft_consensus.cc:515] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:02.902057 29210 raft_consensus.cc:1275] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:02.903863 29973 leader_election.cc:290] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:22:02.904349 29286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:02.904755 30166 consensus_queue.cc:1048] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.905171 29286 raft_consensus.cc:3055] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.905601 29286 raft_consensus.cc:740] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:22:02.905736 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed2c2eff70342fab5e80c4a76ab3593" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:02.906407 29133 raft_consensus.cc:3060] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.906733 29286 consensus_queue.cc:260] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:02.908371 29286 raft_consensus.cc:3060] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.917440 29137 raft_consensus.cc:1275] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:02.919536 30167 consensus_queue.cc:1048] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:02.924436 29286 raft_consensus.cc:2468] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.925648 29133 raft_consensus.cc:2468] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:02.927214 29856 leader_election.cc:304] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:02.929081 30166 raft_consensus.cc:2804] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.932283 30166 raft_consensus.cc:697] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:02.933792 30166 consensus_queue.cc:237] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:02.970916 28959 catalog_manager.cc:5697] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.999807 29139 raft_consensus.cc:1275] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.001747 30167 consensus_queue.cc:1048] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.011972 29286 raft_consensus.cc:1275] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.013731 30178 consensus_queue.cc:1048] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.021096 29139 raft_consensus.cc:1275] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.023020 30178 consensus_queue.cc:1048] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.062266 29210 raft_consensus.cc:1275] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.063832 30178 consensus_queue.cc:1048] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.182900 29210 raft_consensus.cc:1275] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:03.184165 30178 consensus_queue.cc:1048] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:03.194010 29285 raft_consensus.cc:1275] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:03.198009 30179 consensus_queue.cc:1048] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:03.224632 29210 raft_consensus.cc:1275] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.224692 29133 raft_consensus.cc:1275] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.226646 30179 consensus_queue.cc:1048] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.227667 30166 consensus_queue.cc:1048] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.353159 29285 raft_consensus.cc:1275] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.354390 30166 consensus_queue.cc:1048] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.364892 29133 raft_consensus.cc:1275] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.366328 30167 consensus_queue.cc:1048] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.470425 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:03.516834 29212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:60264
I20260709 12:22:03.517539 29212 raft_consensus.cc:606] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:03.520205 29286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149"
dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:42400
I20260709 12:22:03.520793 29286 raft_consensus.cc:606] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:03.523438 29286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749"
dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
mode: GRACEFUL
new_leader_uuid: "7e87f64602ef465cb6288f69964235a9"
 from {username='slave'} at 127.0.0.1:42400
I20260709 12:22:03.523985 29286 raft_consensus.cc:606] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Received request to transfer leadership to TS 7e87f64602ef465cb6288f69964235a9
I20260709 12:22:03.526474 29212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
mode: GRACEFUL
new_leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
 from {username='slave'} at 127.0.0.1:60264
I20260709 12:22:03.527040 29212 raft_consensus.cc:606] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Received request to transfer leadership to TS 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:22:03.529325 29212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:60264
I20260709 12:22:03.529722 29212 raft_consensus.cc:606] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:03.530602 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:03.532188 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:03.532889 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:03.598848 30149 raft_consensus.cc:993] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: : Instructing follower 7e87f64602ef465cb6288f69964235a9 to start an election
I20260709 12:22:03.599355 30156 raft_consensus.cc:1081] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Signalling peer 7e87f64602ef465cb6288f69964235a9 to start an election
I20260709 12:22:03.601006 29212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:22:03.601641 29212 raft_consensus.cc:493] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.602018 29212 raft_consensus.cc:3060] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.609678 29212 raft_consensus.cc:515] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:03.613904 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:03.614445 29286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848262912d046ed91ff2b8b5a5ca749" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:03.614665 29137 raft_consensus.cc:3060] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.615170 29286 raft_consensus.cc:3055] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.613397 29212 leader_election.cc:290] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:22:03.615520 29286 raft_consensus.cc:740] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:22:03.616690 29286 consensus_queue.cc:260] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:03.618088 29286 raft_consensus.cc:3060] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.622996 29137 raft_consensus.cc:2468] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:22:03.624457 29181 leader_election.cc:304] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:22:03.625409 30157 raft_consensus.cc:2804] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.625873 30157 raft_consensus.cc:697] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:03.625962 29286 raft_consensus.cc:2468] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:22:03.626804 30157 consensus_queue.cc:237] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:03.636976 28962 catalog_manager.cc:5697] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.679312 30157 raft_consensus.cc:993] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:03.680183 30160 raft_consensus.cc:1081] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:03.681980 29999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48452
I20260709 12:22:03.682566 29999 raft_consensus.cc:493] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.682933 29999 raft_consensus.cc:3060] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.692206 29999 raft_consensus.cc:515] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:03.694028 29999 leader_election.cc:290] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:03.696333 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:03.696951 29212 raft_consensus.cc:3055] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.697341 29212 raft_consensus.cc:740] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:03.698251 29212 consensus_queue.cc:260] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:03.699743 29212 raft_consensus.cc:3060] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.704221 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b537faf3fa445968eed78c8c6176d0c" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:03.704864 29137 raft_consensus.cc:3060] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.706276 29212 raft_consensus.cc:2468] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:03.707480 29858 leader_election.cc:304] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:03.708228 30178 raft_consensus.cc:2804] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.708700 30178 raft_consensus.cc:697] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:03.709688 30178 consensus_queue.cc:237] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:03.711930 29137 raft_consensus.cc:2468] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:03.721263 28962 catalog_manager.cc:5697] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.825166 30149 raft_consensus.cc:993] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:03.825681 30156 raft_consensus.cc:1081] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:03.827085 29973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48434
I20260709 12:22:03.827617 29973 raft_consensus.cc:493] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.827914 29973 raft_consensus.cc:3060] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.833686 29973 raft_consensus.cc:515] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:03.836426 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:03.836953 29973 leader_election.cc:290] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:22:03.837024 29210 raft_consensus.cc:3060] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.839172 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245a5b3a66c044189c7a2a2d10db4149" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:03.839787 29285 raft_consensus.cc:3055] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.840082 29285 raft_consensus.cc:740] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:22:03.841008 29285 consensus_queue.cc:260] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:03.842382 29285 raft_consensus.cc:3060] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.845582 29210 raft_consensus.cc:2468] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:03.846855 29858 leader_election.cc:304] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:03.848057 30178 raft_consensus.cc:2804] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.848759 30178 raft_consensus.cc:697] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:03.850025 29285 raft_consensus.cc:2468] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:03.849856 30178 consensus_queue.cc:237] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:03.859862 28962 catalog_manager.cc:5697] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.871649 30157 raft_consensus.cc:993] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:03.872216 30160 raft_consensus.cc:1081] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:03.873590 29973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48452
I20260709 12:22:03.874039 29973 raft_consensus.cc:493] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.874262 29973 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:03.880831 29973 raft_consensus.cc:515] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:03.882266 29973 leader_election.cc:290] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:03.883041 29133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:03.883183 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9adb2996f7454cf4821ff6582f680165" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:03.883906 29133 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:03.883973 29210 raft_consensus.cc:3055] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:03.884413 29210 raft_consensus.cc:740] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:03.885361 29210 consensus_queue.cc:260] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:03.886564 29210 raft_consensus.cc:3060] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:03.890085 29133 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:03.891363 29858 leader_election.cc:304] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:03.892230 30178 raft_consensus.cc:2804] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:03.892697 30178 raft_consensus.cc:697] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:03.893676 30178 consensus_queue.cc:237] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:03.894697 29210 raft_consensus.cc:2468] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:03.904709 28962 catalog_manager.cc:5697] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 2 to 3, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.915556 30160 raft_consensus.cc:993] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: : Instructing follower 6cf7766f7e944f41837fd8aa8bde0018 to start an election
I20260709 12:22:03.916059 30157 raft_consensus.cc:1081] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Signalling peer 6cf7766f7e944f41837fd8aa8bde0018 to start an election
I20260709 12:22:03.917506 29133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:22:03.918021 29133 raft_consensus.cc:493] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:03.918332 29133 raft_consensus.cc:3060] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.924703 29133 raft_consensus.cc:515] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:03.926329 29133 leader_election.cc:290] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:22:03.927718 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:03.928365 29285 raft_consensus.cc:3060] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.931003 29212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504440a1993945c68cb34cd95f8ff39f" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:03.931680 29212 raft_consensus.cc:3055] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.931980 29212 raft_consensus.cc:740] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:03.932793 29212 consensus_queue.cc:260] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:03.933800 29212 raft_consensus.cc:3060] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.935710 29285 raft_consensus.cc:2468] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:22:03.937588 29105 leader_election.cc:304] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 91fd10ed5c3e47fcb354c51acbe25286; no voters: 
I20260709 12:22:03.938464 30147 raft_consensus.cc:2804] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.938899 30147 raft_consensus.cc:697] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:03.940598 30147 consensus_queue.cc:237] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:03.943181 29212 raft_consensus.cc:2468] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:22:03.952319 28962 catalog_manager.cc:5697] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.119933 29137 raft_consensus.cc:1275] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.121102 30166 consensus_queue.cc:1048] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.134013 29210 raft_consensus.cc:1275] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.137915 30167 consensus_queue.cc:1048] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.139938 29285 raft_consensus.cc:1275] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.142170 30157 consensus_queue.cc:1048] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.172303 29133 raft_consensus.cc:1275] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.174450 30160 consensus_queue.cc:1048] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.290092 29285 raft_consensus.cc:1275] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.291898 30167 consensus_queue.cc:1048] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.306628 29210 raft_consensus.cc:1275] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.319007 30178 consensus_queue.cc:1048] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:04.362155 29137 raft_consensus.cc:1275] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:04.363608 30178 consensus_queue.cc:1048] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:04.378376 29210 raft_consensus.cc:1275] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:04.380010 30166 consensus_queue.cc:1048] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:04.494619 29285 raft_consensus.cc:1275] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.496129 30216 consensus_queue.cc:1048] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:04.512161 29210 raft_consensus.cc:1275] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.519522 30146 consensus_queue.cc:1048] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:04.574303 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:04.613705 29285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8"
dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
mode: GRACEFUL
new_leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
 from {username='slave'} at 127.0.0.1:42400
I20260709 12:22:04.614323 29285 raft_consensus.cc:606] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Received request to transfer leadership to TS 6cf7766f7e944f41837fd8aa8bde0018
I20260709 12:22:04.617189 29285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81"
dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:42400
I20260709 12:22:04.617770 29285 raft_consensus.cc:606] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:04.620344 29210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:60264
I20260709 12:22:04.620851 29210 raft_consensus.cc:606] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:04.623471 29286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "970d5a478a4e490a87a712db238e695c"
dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
mode: GRACEFUL
new_leader_uuid: "7e87f64602ef465cb6288f69964235a9"
 from {username='slave'} at 127.0.0.1:42400
I20260709 12:22:04.624053 29286 raft_consensus.cc:606] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Received request to transfer leadership to TS 7e87f64602ef465cb6288f69964235a9
I20260709 12:22:04.628515 29137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:22:04.629395 29137 raft_consensus.cc:606] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:04.630622 30211 raft_consensus.cc:993] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: : Instructing follower 7e87f64602ef465cb6288f69964235a9 to start an election
I20260709 12:22:04.631309 30156 raft_consensus.cc:1081] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Signalling peer 7e87f64602ef465cb6288f69964235a9 to start an election
I20260709 12:22:04.632300 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:04.634603 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:04.635409 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:04.639362 29210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "970d5a478a4e490a87a712db238e695c"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
 from {username='slave'} at 127.0.0.1:58486
I20260709 12:22:04.640017 29210 raft_consensus.cc:493] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.640380 29210 raft_consensus.cc:3060] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.651755 30156 raft_consensus.cc:993] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: : Instructing follower 6cf7766f7e944f41837fd8aa8bde0018 to start an election
I20260709 12:22:04.652560 30156 raft_consensus.cc:1081] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Signalling peer 6cf7766f7e944f41837fd8aa8bde0018 to start an election
I20260709 12:22:04.651012 29210 raft_consensus.cc:515] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:04.654146 29137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
 from {username='slave'} at 127.0.0.1:58402
I20260709 12:22:04.654742 29137 raft_consensus.cc:493] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.655087 29137 raft_consensus.cc:3060] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.656085 29210 leader_election.cc:290] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:22:04.660524 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:04.661221 29139 raft_consensus.cc:3060] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.661432 29286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "970d5a478a4e490a87a712db238e695c" candidate_uuid: "7e87f64602ef465cb6288f69964235a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:04.662052 29286 raft_consensus.cc:3055] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.662338 29286 raft_consensus.cc:740] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:22:04.663146 29286 consensus_queue.cc:260] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:04.664300 29286 raft_consensus.cc:3060] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.669519 29139 raft_consensus.cc:2468] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:22:04.670692 29181 leader_election.cc:304] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:22:04.671445 30213 raft_consensus.cc:2804] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.672062 30213 raft_consensus.cc:697] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Leader. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:04.671737 29137 raft_consensus.cc:515] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:04.680805 30213 consensus_queue.cc:237] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:04.682473 29137 leader_election.cc:290] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:22:04.679461 29286 raft_consensus.cc:2468] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87f64602ef465cb6288f69964235a9 in term 2.
I20260709 12:22:04.683956 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:04.684662 29210 raft_consensus.cc:3060] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.684942 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07cf2c0767c14dac861751f1d5d524e8" candidate_uuid: "6cf7766f7e944f41837fd8aa8bde0018" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:04.686993 29285 raft_consensus.cc:3055] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.687325 29285 raft_consensus.cc:740] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:22:04.690071 29285 consensus_queue.cc:260] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:04.691359 29285 raft_consensus.cc:3060] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.695663 29210 raft_consensus.cc:2468] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:22:04.697352 29107 leader_election.cc:304] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 7e87f64602ef465cb6288f69964235a9; no voters: 
I20260709 12:22:04.697757 29285 raft_consensus.cc:2468] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cf7766f7e944f41837fd8aa8bde0018 in term 2.
I20260709 12:22:04.698537 30146 raft_consensus.cc:2804] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.699870 30146 raft_consensus.cc:697] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Leader. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:04.702302 30146 consensus_queue.cc:237] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } }
I20260709 12:22:04.716055 28960 catalog_manager.cc:5697] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 reported cstate change: term changed from 1 to 2, leader changed from 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68) to 7e87f64602ef465cb6288f69964235a9 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "7e87f64602ef465cb6288f69964235a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.734840 28959 catalog_manager.cc:5697] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 reported cstate change: term changed from 1 to 2, leader changed from 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68) to 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "6cf7766f7e944f41837fd8aa8bde0018" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.884828 30213 raft_consensus.cc:993] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:04.886524 30157 raft_consensus.cc:1081] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:04.888334 29973 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48452
I20260709 12:22:04.888943 29973 raft_consensus.cc:493] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.889345 29973 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.895364 29973 raft_consensus.cc:515] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:04.896983 29973 leader_election.cc:290] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:04.897733 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:04.898073 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89fa7dc85da649e3a5c3195b959e3a61" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:04.898556 29137 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.898717 29210 raft_consensus.cc:3055] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:04.899140 29210 raft_consensus.cc:740] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:04.899923 29210 consensus_queue.cc:260] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:04.901144 29210 raft_consensus.cc:3060] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.905157 29137 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:04.906996 29858 leader_election.cc:304] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:04.908221 30178 raft_consensus.cc:2804] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:04.908349 29210 raft_consensus.cc:2468] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:04.908773 30178 raft_consensus.cc:697] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:04.909844 30178 consensus_queue.cc:237] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:04.920372 28959 catalog_manager.cc:5697] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 2 to 3, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.033231 30211 raft_consensus.cc:993] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:05.035455 30210 raft_consensus.cc:1081] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:05.037883 29999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48434
I20260709 12:22:05.038558 29999 raft_consensus.cc:493] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.038954 29999 raft_consensus.cc:3060] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.044792 29999 raft_consensus.cc:515] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:05.046439 29999 leader_election.cc:290] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:22:05.047115 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:05.047346 29137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b994c952494b52b3bd6e1946663c81" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:05.047881 29285 raft_consensus.cc:3055] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:05.048024 29137 raft_consensus.cc:3060] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.048161 29285 raft_consensus.cc:740] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91fd10ed5c3e47fcb354c51acbe25286, State: Running, Role: LEADER
I20260709 12:22:05.049078 29285 consensus_queue.cc:260] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:05.050114 29285 raft_consensus.cc:3060] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.054301 29137 raft_consensus.cc:2468] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:05.055431 29858 leader_election.cc:304] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:05.056553 30178 raft_consensus.cc:2804] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:05.056995 30178 raft_consensus.cc:697] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:05.057835 30178 consensus_queue.cc:237] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:05.058671 29285 raft_consensus.cc:2468] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:05.068672 28959 catalog_manager.cc:5697] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.085031 29210 raft_consensus.cc:1275] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.086813 30146 consensus_queue.cc:1048] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.107209 29286 raft_consensus.cc:1275] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 6cf7766f7e944f41837fd8aa8bde0018: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.111799 30147 consensus_queue.cc:1048] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.117744 29286 raft_consensus.cc:1275] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.119441 30213 consensus_queue.cc:1048] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.116405 30147 raft_consensus.cc:993] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:05.124857 30147 raft_consensus.cc:1081] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:05.127365 30008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:22:05.128911 30008 raft_consensus.cc:493] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.129417 30008 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.214499 30008 raft_consensus.cc:515] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:05.219079 30008 leader_election.cc:290] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Requested vote from peers 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507), 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735)
I20260709 12:22:05.222967 29137 raft_consensus.cc:1275] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 7e87f64602ef465cb6288f69964235a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.228515 30157 consensus_queue.cc:1048] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.236817 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:05.237520 29139 raft_consensus.cc:3055] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:05.237825 29139 raft_consensus.cc:740] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:05.238636 29139 consensus_queue.cc:260] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:05.240221 29139 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.246894 29139 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:05.252424 29858 leader_election.cc:304] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:05.256786 30239 raft_consensus.cc:2804] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:05.257113 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea44e5f06ab7487b85663ead289a65d5" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:05.257901 29210 raft_consensus.cc:3060] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.258244 30239 raft_consensus.cc:697] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:05.259362 30239 consensus_queue.cc:237] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } }
I20260709 12:22:05.266549 29210 raft_consensus.cc:2468] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:05.298300 28960 catalog_manager.cc:5697] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 2 to 3, leader changed from 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.355760 29133 raft_consensus.cc:1275] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:05.357206 30239 consensus_queue.cc:1048] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:05.376698 29210 raft_consensus.cc:1275] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:05.378038 30239 consensus_queue.cc:1048] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:05.464967 29139 raft_consensus.cc:1275] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.466261 30167 consensus_queue.cc:1048] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.479333 29285 raft_consensus.cc:1275] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.482448 30238 consensus_queue.cc:1048] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.694552 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.736931 29139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e"
dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:51888
I20260709 12:22:05.737673 29139 raft_consensus.cc:606] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:05.740341 29210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea"
dest_uuid: "7e87f64602ef465cb6288f69964235a9"
mode: GRACEFUL
new_leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:60264
I20260709 12:22:05.740849 29210 raft_consensus.cc:606] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Received request to transfer leadership to TS 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:05.741952 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:05.743502 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:05.744356 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.821835 29212 raft_consensus.cc:1275] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:05.823272 30238 consensus_queue.cc:1048] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:05.827476 29139 raft_consensus.cc:1275] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:05.828893 30238 consensus_queue.cc:1048] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:05.994622 30240 raft_consensus.cc:993] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:05.995255 30250 raft_consensus.cc:1081] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:05.996867 29999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48452
I20260709 12:22:05.997393 29999 raft_consensus.cc:493] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.997763 29999 raft_consensus.cc:3060] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.004410 29999 raft_consensus.cc:515] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:06.006569 29999 leader_election.cc:290] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807)
I20260709 12:22:06.008289 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:06.008420 29210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da79a40a6b07437086aa49b0cc2ae9ea" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e87f64602ef465cb6288f69964235a9"
I20260709 12:22:06.009003 29285 raft_consensus.cc:3060] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.009104 29210 raft_consensus.cc:3055] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:06.009579 29210 raft_consensus.cc:740] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e87f64602ef465cb6288f69964235a9, State: Running, Role: LEADER
I20260709 12:22:06.010481 29210 consensus_queue.cc:260] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:06.011641 29210 raft_consensus.cc:3060] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.014616 29285 raft_consensus.cc:2468] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:06.015767 29856 leader_election.cc:304] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:06.016855 30239 raft_consensus.cc:2804] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:06.017472 29210 raft_consensus.cc:2468] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 2.
I20260709 12:22:06.018152 30239 raft_consensus.cc:697] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:06.020138 30239 consensus_queue.cc:237] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:06.032583 28959 catalog_manager.cc:5697] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 1 to 2, leader changed from 7e87f64602ef465cb6288f69964235a9 (127.18.132.67) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.106722 30147 raft_consensus.cc:993] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: : Instructing follower 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:06.107235 30233 raft_consensus.cc:1081] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Signalling peer 92a88e5c9f6f4c83b7765774ef4fe0f5 to start an election
I20260709 12:22:06.108748 29999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e"
dest_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:22:06.109274 29999 raft_consensus.cc:493] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:06.109661 29999 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.117401 29999 raft_consensus.cc:515] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:06.120010 29999 leader_election.cc:290] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Requested vote from peers 91fd10ed5c3e47fcb354c51acbe25286 (127.18.132.68:45807), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:22:06.120460 29285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91fd10ed5c3e47fcb354c51acbe25286"
I20260709 12:22:06.120931 29139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b49a4fda120d4293aa6694ed3fb8336e" candidate_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cf7766f7e944f41837fd8aa8bde0018"
I20260709 12:22:06.121112 29285 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.121569 29139 raft_consensus.cc:3055] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:06.121850 29139 raft_consensus.cc:740] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cf7766f7e944f41837fd8aa8bde0018, State: Running, Role: LEADER
I20260709 12:22:06.122598 29139 consensus_queue.cc:260] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:06.123489 29139 raft_consensus.cc:3060] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.129343 29139 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:06.130589 29858 leader_election.cc:304] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5; no voters: 
I20260709 12:22:06.131533 30239 raft_consensus.cc:2804] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:06.132310 29285 raft_consensus.cc:2468] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92a88e5c9f6f4c83b7765774ef4fe0f5 in term 3.
I20260709 12:22:06.132418 30239 raft_consensus.cc:697] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Becoming Leader. State: Replica: 92a88e5c9f6f4c83b7765774ef4fe0f5, State: Running, Role: LEADER
I20260709 12:22:06.138340 30239 consensus_queue.cc:237] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:06.152146 28959 catalog_manager.cc:5697] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 reported cstate change: term changed from 2 to 3, leader changed from 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66) to 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65). New cstate: current_term: 3 leader_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.566653 29287 raft_consensus.cc:1275] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:06.567976 30239 consensus_queue.cc:1048] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:06.577859 29139 raft_consensus.cc:1275] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:06.579484 30238 consensus_queue.cc:1048] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:06.600761 29212 raft_consensus.cc:1275] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:06.602775 30238 consensus_queue.cc:1048] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:06.606060 29287 raft_consensus.cc:1275] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Refusing update from remote peer 92a88e5c9f6f4c83b7765774ef4fe0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:06.607949 30239 consensus_queue.cc:1048] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:06.712256 29181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:42507, user_credentials={real_user=slave}} blocked reactor thread for 67792.2us
I20260709 12:22:06.787977 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:06.827625 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:06.828840 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:06.829380 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:06.866453 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:06.903250 18961 tablet_server.cc:179] TabletServer@127.18.132.65:42483 shutting down...
W20260709 12:22:06.909083 29180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 310 similar messages]
W20260709 12:22:06.913951 29180 consensus_peers.cc:597] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:06.939029 29106 consensus_peers.cc:597] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:06.943286 29180 consensus_peers.cc:597] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.949231 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:06.950263 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:06.951073 18961 raft_consensus.cc:2243] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.951552 18961 raft_consensus.cc:2272] T cfbb99959a4d4868936840d4e60bbe83 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.954276 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:06.954989 18961 raft_consensus.cc:2243] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.955924 18961 raft_consensus.cc:2272] T aed2c2eff70342fab5e80c4a76ab3593 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.958624 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:06.959405 18961 raft_consensus.cc:2243] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.959868 18961 raft_consensus.cc:2272] T e79910b5e01341aea4d305a8d26211eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.963021 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:06.964111 18961 raft_consensus.cc:2243] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:06.964676 18961 raft_consensus.cc:2272] T fa12ef41f343476a8228cd78fe0db9bb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:06.967813 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:06.968711 18961 raft_consensus.cc:2243] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:06.969777 18961 raft_consensus.cc:2272] T 89fa7dc85da649e3a5c3195b959e3a61 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:06.970695 29180 consensus_peers.cc:597] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.973098 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.025964 18961 raft_consensus.cc:2243] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.028015 18961 raft_consensus.cc:2272] T 9adb2996f7454cf4821ff6582f680165 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.032843 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.037464 18961 raft_consensus.cc:2243] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.039458 18961 raft_consensus.cc:2272] T 2b638bc90c6b4ca4a599a9104e10af3b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.043273 29180 consensus_peers.cc:597] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.045224 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.049774 18961 raft_consensus.cc:2243] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:22:07.052207 29106 consensus_peers.cc:597] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.052225 18961 raft_consensus.cc:2272] T ea44e5f06ab7487b85663ead289a65d5 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.060384 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.063028 18961 raft_consensus.cc:2243] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:22:07.061543 29180 consensus_peers.cc:597] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.069681 18961 raft_consensus.cc:2272] T da79a40a6b07437086aa49b0cc2ae9ea P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.075488 18961 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:07.076820 29180 consensus_peers.cc:597] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.082139 18961 raft_consensus.cc:2243] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.082804 18961 raft_consensus.cc:2272] T 26215fc88fd545f290fbaaff9ae467f6 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.084450 29255 consensus_peers.cc:597] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.085088 29255 consensus_peers.cc:597] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.085533 29255 consensus_peers.cc:597] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.086122 18961 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:07.087589 29255 consensus_peers.cc:597] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.087623 18961 raft_consensus.cc:2243] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.088595 18961 raft_consensus.cc:2272] T f15092329a634992ba6d44f5e89b40db P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.092234 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.093068 18961 raft_consensus.cc:2243] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.093657 18961 raft_consensus.cc:2272] T a2294d7212b244ba80173c04a7ae214e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.094449 29106 consensus_peers.cc:597] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.097334 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.098608 18961 raft_consensus.cc:2243] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.099263 18961 raft_consensus.cc:2272] T 4e0254afbe554de5bda48bee078dc4b8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.102867 29180 consensus_peers.cc:597] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.102978 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.104254 18961 raft_consensus.cc:2243] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.104841 18961 raft_consensus.cc:2272] T 118990c87a4d480baacf7c25b58229aa P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.105641 29106 consensus_peers.cc:597] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.105899 29255 consensus_peers.cc:597] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.108122 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.109226 18961 raft_consensus.cc:2243] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.109774 18961 raft_consensus.cc:2272] T 341064dd172e4bfc87467b2395fcad6b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.110296 29180 consensus_peers.cc:597] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.112634 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.113689 18961 raft_consensus.cc:2243] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.114207 18961 raft_consensus.cc:2272] T c7496a0c6c1946acad1f4fb97b1ce80b P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.116240 29180 consensus_peers.cc:597] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.117537 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.118305 18961 raft_consensus.cc:2243] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.119379 18961 raft_consensus.cc:2272] T 4b9624100bda4f399b25c0c5fe5206f3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.122371 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.123169 18961 raft_consensus.cc:2243] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:07.123215 29106 consensus_peers.cc:597] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.123926 18961 raft_consensus.cc:2272] T a11ff826b27146f8b266ae26e03dc775 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.126031 29255 consensus_peers.cc:597] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.126957 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.127895 18961 raft_consensus.cc:2243] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.128520 18961 raft_consensus.cc:2272] T aecf4de06f0641c5bedbc8eb813a7f97 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.131196 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.132028 18961 raft_consensus.cc:2243] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.132665 18961 raft_consensus.cc:2272] T 172799b8ec7c4d32905d6b02f0728846 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.135967 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.136689 18961 raft_consensus.cc:2243] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.137131 18961 raft_consensus.cc:2272] T b774d33d7306413c852622175e13c2cc P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.140326 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.140934 18961 raft_consensus.cc:2243] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.141764 18961 raft_consensus.cc:2272] T cbaa18dc25644cc6976f09ff3dfce4f8 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.145004 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.146004 18961 raft_consensus.cc:2243] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.146582 18961 raft_consensus.cc:2272] T 5ecfc448993b45138c2cda5213e934c1 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.147132 29180 consensus_peers.cc:597] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.148229 29106 consensus_peers.cc:597] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.149668 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.150472 18961 raft_consensus.cc:2243] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.150950 18961 raft_consensus.cc:2272] T faf05148546740429720380b7f235833 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.153595 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.154258 18961 raft_consensus.cc:2243] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.154744 18961 raft_consensus.cc:2272] T 73311071016949569f4b68732a970667 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.157094 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.157711 18961 raft_consensus.cc:2243] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.158174 18961 raft_consensus.cc:2272] T 7d5356a7d1c64926aeed795d25f96c0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.161983 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.162638 18961 raft_consensus.cc:2243] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.163129 18961 raft_consensus.cc:2272] T 4f1a67b1f91a4f07b9acc926b114d701 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.166304 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.167057 18961 raft_consensus.cc:2243] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:22:07.167620 29255 consensus_peers.cc:597] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.168167 18961 raft_consensus.cc:2272] T 1973cb4352f14b628c856d7f58cea0da P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.170406 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.170994 18961 raft_consensus.cc:2243] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.171478 18961 raft_consensus.cc:2272] T 4719ec61ba174acdbffd0d8a8f691142 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.173895 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.174602 18961 raft_consensus.cc:2243] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.175408 18961 raft_consensus.cc:2272] T b49a4fda120d4293aa6694ed3fb8336e P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.177961 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.178555 18961 raft_consensus.cc:2243] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.179463 18961 raft_consensus.cc:2272] T 1b537faf3fa445968eed78c8c6176d0c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.181592 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.182147 18961 raft_consensus.cc:2243] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.182986 18961 raft_consensus.cc:2272] T 092eec00ed674936b54daf8589efe743 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.185150 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.185751 18961 raft_consensus.cc:2243] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.186189 18961 raft_consensus.cc:2272] T 6469c0ade3804810b53702577319456c P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.188548 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.189105 18961 raft_consensus.cc:2243] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.189513 18961 raft_consensus.cc:2272] T b67bcd4012bb45829241ae1389b6afa3 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.191577 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.192175 18961 raft_consensus.cc:2243] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.192641 18961 raft_consensus.cc:2272] T 1c79ddf0b439489197763183ae8553e4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.194857 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.195406 18961 raft_consensus.cc:2243] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.196273 18961 raft_consensus.cc:2272] T 33b994c952494b52b3bd6e1946663c81 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.198406 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.198945 18961 raft_consensus.cc:2243] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.199959 18961 raft_consensus.cc:2272] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.202412 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.203009 18961 raft_consensus.cc:2243] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.203507 18961 raft_consensus.cc:2272] T cd03869bf33149b993051af5c8f055eb P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.205832 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.206420 18961 raft_consensus.cc:2243] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.206875 18961 raft_consensus.cc:2272] T 494a1a011a1c49d9845829b1a5858c4a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.209237 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.209784 18961 raft_consensus.cc:2243] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.210270 18961 raft_consensus.cc:2272] T d4c2675a26a2453487ff7fa3eb4a4441 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.213511 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.214241 18961 raft_consensus.cc:2243] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.214901 18961 raft_consensus.cc:2272] T f8fffd97d1134dc9addffe91d5d5e5d4 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.214967 29180 consensus_peers.cc:597] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.218088 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.218791 18961 raft_consensus.cc:2243] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.219336 18961 raft_consensus.cc:2272] T 7483cd4c0e99450089e2c3aef8f1524a P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.221895 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.222573 18961 raft_consensus.cc:2243] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.223701 18961 raft_consensus.cc:2272] T 245a5b3a66c044189c7a2a2d10db4149 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.226219 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.226761 18961 raft_consensus.cc:2243] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.227177 18961 raft_consensus.cc:2272] T afa3802b77714deab6889b0c74f08f50 P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.230211 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:07.230973 18961 raft_consensus.cc:2243] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:07.231480 29106 consensus_peers.cc:597] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.231673 18961 raft_consensus.cc:2272] T 98cc247c119e4c099657c60c961aa37d P 92a88e5c9f6f4c83b7765774ef4fe0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.318959 18961 tablet_server.cc:196] TabletServer@127.18.132.65:42483 shutdown complete.
W20260709 12:22:07.321599 29255 consensus_peers.cc:597] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.325142 29255 consensus_peers.cc:597] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.334560 29255 consensus_peers.cc:597] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.384683 29106 consensus_peers.cc:597] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.401007 29255 consensus_peers.cc:597] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.425269 29180 consensus_peers.cc:597] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 -> Peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Couldn't send request to peer 92a88e5c9f6f4c83b7765774ef4fe0f5. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.437242 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
W20260709 12:22:07.457417 29181 consensus_peers.cc:597] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.458611 29256 consensus_peers.cc:597] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.492815 29256 consensus_peers.cc:597] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.524421 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:22:07.524712 29181 consensus_peers.cc:597] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.525642 18961 tablet_replica.cc:333] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.526969 18961 raft_consensus.cc:2243] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.528189 18961 raft_consensus.cc:2272] T 341064dd172e4bfc87467b2395fcad6b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.531052 18961 tablet_replica.cc:333] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.532043 18961 raft_consensus.cc:2243] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.533311 18961 raft_consensus.cc:2272] T b67bcd4012bb45829241ae1389b6afa3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.538367 18961 tablet_replica.cc:333] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.541960 18961 raft_consensus.cc:2243] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:07.542363 29181 consensus_peers.cc:597] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.542696 18961 raft_consensus.cc:2272] T f8fffd97d1134dc9addffe91d5d5e5d4 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.546372 18961 tablet_replica.cc:333] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.547132 18961 raft_consensus.cc:2243] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.547677 18961 raft_consensus.cc:2272] T 7483cd4c0e99450089e2c3aef8f1524a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.550009 18961 tablet_replica.cc:333] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.550904 18961 raft_consensus.cc:2243] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.552060 18961 raft_consensus.cc:2272] T 07cf2c0767c14dac861751f1d5d524e8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.555306 18961 tablet_replica.cc:333] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
W20260709 12:22:07.555423 29181 consensus_peers.cc:597] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.556430 18961 raft_consensus.cc:2243] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.557142 18961 raft_consensus.cc:2272] T 3848262912d046ed91ff2b8b5a5ca749 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.559845 29256 consensus_peers.cc:597] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.560377 18961 tablet_replica.cc:333] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.561542 18961 raft_consensus.cc:2243] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.562860 18961 raft_consensus.cc:2272] T e79910b5e01341aea4d305a8d26211eb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.566049 18961 tablet_replica.cc:333] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.566998 18961 raft_consensus.cc:2243] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.568280 18961 raft_consensus.cc:2272] T 98cc247c119e4c099657c60c961aa37d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.570940 18961 tablet_replica.cc:333] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.571704 18961 raft_consensus.cc:2243] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.572590 18961 raft_consensus.cc:2272] T 73311071016949569f4b68732a970667 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.575189 18961 tablet_replica.cc:333] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.576022 18961 raft_consensus.cc:2243] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.576538 18961 raft_consensus.cc:2272] T b49a4fda120d4293aa6694ed3fb8336e P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.582293 18961 tablet_replica.cc:333] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.582983 18961 raft_consensus.cc:2243] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.583467 18961 raft_consensus.cc:2272] T 092eec00ed674936b54daf8589efe743 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.586393 18961 tablet_replica.cc:333] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.587306 18961 raft_consensus.cc:2243] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.588325 18961 raft_consensus.cc:2272] T 1b537faf3fa445968eed78c8c6176d0c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.592334 18961 tablet_replica.cc:333] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.593124 18961 raft_consensus.cc:2243] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.594717 18961 raft_consensus.cc:2272] T 9548af611b534185ae76fa0d4c896962 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.597648 18961 tablet_replica.cc:333] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.598459 18961 raft_consensus.cc:2243] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.599059 18961 raft_consensus.cc:2272] T 58c070504fe245aba727845758bbca34 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.601886 29256 consensus_peers.cc:597] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.602375 18961 tablet_replica.cc:333] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
W20260709 12:22:07.602772 29181 consensus_peers.cc:597] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.603451 18961 raft_consensus.cc:2243] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.604809 18961 raft_consensus.cc:2272] T 16f61f9c9b39417ca1f74cfa4a80f092 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.608443 18961 tablet_replica.cc:333] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.609382 18961 raft_consensus.cc:2243] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.609942 18961 raft_consensus.cc:2272] T aed2c2eff70342fab5e80c4a76ab3593 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.613013 18961 tablet_replica.cc:333] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.613919 18961 raft_consensus.cc:2243] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.614557 18961 raft_consensus.cc:2272] T cfbb99959a4d4868936840d4e60bbe83 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.617748 18961 tablet_replica.cc:333] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.618584 18961 raft_consensus.cc:2243] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.619762 18961 raft_consensus.cc:2272] T 504440a1993945c68cb34cd95f8ff39f P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.622977 18961 tablet_replica.cc:333] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.623903 18961 raft_consensus.cc:2243] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.624445 18961 raft_consensus.cc:2272] T 33b994c952494b52b3bd6e1946663c81 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.627271 18961 tablet_replica.cc:333] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.627951 18961 raft_consensus.cc:2243] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.629033 18961 raft_consensus.cc:2272] T 494a1a011a1c49d9845829b1a5858c4a P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.631312 18961 tablet_replica.cc:333] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.631958 18961 raft_consensus.cc:2243] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.632836 18961 raft_consensus.cc:2272] T d4c2675a26a2453487ff7fa3eb4a4441 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.635063 18961 tablet_replica.cc:333] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.635774 18961 raft_consensus.cc:2243] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.636300 18961 raft_consensus.cc:2272] T 9adb2996f7454cf4821ff6582f680165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.638430 18961 tablet_replica.cc:333] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.639020 18961 raft_consensus.cc:2243] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.639470 18961 raft_consensus.cc:2272] T 9491de7c08e54ace93f8edaaadfff61a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.641664 18961 tablet_replica.cc:333] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.642208 18961 raft_consensus.cc:2243] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.642649 18961 raft_consensus.cc:2272] T b1bf6f5ffed54f1fad60a22b102f923d P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.645506 18961 tablet_replica.cc:333] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.646358 18961 raft_consensus.cc:2243] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.647068 18961 raft_consensus.cc:2272] T f15092329a634992ba6d44f5e89b40db P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.647723 29181 consensus_peers.cc:597] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.650043 18961 tablet_replica.cc:333] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.651012 18961 raft_consensus.cc:2243] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.651539 18961 raft_consensus.cc:2272] T 26215fc88fd545f290fbaaff9ae467f6 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.654515 18961 tablet_replica.cc:333] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.655290 18961 raft_consensus.cc:2243] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.655884 18961 raft_consensus.cc:2272] T ad25e9fbcd614e4e9eecbb5dc392c165 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.657950 18961 tablet_replica.cc:333] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.658689 18961 raft_consensus.cc:2243] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.659111 18961 raft_consensus.cc:2272] T 1973cb4352f14b628c856d7f58cea0da P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.661569 18961 tablet_replica.cc:333] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.662128 18961 raft_consensus.cc:2243] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.663002 18961 raft_consensus.cc:2272] T 7dd34001bec34add96fbddfbb1a9b54a P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.665181 18961 tablet_replica.cc:333] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.665768 18961 raft_consensus.cc:2243] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.666204 18961 raft_consensus.cc:2272] T a2294d7212b244ba80173c04a7ae214e P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.668426 18961 tablet_replica.cc:333] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.668998 18961 raft_consensus.cc:2243] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.669838 18961 raft_consensus.cc:2272] T 8fecfd39d27743c9aec3e98b7f9162b2 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.672045 18961 tablet_replica.cc:333] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.672596 18961 raft_consensus.cc:2243] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.673049 18961 raft_consensus.cc:2272] T 172799b8ec7c4d32905d6b02f0728846 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.675072 18961 tablet_replica.cc:333] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.675659 18961 raft_consensus.cc:2243] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.676478 18961 raft_consensus.cc:2272] T aecf4de06f0641c5bedbc8eb813a7f97 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.678428 18961 tablet_replica.cc:333] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.678982 18961 raft_consensus.cc:2243] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.679416 18961 raft_consensus.cc:2272] T a11ff826b27146f8b266ae26e03dc775 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.681697 18961 tablet_replica.cc:333] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.682283 18961 raft_consensus.cc:2243] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.682724 18961 raft_consensus.cc:2272] T ea44e5f06ab7487b85663ead289a65d5 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.685022 18961 tablet_replica.cc:333] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.685576 18961 raft_consensus.cc:2243] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.686007 18961 raft_consensus.cc:2272] T a6f9df47273e4b88bb17fb9d1924c020 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.688232 18961 tablet_replica.cc:333] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.688819 18961 raft_consensus.cc:2243] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:07.689704 18961 raft_consensus.cc:2272] T 137ad6a7bad4460bb03ca501e6588a2b P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.691912 18961 tablet_replica.cc:333] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.692461 18961 raft_consensus.cc:2243] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.692893 18961 raft_consensus.cc:2272] T 4b9624100bda4f399b25c0c5fe5206f3 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.695437 18961 tablet_replica.cc:333] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.696206 18961 raft_consensus.cc:2243] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:07.696236 29256 consensus_peers.cc:597] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.697196 18961 raft_consensus.cc:2272] T 970d5a478a4e490a87a712db238e695c P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.699802 18961 tablet_replica.cc:333] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.700610 18961 raft_consensus.cc:2243] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.701225 18961 raft_consensus.cc:2272] T 89fa7dc85da649e3a5c3195b959e3a61 P 6cf7766f7e944f41837fd8aa8bde0018 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.704109 18961 tablet_replica.cc:333] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.704932 18961 raft_consensus.cc:2243] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.705583 18961 raft_consensus.cc:2272] T faf05148546740429720380b7f235833 P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.708545 18961 tablet_replica.cc:333] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.709306 18961 raft_consensus.cc:2243] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.709909 18961 raft_consensus.cc:2272] T fa12ef41f343476a8228cd78fe0db9bb P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.712688 18961 tablet_replica.cc:333] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.713393 18961 raft_consensus.cc:2243] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.714012 18961 raft_consensus.cc:2272] T b774d33d7306413c852622175e13c2cc P 6cf7766f7e944f41837fd8aa8bde0018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:07.716852 18961 tablet_replica.cc:333] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018: stopping tablet replica
I20260709 12:22:07.717374 18961 raft_consensus.cc:2243] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:07.717897 18961 raft_consensus.cc:2272] T cbaa18dc25644cc6976f09ff3dfce4f8 P 6cf7766f7e944f41837fd8aa8bde0018 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:07.745424 29181 consensus_peers.cc:597] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.822741 29181 consensus_peers.cc:597] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.832444 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
W20260709 12:22:07.850391 29256 consensus_peers.cc:597] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.909663 29256 consensus_peers.cc:597] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.917258 29256 consensus_peers.cc:597] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.921324 29256 consensus_peers.cc:597] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:07.926652 29181 consensus_peers.cc:597] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 -> Peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Couldn't send request to peer 6cf7766f7e944f41837fd8aa8bde0018. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:07.954301 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
W20260709 12:22:08.008775 29256 consensus_peers.cc:597] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.032037 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:08.033149 18961 tablet_replica.cc:333] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.034086 18961 raft_consensus.cc:2243] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.035100 18961 raft_consensus.cc:2272] T f8fffd97d1134dc9addffe91d5d5e5d4 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.038008 18961 tablet_replica.cc:333] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.038709 18961 raft_consensus.cc:2243] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:08.038918 29256 consensus_peers.cc:597] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.039217 18961 raft_consensus.cc:2272] T 5ecfc448993b45138c2cda5213e934c1 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.042696 18961 tablet_replica.cc:333] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.043727 18961 raft_consensus.cc:2243] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.044373 18961 raft_consensus.cc:2272] T 07cf2c0767c14dac861751f1d5d524e8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.047490 18961 tablet_replica.cc:333] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.048465 18961 raft_consensus.cc:2243] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.049088 18961 raft_consensus.cc:2272] T e79910b5e01341aea4d305a8d26211eb P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.051816 18961 tablet_replica.cc:333] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.052395 18961 raft_consensus.cc:2243] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.052830 18961 raft_consensus.cc:2272] T 9548af611b534185ae76fa0d4c896962 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.054919 18961 tablet_replica.cc:333] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.055691 18961 raft_consensus.cc:2243] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.056396 18961 raft_consensus.cc:2272] T 092eec00ed674936b54daf8589efe743 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.059552 18961 tablet_replica.cc:333] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.060339 18961 raft_consensus.cc:2243] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.060758 18961 raft_consensus.cc:2272] T 1b537faf3fa445968eed78c8c6176d0c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.063088 18961 tablet_replica.cc:333] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.063728 18961 raft_consensus.cc:2243] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.064105 18961 raft_consensus.cc:2272] T 4719ec61ba174acdbffd0d8a8f691142 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.066190 18961 tablet_replica.cc:333] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.066735 18961 raft_consensus.cc:2243] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.067538 18961 raft_consensus.cc:2272] T c7496a0c6c1946acad1f4fb97b1ce80b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.069552 18961 tablet_replica.cc:333] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.070075 18961 raft_consensus.cc:2243] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.070569 18961 raft_consensus.cc:2272] T 58c070504fe245aba727845758bbca34 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.072871 18961 tablet_replica.cc:333] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.073479 18961 raft_consensus.cc:2243] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.073912 18961 raft_consensus.cc:2272] T 16f61f9c9b39417ca1f74cfa4a80f092 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:08.074311 29256 consensus_peers.cc:597] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.076196 18961 tablet_replica.cc:333] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.076924 18961 raft_consensus.cc:2243] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.077764 18961 raft_consensus.cc:2272] T 1c79ddf0b439489197763183ae8553e4 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.080253 18961 tablet_replica.cc:333] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.080852 18961 raft_consensus.cc:2243] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.081302 18961 raft_consensus.cc:2272] T 6469c0ade3804810b53702577319456c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.084224 18961 tablet_replica.cc:333] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.085175 18961 raft_consensus.cc:2243] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.086292 18961 raft_consensus.cc:2272] T cfbb99959a4d4868936840d4e60bbe83 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.089407 18961 tablet_replica.cc:333] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.090186 18961 raft_consensus.cc:2243] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.091297 18961 raft_consensus.cc:2272] T 970d5a478a4e490a87a712db238e695c P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:08.091822 29256 consensus_peers.cc:597] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.094236 18961 tablet_replica.cc:333] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.095074 18961 raft_consensus.cc:2243] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.095713 18961 raft_consensus.cc:2272] T 4b9624100bda4f399b25c0c5fe5206f3 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.098398 18961 tablet_replica.cc:333] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.099229 18961 raft_consensus.cc:2243] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.099851 18961 raft_consensus.cc:2272] T 9491de7c08e54ace93f8edaaadfff61a P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.102409 18961 tablet_replica.cc:333] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.103039 18961 raft_consensus.cc:2243] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.103497 18961 raft_consensus.cc:2272] T b1bf6f5ffed54f1fad60a22b102f923d P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.105803 18961 tablet_replica.cc:333] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.106386 18961 raft_consensus.cc:2243] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.107213 18961 raft_consensus.cc:2272] T f15092329a634992ba6d44f5e89b40db P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.109634 18961 tablet_replica.cc:333] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.110219 18961 raft_consensus.cc:2243] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.110641 18961 raft_consensus.cc:2272] T da79a40a6b07437086aa49b0cc2ae9ea P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.112697 18961 tablet_replica.cc:333] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.113265 18961 raft_consensus.cc:2243] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.114123 18961 raft_consensus.cc:2272] T ad25e9fbcd614e4e9eecbb5dc392c165 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.116389 18961 tablet_replica.cc:333] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.117019 18961 raft_consensus.cc:2243] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.117473 18961 raft_consensus.cc:2272] T 7dd34001bec34add96fbddfbb1a9b54a P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.119622 18961 tablet_replica.cc:333] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.120216 18961 raft_consensus.cc:2243] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.121054 18961 raft_consensus.cc:2272] T cd03869bf33149b993051af5c8f055eb P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.123065 18961 tablet_replica.cc:333] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.123662 18961 raft_consensus.cc:2243] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.124159 18961 raft_consensus.cc:2272] T 9adb2996f7454cf4821ff6582f680165 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.126096 18961 tablet_replica.cc:333] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.126670 18961 raft_consensus.cc:2243] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.127113 18961 raft_consensus.cc:2272] T 504440a1993945c68cb34cd95f8ff39f P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.129448 18961 tablet_replica.cc:333] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.130092 18961 raft_consensus.cc:2243] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.130568 18961 raft_consensus.cc:2272] T cbaa18dc25644cc6976f09ff3dfce4f8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.132735 18961 tablet_replica.cc:333] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.133328 18961 raft_consensus.cc:2243] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.134212 18961 raft_consensus.cc:2272] T 118990c87a4d480baacf7c25b58229aa P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.136727 18961 tablet_replica.cc:333] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.137327 18961 raft_consensus.cc:2243] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.137807 18961 raft_consensus.cc:2272] T 4e0254afbe554de5bda48bee078dc4b8 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.140161 18961 tablet_replica.cc:333] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.140743 18961 raft_consensus.cc:2243] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.141567 18961 raft_consensus.cc:2272] T 2b638bc90c6b4ca4a599a9104e10af3b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.143666 18961 tablet_replica.cc:333] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.144254 18961 raft_consensus.cc:2243] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.144697 18961 raft_consensus.cc:2272] T a6f9df47273e4b88bb17fb9d1924c020 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.146687 18961 tablet_replica.cc:333] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.147238 18961 raft_consensus.cc:2243] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.147781 18961 raft_consensus.cc:2272] T ea44e5f06ab7487b85663ead289a65d5 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.150342 18961 tablet_replica.cc:333] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.151221 18961 raft_consensus.cc:2243] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.151863 18961 raft_consensus.cc:2272] T 89fa7dc85da649e3a5c3195b959e3a61 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:08.152254 29256 consensus_peers.cc:597] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.155045 18961 tablet_replica.cc:333] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.156064 18961 raft_consensus.cc:2243] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.156563 18961 raft_consensus.cc:2272] T 7d5356a7d1c64926aeed795d25f96c0c P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.159354 18961 tablet_replica.cc:333] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.159971 18961 raft_consensus.cc:2243] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.160444 18961 raft_consensus.cc:2272] T 73311071016949569f4b68732a970667 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.162510 18961 tablet_replica.cc:333] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.163084 18961 raft_consensus.cc:2243] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.163978 18961 raft_consensus.cc:2272] T 4f1a67b1f91a4f07b9acc926b114d701 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.166242 18961 tablet_replica.cc:333] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.166831 18961 raft_consensus.cc:2243] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.167248 18961 raft_consensus.cc:2272] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 7e87f64602ef465cb6288f69964235a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.169289 18961 tablet_replica.cc:333] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.169901 18961 raft_consensus.cc:2243] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.170349 18961 raft_consensus.cc:2272] T afa3802b77714deab6889b0c74f08f50 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.172469 18961 tablet_replica.cc:333] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.173012 18961 raft_consensus.cc:2243] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.173470 18961 raft_consensus.cc:2272] T 137ad6a7bad4460bb03ca501e6588a2b P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.175549 18961 tablet_replica.cc:333] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.176147 18961 raft_consensus.cc:2243] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.176976 18961 raft_consensus.cc:2272] T 3848262912d046ed91ff2b8b5a5ca749 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.179026 18961 tablet_replica.cc:333] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.179553 18961 raft_consensus.cc:2243] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.180039 18961 raft_consensus.cc:2272] T 245a5b3a66c044189c7a2a2d10db4149 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.182106 18961 tablet_replica.cc:333] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.182651 18961 raft_consensus.cc:2243] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.183503 18961 raft_consensus.cc:2272] T 172799b8ec7c4d32905d6b02f0728846 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.185596 18961 tablet_replica.cc:333] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.186141 18961 raft_consensus.cc:2243] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.186944 18961 raft_consensus.cc:2272] T a11ff826b27146f8b266ae26e03dc775 P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.189023 18961 tablet_replica.cc:333] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.189018 30271 raft_consensus.cc:493] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:22:08.189841 18961 raft_consensus.cc:2243] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.189725 30271 raft_consensus.cc:515] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:08.190780 18961 raft_consensus.cc:2272] T a2294d7212b244ba80173c04a7ae214e P 7e87f64602ef465cb6288f69964235a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.191879 30271 leader_election.cc:290] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
I20260709 12:22:08.193542 18961 tablet_replica.cc:333] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9: stopping tablet replica
I20260709 12:22:08.194299 18961 raft_consensus.cc:2243] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.194854 18961 raft_consensus.cc:2272] T 8fecfd39d27743c9aec3e98b7f9162b2 P 7e87f64602ef465cb6288f69964235a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:08.196847 29255 leader_election.cc:336] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:22:08.197450 29256 leader_election.cc:336] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111)
I20260709 12:22:08.197815 29256 leader_election.cc:304] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:08.198396 30271 raft_consensus.cc:2749] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.272910 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
W20260709 12:22:08.277452 29256 consensus_peers.cc:597] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:41735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.293794 29256 consensus_peers.cc:597] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:41735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.310031 29256 consensus_peers.cc:597] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:41735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:08.319031 29256 consensus_peers.cc:597] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:41735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.370723 18961 tablet_server.cc:179] TabletServer@127.18.132.68:0 shutting down...
I20260709 12:22:08.401175 30272 raft_consensus.cc:493] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:22:08.401971 30272 raft_consensus.cc:515] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } } peers { permanent_uuid: "6cf7766f7e944f41837fd8aa8bde0018" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 42507 } }
I20260709 12:22:08.405520 30272 leader_election.cc:290] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483), 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507)
W20260709 12:22:08.409310 29255 leader_election.cc:336] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
W20260709 12:22:08.409911 29256 leader_election.cc:336] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6cf7766f7e944f41837fd8aa8bde0018 (127.18.132.66:42507): Network error: Client connection negotiation failed: client connection to 127.18.132.66:42507: connect: Connection refused (error 111)
I20260709 12:22:08.410351 29256 leader_election.cc:304] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 6cf7766f7e944f41837fd8aa8bde0018, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:08.411175 30272 raft_consensus.cc:2749] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.420656 30272 raft_consensus.cc:493] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 92a88e5c9f6f4c83b7765774ef4fe0f5)
I20260709 12:22:08.421159 30272 raft_consensus.cc:515] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87f64602ef465cb6288f69964235a9" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 41735 } } peers { permanent_uuid: "91fd10ed5c3e47fcb354c51acbe25286" member_type: VOTER last_known_addr { host: "127.18.132.68" port: 45807 } } peers { permanent_uuid: "92a88e5c9f6f4c83b7765774ef4fe0f5" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 42483 } }
I20260709 12:22:08.424073 30272 leader_election.cc:290] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735), 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483)
W20260709 12:22:08.427178 29256 leader_election.cc:336] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Network error: Client connection negotiation failed: client connection to 127.18.132.67:41735: connect: Connection refused (error 111)
W20260709 12:22:08.427865 29255 leader_election.cc:336] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 92a88e5c9f6f4c83b7765774ef4fe0f5 (127.18.132.65:42483): Network error: Client connection negotiation failed: client connection to 127.18.132.65:42483: connect: Connection refused (error 111)
I20260709 12:22:08.428114 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:08.428277 29255 leader_election.cc:304] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91fd10ed5c3e47fcb354c51acbe25286; no voters: 7e87f64602ef465cb6288f69964235a9, 92a88e5c9f6f4c83b7765774ef4fe0f5
I20260709 12:22:08.429203 18961 tablet_replica.cc:333] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.429194 30272 raft_consensus.cc:2749] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.430183 18961 raft_consensus.cc:2243] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.431150 18961 raft_consensus.cc:2272] T 7483cd4c0e99450089e2c3aef8f1524a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.433535 18961 tablet_replica.cc:333] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.434130 18961 raft_consensus.cc:2243] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.434587 18961 raft_consensus.cc:2272] T 07cf2c0767c14dac861751f1d5d524e8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.436663 18961 tablet_replica.cc:333] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.437220 18961 raft_consensus.cc:2243] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.437674 18961 raft_consensus.cc:2272] T 98cc247c119e4c099657c60c961aa37d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.440552 18961 tablet_replica.cc:333] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.441531 18961 raft_consensus.cc:2243] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.442553 18961 raft_consensus.cc:2272] T b774d33d7306413c852622175e13c2cc P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.444854 18961 tablet_replica.cc:333] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.445477 18961 raft_consensus.cc:2243] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.446108 18961 raft_consensus.cc:2272] T 9548af611b534185ae76fa0d4c896962 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.448660 18961 tablet_replica.cc:333] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.449535 18961 raft_consensus.cc:2243] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.450101 18961 raft_consensus.cc:2272] T c7496a0c6c1946acad1f4fb97b1ce80b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.452577 18961 tablet_replica.cc:333] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.453275 18961 raft_consensus.cc:2243] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.453990 18961 raft_consensus.cc:2272] T 58c070504fe245aba727845758bbca34 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.456324 18961 tablet_replica.cc:333] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.456954 18961 raft_consensus.cc:2243] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.457401 18961 raft_consensus.cc:2272] T 16f61f9c9b39417ca1f74cfa4a80f092 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.459510 18961 tablet_replica.cc:333] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.460217 18961 raft_consensus.cc:2243] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.461105 18961 raft_consensus.cc:2272] T 4719ec61ba174acdbffd0d8a8f691142 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.463128 18961 tablet_replica.cc:333] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.463810 18961 raft_consensus.cc:2243] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.464284 18961 raft_consensus.cc:2272] T b49a4fda120d4293aa6694ed3fb8336e P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.466241 18961 tablet_replica.cc:333] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.466874 18961 raft_consensus.cc:2243] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.467317 18961 raft_consensus.cc:2272] T 494a1a011a1c49d9845829b1a5858c4a P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.469377 18961 tablet_replica.cc:333] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.469952 18961 raft_consensus.cc:2243] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.470527 18961 raft_consensus.cc:2272] T d4c2675a26a2453487ff7fa3eb4a4441 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.473570 18961 tablet_replica.cc:333] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.474467 18961 raft_consensus.cc:2243] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.475059 18961 raft_consensus.cc:2272] T cd03869bf33149b993051af5c8f055eb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.477651 18961 tablet_replica.cc:333] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.478201 18961 raft_consensus.cc:2243] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.478605 18961 raft_consensus.cc:2272] T aed2c2eff70342fab5e80c4a76ab3593 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.480733 18961 tablet_replica.cc:333] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.481287 18961 raft_consensus.cc:2243] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.481688 18961 raft_consensus.cc:2272] T 1c79ddf0b439489197763183ae8553e4 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.483672 18961 tablet_replica.cc:333] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.484210 18961 raft_consensus.cc:2243] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.484579 18961 raft_consensus.cc:2272] T b67bcd4012bb45829241ae1389b6afa3 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.486506 18961 tablet_replica.cc:333] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.487047 18961 raft_consensus.cc:2243] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.487986 18961 raft_consensus.cc:2272] T 6469c0ade3804810b53702577319456c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.490110 18961 tablet_replica.cc:333] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.490671 18961 raft_consensus.cc:2243] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.491461 18961 raft_consensus.cc:2272] T 9491de7c08e54ace93f8edaaadfff61a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.493476 18961 tablet_replica.cc:333] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.494004 18961 raft_consensus.cc:2243] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.494815 18961 raft_consensus.cc:2272] T b1bf6f5ffed54f1fad60a22b102f923d P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.497058 18961 tablet_replica.cc:333] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.497629 18961 raft_consensus.cc:2243] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.498406 18961 raft_consensus.cc:2272] T 26215fc88fd545f290fbaaff9ae467f6 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.500633 18961 tablet_replica.cc:333] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.501238 18961 raft_consensus.cc:2243] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.501636 18961 raft_consensus.cc:2272] T da79a40a6b07437086aa49b0cc2ae9ea P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.504330 18961 tablet_replica.cc:333] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.505288 18961 raft_consensus.cc:2243] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.505879 18961 raft_consensus.cc:2272] T ad25e9fbcd614e4e9eecbb5dc392c165 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.508180 18961 tablet_replica.cc:333] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.508872 18961 raft_consensus.cc:2243] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.509454 18961 raft_consensus.cc:2272] T 1973cb4352f14b628c856d7f58cea0da P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.512552 18961 tablet_replica.cc:333] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.513444 18961 raft_consensus.cc:2243] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:08.513707 29256 consensus_peers.cc:597] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 -> Peer 7e87f64602ef465cb6288f69964235a9 (127.18.132.67:41735): Couldn't send request to peer 7e87f64602ef465cb6288f69964235a9. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.67:41735: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:08.514029 18961 raft_consensus.cc:2272] T 7dd34001bec34add96fbddfbb1a9b54a P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.516844 18961 tablet_replica.cc:333] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.517719 18961 raft_consensus.cc:2243] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.518513 18961 raft_consensus.cc:2272] T fa12ef41f343476a8228cd78fe0db9bb P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.520633 18961 tablet_replica.cc:333] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.521190 18961 raft_consensus.cc:2243] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.521559 18961 raft_consensus.cc:2272] T 341064dd172e4bfc87467b2395fcad6b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.523754 18961 tablet_replica.cc:333] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.524351 18961 raft_consensus.cc:2243] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.525246 18961 raft_consensus.cc:2272] T 4e0254afbe554de5bda48bee078dc4b8 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.527375 18961 tablet_replica.cc:333] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.527966 18961 raft_consensus.cc:2243] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.528364 18961 raft_consensus.cc:2272] T 118990c87a4d480baacf7c25b58229aa P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.530457 18961 tablet_replica.cc:333] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.531121 18961 raft_consensus.cc:2243] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.531502 18961 raft_consensus.cc:2272] T aecf4de06f0641c5bedbc8eb813a7f97 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.533593 18961 tablet_replica.cc:333] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.534144 18961 raft_consensus.cc:2243] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.534525 18961 raft_consensus.cc:2272] T 970d5a478a4e490a87a712db238e695c P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.536568 18961 tablet_replica.cc:333] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.537128 18961 raft_consensus.cc:2243] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.537943 18961 raft_consensus.cc:2272] T 5ecfc448993b45138c2cda5213e934c1 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.540135 18961 tablet_replica.cc:333] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.540649 18961 raft_consensus.cc:2243] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.541395 18961 raft_consensus.cc:2272] T faf05148546740429720380b7f235833 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.543361 18961 tablet_replica.cc:333] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.543888 18961 raft_consensus.cc:2243] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.544637 18961 raft_consensus.cc:2272] T 7d5356a7d1c64926aeed795d25f96c0c P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.546547 18961 tablet_replica.cc:333] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.547089 18961 raft_consensus.cc:2243] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.547489 18961 raft_consensus.cc:2272] T 4f1a67b1f91a4f07b9acc926b114d701 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.549429 18961 tablet_replica.cc:333] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.549937 18961 raft_consensus.cc:2243] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.550329 18961 raft_consensus.cc:2272] T 504440a1993945c68cb34cd95f8ff39f P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.552234 18961 tablet_replica.cc:333] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.552719 18961 raft_consensus.cc:2243] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.553196 18961 raft_consensus.cc:2272] T 8fecfd39d27743c9aec3e98b7f9162b2 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.555150 18961 tablet_replica.cc:333] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.555698 18961 raft_consensus.cc:2243] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.556162 18961 raft_consensus.cc:2272] T 2b638bc90c6b4ca4a599a9104e10af3b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.558147 18961 tablet_replica.cc:333] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.558655 18961 raft_consensus.cc:2243] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.559440 18961 raft_consensus.cc:2272] T a6f9df47273e4b88bb17fb9d1924c020 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.561560 18961 tablet_replica.cc:333] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.562135 18961 raft_consensus.cc:2243] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.562973 18961 raft_consensus.cc:2272] T afa3802b77714deab6889b0c74f08f50 P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.565285 18961 tablet_replica.cc:333] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.565828 18961 raft_consensus.cc:2243] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.566265 18961 raft_consensus.cc:2272] T 137ad6a7bad4460bb03ca501e6588a2b P 91fd10ed5c3e47fcb354c51acbe25286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.568385 18961 tablet_replica.cc:333] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.568929 18961 raft_consensus.cc:2243] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.569414 18961 raft_consensus.cc:2272] T 3848262912d046ed91ff2b8b5a5ca749 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.571547 18961 tablet_replica.cc:333] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.572129 18961 raft_consensus.cc:2243] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.572552 18961 raft_consensus.cc:2272] T 245a5b3a66c044189c7a2a2d10db4149 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.574632 18961 tablet_replica.cc:333] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.575130 18961 raft_consensus.cc:2243] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.575551 18961 raft_consensus.cc:2272] T 33b994c952494b52b3bd6e1946663c81 P 91fd10ed5c3e47fcb354c51acbe25286 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.577656 18961 tablet_replica.cc:333] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286: stopping tablet replica
I20260709 12:22:08.578137 18961 raft_consensus.cc:2243] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:08.578572 18961 raft_consensus.cc:2272] T 8e39ebaf09f44b5fafafbcc94e7b50a7 P 91fd10ed5c3e47fcb354c51acbe25286 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.657672 18961 tablet_server.cc:196] TabletServer@127.18.132.68:0 shutdown complete.
I20260709 12:22:08.735230 18961 master.cc:562] Master@127.18.132.126:45601 shutting down...
I20260709 12:22:08.765790 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:08.766513 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:08.766912 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P 758adb48947145ab9f8735db799762a2: stopping tablet replica
I20260709 12:22:08.790692 18961 master.cc:584] Master@127.18.132.126:45601 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34763 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:22:08.893968 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:41455
I20260709 12:22:08.895283 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:08.901722 30283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:08.901901 30282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:08.902568 30285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:08.903466 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:08.904742 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:08.904929 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:08.905045 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599728905035 us; error 0 us; skew 500 ppm
I20260709 12:22:08.905583 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:08.908313 18961 webserver.cc:533] Webserver started at http://127.18.132.126:41813/ using document root <none> and password file <none>
I20260709 12:22:08.908818 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:08.909013 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:08.909334 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:08.910612 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "3648e69b58a14d8c987fd89c2649fc9f"
format_stamp: "Formatted at 2026-07-09 12:22:08 on dist-test-slave-xbvc"
I20260709 12:22:08.915170 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:22:08.918665 30290 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:08.919415 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:08.919757 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "3648e69b58a14d8c987fd89c2649fc9f"
format_stamp: "Formatted at 2026-07-09 12:22:08 on dist-test-slave-xbvc"
I20260709 12:22:08.920068 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:08.951666 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:08.953137 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:08.998459 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:41455
I20260709 12:22:08.998562 30341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:41455 every 8 connection(s)
I20260709 12:22:09.002877 30342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.015658 30342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f: Bootstrap starting.
I20260709 12:22:09.021317 30342 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.026086 30342 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f: No bootstrap required, opened a new log
I20260709 12:22:09.028488 30342 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3648e69b58a14d8c987fd89c2649fc9f" member_type: VOTER }
I20260709 12:22:09.028898 30342 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.029081 30342 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3648e69b58a14d8c987fd89c2649fc9f, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.029727 30342 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3648e69b58a14d8c987fd89c2649fc9f" member_type: VOTER }
I20260709 12:22:09.030169 30342 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:09.030362 30342 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:09.030573 30342 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.037386 30342 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3648e69b58a14d8c987fd89c2649fc9f" member_type: VOTER }
I20260709 12:22:09.037869 30342 leader_election.cc:304] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3648e69b58a14d8c987fd89c2649fc9f; no voters: 
I20260709 12:22:09.039021 30342 leader_election.cc:290] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:09.039510 30345 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:09.041155 30345 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 1 LEADER]: Becoming Leader. State: Replica: 3648e69b58a14d8c987fd89c2649fc9f, State: Running, Role: LEADER
I20260709 12:22:09.041869 30345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3648e69b58a14d8c987fd89c2649fc9f" member_type: VOTER }
I20260709 12:22:09.042325 30342 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:09.048125 30347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3648e69b58a14d8c987fd89c2649fc9f. Latest consensus state: current_term: 1 leader_uuid: "3648e69b58a14d8c987fd89c2649fc9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3648e69b58a14d8c987fd89c2649fc9f" member_type: VOTER } }
I20260709 12:22:09.049522 30347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:09.048240 30346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3648e69b58a14d8c987fd89c2649fc9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3648e69b58a14d8c987fd89c2649fc9f" member_type: VOTER } }
I20260709 12:22:09.050601 30346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:09.051802 30353 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:09.060240 30353 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:09.061416 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:09.070220 30353 catalog_manager.cc:1383] Generated new cluster ID: 2732cfcf10d94a2dae0ca1778a093c56
I20260709 12:22:09.070514 30353 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:09.104301 30353 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:09.105825 30353 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:09.119315 30353 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f: Generated new TSK 0
I20260709 12:22:09.119998 30353 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:09.128113 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:09.134860 30363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:09.136258 30364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:09.137812 30366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:09.140998 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:09.142257 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:09.142495 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:09.142675 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599729142654 us; error 0 us; skew 500 ppm
I20260709 12:22:09.143246 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:09.145841 18961 webserver.cc:533] Webserver started at http://127.18.132.65:45689/ using document root <none> and password file <none>
I20260709 12:22:09.146399 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:09.146620 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:09.146910 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:09.148186 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "644aad4e0bf1400b898cb858699c985b"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:09.152895 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:09.156620 30371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.157418 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:09.157716 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "644aad4e0bf1400b898cb858699c985b"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:09.158034 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:09.185230 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:09.186686 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:09.188339 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:09.190781 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:09.191013 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.191267 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:09.191468 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.237807 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:38257
I20260709 12:22:09.237920 30434 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:38257 every 8 connection(s)
I20260709 12:22:09.243474 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:09.250543 30439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:09.252101 30440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:09.255059 30442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:09.255954 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:09.257612 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:09.257908 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:09.258136 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599729258094 us; error 0 us; skew 500 ppm
I20260709 12:22:09.258916 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:09.260528 30435 heartbeater.cc:344] Connected to a master server at 127.18.132.126:41455
I20260709 12:22:09.260895 30435 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:09.261777 30435 heartbeater.cc:507] Master 127.18.132.126:41455 requested a full tablet report, sending...
I20260709 12:22:09.261966 18961 webserver.cc:533] Webserver started at http://127.18.132.66:34685/ using document root <none> and password file <none>
I20260709 12:22:09.262617 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:09.262847 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:09.263135 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:09.264173 30307 ts_manager.cc:194] Registered new tserver with Master: 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257)
I20260709 12:22:09.264557 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:09.266184 30307 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44274
I20260709 12:22:09.269642 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:22:09.273291 30447 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.273988 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:09.274298 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:09.274592 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:09.289577 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:09.290936 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:09.292536 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:09.295001 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:09.295231 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.295480 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:09.295686 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:09.341254 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:35701
I20260709 12:22:09.341367 30509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:35701 every 8 connection(s)
I20260709 12:22:09.346568 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:09.356189 30514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:09.355355 30513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:09.360371 30516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:09.360479 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:09.360535 30510 heartbeater.cc:344] Connected to a master server at 127.18.132.126:41455
I20260709 12:22:09.361411 30510 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:09.361922 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:09.362223 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:09.362196 30510 heartbeater.cc:507] Master 127.18.132.126:41455 requested a full tablet report, sending...
I20260709 12:22:09.362676 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599729362656 us; error 0 us; skew 500 ppm
I20260709 12:22:09.363358 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:09.364765 30307 ts_manager.cc:194] Registered new tserver with Master: 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:09.366076 18961 webserver.cc:533] Webserver started at http://127.18.132.67:37053/ using document root <none> and password file <none>
I20260709 12:22:09.366499 30307 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44280
I20260709 12:22:09.366652 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:09.366995 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:09.367311 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:09.368608 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:09.373147 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:09.376462 30521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.377220 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:09.377527 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:09.377825 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:09.394774 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:09.396152 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:09.397729 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:09.400111 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:09.400348 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.400597 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:09.400775 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:09.446177 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:35313
I20260709 12:22:09.446291 30583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:35313 every 8 connection(s)
I20260709 12:22:09.460881 30584 heartbeater.cc:344] Connected to a master server at 127.18.132.126:41455
I20260709 12:22:09.461400 30584 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:09.462177 30584 heartbeater.cc:507] Master 127.18.132.126:41455 requested a full tablet report, sending...
I20260709 12:22:09.464195 30307 ts_manager.cc:194] Registered new tserver with Master: 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:09.465190 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015723816s
I20260709 12:22:09.465723 30307 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44296
I20260709 12:22:09.491467 30307 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44310:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:09.494776 30307 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:09.594533 30475 tablet_service.cc:1511] Processing CreateTablet for tablet de75a4cf11264e6b8f84530c68841c6e (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:09.596350 30475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75a4cf11264e6b8f84530c68841c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.596743 30473 tablet_service.cc:1511] Processing CreateTablet for tablet b868a30dff4d44e5a53a8502edd00610 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:09.598376 30473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b868a30dff4d44e5a53a8502edd00610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.600221 30469 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb4ec027d2e45dfb765ba52139c6b54 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:09.600752 30474 tablet_service.cc:1511] Processing CreateTablet for tablet 4c05517115e84eb5a3a83ff5de185004 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:09.601779 30469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4ec027d2e45dfb765ba52139c6b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.602479 30474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c05517115e84eb5a3a83ff5de185004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.603615 30468 tablet_service.cc:1511] Processing CreateTablet for tablet 40badf82971d49c28fabd4a9338fd466 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:09.604681 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 798b5a5c646b4a7095d425cab4827063 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:09.605160 30468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40badf82971d49c28fabd4a9338fd466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.606863 30471 tablet_service.cc:1511] Processing CreateTablet for tablet e645d41e747b48a1922a4d79f214c7c2 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:09.608357 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e645d41e747b48a1922a4d79f214c7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.611227 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 56bcf73411c04337bc79f66ee592c842 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:09.612854 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bcf73411c04337bc79f66ee592c842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.615087 30467 tablet_service.cc:1511] Processing CreateTablet for tablet 2df4c1cb04e740c19ef4570a66176246 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:09.615706 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 6c230c0c4a604ce5a010226733ec0f0b (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:09.616750 30467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df4c1cb04e740c19ef4570a66176246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.617795 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798b5a5c646b4a7095d425cab4827063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.620054 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c230c0c4a604ce5a010226733ec0f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.638439 30599 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:09.639495 30549 tablet_service.cc:1511] Processing CreateTablet for tablet de75a4cf11264e6b8f84530c68841c6e (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:09.641104 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75a4cf11264e6b8f84530c68841c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.645710 30599 tablet_bootstrap.cc:654] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.645349 30548 tablet_service.cc:1511] Processing CreateTablet for tablet 4c05517115e84eb5a3a83ff5de185004 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:09.646888 30548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c05517115e84eb5a3a83ff5de185004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.654115 30547 tablet_service.cc:1511] Processing CreateTablet for tablet b868a30dff4d44e5a53a8502edd00610 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:09.664136 30547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b868a30dff4d44e5a53a8502edd00610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.670992 30546 tablet_service.cc:1511] Processing CreateTablet for tablet 798b5a5c646b4a7095d425cab4827063 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:09.671348 30545 tablet_service.cc:1511] Processing CreateTablet for tablet e645d41e747b48a1922a4d79f214c7c2 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:09.672610 30546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798b5a5c646b4a7095d425cab4827063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.673314 30545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e645d41e747b48a1922a4d79f214c7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.674744 30544 tablet_service.cc:1511] Processing CreateTablet for tablet 56bcf73411c04337bc79f66ee592c842 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:09.676265 30544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bcf73411c04337bc79f66ee592c842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.680850 30543 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb4ec027d2e45dfb765ba52139c6b54 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:09.681358 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 6c230c0c4a604ce5a010226733ec0f0b (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:09.682389 30543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4ec027d2e45dfb765ba52139c6b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.685091 30542 tablet_service.cc:1511] Processing CreateTablet for tablet 40badf82971d49c28fabd4a9338fd466 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:09.686694 30542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40badf82971d49c28fabd4a9338fd466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.687465 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c230c0c4a604ce5a010226733ec0f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.689128 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 2df4c1cb04e740c19ef4570a66176246 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:09.690778 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df4c1cb04e740c19ef4570a66176246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.710230 30398 tablet_service.cc:1511] Processing CreateTablet for tablet b868a30dff4d44e5a53a8502edd00610 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:09.711802 30393 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb4ec027d2e45dfb765ba52139c6b54 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:09.713006 30396 tablet_service.cc:1511] Processing CreateTablet for tablet e645d41e747b48a1922a4d79f214c7c2 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:09.714406 30392 tablet_service.cc:1511] Processing CreateTablet for tablet 40badf82971d49c28fabd4a9338fd466 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:09.716763 30391 tablet_service.cc:1511] Processing CreateTablet for tablet 2df4c1cb04e740c19ef4570a66176246 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:09.718037 30399 tablet_service.cc:1511] Processing CreateTablet for tablet 4c05517115e84eb5a3a83ff5de185004 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:09.710234 30395 tablet_service.cc:1511] Processing CreateTablet for tablet 56bcf73411c04337bc79f66ee592c842 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:09.715386 30400 tablet_service.cc:1511] Processing CreateTablet for tablet de75a4cf11264e6b8f84530c68841c6e (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:09.716763 30397 tablet_service.cc:1511] Processing CreateTablet for tablet 798b5a5c646b4a7095d425cab4827063 (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:09.719269 30390 tablet_service.cc:1511] Processing CreateTablet for tablet 6c230c0c4a604ce5a010226733ec0f0b (DEFAULT_TABLE table=test-workload [id=b4ea3226f9d64d30af17cbdabbaa06e4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:09.722427 30398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b868a30dff4d44e5a53a8502edd00610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.725059 30393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4ec027d2e45dfb765ba52139c6b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.728335 30391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df4c1cb04e740c19ef4570a66176246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.732803 30392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40badf82971d49c28fabd4a9338fd466. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.736116 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798b5a5c646b4a7095d425cab4827063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.737098 30390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c230c0c4a604ce5a010226733ec0f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.740260 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c05517115e84eb5a3a83ff5de185004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.744191 30395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bcf73411c04337bc79f66ee592c842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.748335 30400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de75a4cf11264e6b8f84530c68841c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.752168 30396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e645d41e747b48a1922a4d79f214c7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:09.804132 30601 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:09.811834 30599 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:09.812717 30599 ts_tablet_manager.cc:1403] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.175s	user 0.022s	sys 0.016s
I20260709 12:22:09.826653 30601 tablet_bootstrap.cc:654] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.832463 30602 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:09.836925 30599 raft_consensus.cc:359] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.837762 30599 raft_consensus.cc:385] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.838104 30599 raft_consensus.cc:740] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.839087 30599 consensus_queue.cc:260] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.847375 30602 tablet_bootstrap.cc:654] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.852317 30599 ts_tablet_manager.cc:1434] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 12:22:09.853370 30510 heartbeater.cc:499] Master 127.18.132.126:41455 was elected leader, sending a full tablet report...
I20260709 12:22:09.854125 30599 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:09.854898 30602 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:09.855412 30602 ts_tablet_manager.cc:1403] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 12:22:09.858982 30602 raft_consensus.cc:359] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.859993 30602 raft_consensus.cc:385] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.860293 30602 raft_consensus.cc:740] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.861048 30602 consensus_queue.cc:260] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.862156 30601 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:09.862972 30601 ts_tablet_manager.cc:1403] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.000s
I20260709 12:22:09.863550 30435 heartbeater.cc:499] Master 127.18.132.126:41455 was elected leader, sending a full tablet report...
I20260709 12:22:09.864065 30602 ts_tablet_manager.cc:1434] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:22:09.865168 30602 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:09.866863 30601 raft_consensus.cc:359] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.867923 30601 raft_consensus.cc:385] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.868312 30601 raft_consensus.cc:740] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.869521 30601 consensus_queue.cc:260] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.872424 30602 tablet_bootstrap.cc:654] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.872475 30599 tablet_bootstrap.cc:654] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.891252 30607 raft_consensus.cc:493] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.892570 30607 raft_consensus.cc:515] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.891366 30584 heartbeater.cc:499] Master 127.18.132.126:41455 was elected leader, sending a full tablet report...
I20260709 12:22:09.891973 30601 ts_tablet_manager.cc:1434] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.017s
I20260709 12:22:09.896772 30601 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:09.899937 30607 leader_election.cc:290] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:09.905850 30601 tablet_bootstrap.cc:654] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.907755 30602 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:09.908453 30602 ts_tablet_manager.cc:1403] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.015s
I20260709 12:22:09.912951 30602 raft_consensus.cc:359] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.914095 30602 raft_consensus.cc:385] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.914551 30602 raft_consensus.cc:740] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.916759 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
W20260709 12:22:09.918849 30524 leader_election.cc:343] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.916774 30602 consensus_queue.cc:260] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.931926 30602 ts_tablet_manager.cc:1434] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 12:22:09.932359 30599 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:09.933025 30599 ts_tablet_manager.cc:1403] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.013s
I20260709 12:22:09.936329 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:09.936529 30599 raft_consensus.cc:359] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.938609 30599 raft_consensus.cc:385] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:09.938977 30522 leader_election.cc:343] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.939029 30599 raft_consensus.cc:740] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.939918 30522 leader_election.cc:304] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c; no voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:09.940845 30601 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:09.941151 30610 raft_consensus.cc:2749] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.941488 30601 ts_tablet_manager.cc:1403] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.015s
I20260709 12:22:09.940636 30599 consensus_queue.cc:260] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.942979 30602 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:09.945190 30601 raft_consensus.cc:359] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.946026 30601 raft_consensus.cc:385] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.946360 30601 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.947253 30601 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.949118 30599 ts_tablet_manager.cc:1434] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:22:09.949685 30601 ts_tablet_manager.cc:1434] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:22:09.950595 30599 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:09.950788 30601 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
W20260709 12:22:09.951442 30585 tablet.cc:2406] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:09.952739 30602 tablet_bootstrap.cc:654] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.959218 30599 tablet_bootstrap.cc:654] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.960579 30601 tablet_bootstrap.cc:654] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.968338 30602 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:09.969255 30602 ts_tablet_manager.cc:1403] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.013s
I20260709 12:22:09.973065 30599 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:09.973831 30599 ts_tablet_manager.cc:1403] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 12:22:09.973639 30602 raft_consensus.cc:359] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.974881 30602 raft_consensus.cc:385] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.975346 30602 raft_consensus.cc:740] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.976269 30602 consensus_queue.cc:260] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.977422 30599 raft_consensus.cc:359] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.977967 30601 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:09.978355 30599 raft_consensus.cc:385] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.978677 30601 ts_tablet_manager.cc:1403] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.016s
I20260709 12:22:09.978816 30599 raft_consensus.cc:740] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.979398 30602 ts_tablet_manager.cc:1434] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:09.980654 30602 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:09.980355 30599 consensus_queue.cc:260] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.982373 30601 raft_consensus.cc:359] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.983739 30601 raft_consensus.cc:385] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.984115 30601 raft_consensus.cc:740] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.985103 30601 consensus_queue.cc:260] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:09.989460 30601 ts_tablet_manager.cc:1434] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:22:09.990615 30601 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:09.991717 30602 tablet_bootstrap.cc:654] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.991839 30599 ts_tablet_manager.cc:1434] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 12:22:09.997675 30599 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:09.999495 30601 tablet_bootstrap.cc:654] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.006491 30599 tablet_bootstrap.cc:654] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.008821 30601 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.009374 30602 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.009384 30601 ts_tablet_manager.cc:1403] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.012s
I20260709 12:22:10.009589 30603 raft_consensus.cc:493] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.010339 30602 ts_tablet_manager.cc:1403] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.008s
I20260709 12:22:10.010468 30603 raft_consensus.cc:515] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.013201 30601 raft_consensus.cc:359] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.013489 30602 raft_consensus.cc:359] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.014000 30601 raft_consensus.cc:385] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.014180 30602 raft_consensus.cc:385] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.014348 30601 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.014520 30602 raft_consensus.cc:740] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.015357 30601 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.015357 30602 consensus_queue.cc:260] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.017800 30603 leader_election.cc:290] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.019119 30599 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.019965 30599 ts_tablet_manager.cc:1403] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 12:22:10.022673 30601 ts_tablet_manager.cc:1434] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:22:10.023854 30601 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:10.024448 30599 raft_consensus.cc:359] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.025547 30599 raft_consensus.cc:385] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.025938 30599 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.026861 30599 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.027714 30602 ts_tablet_manager.cc:1434] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:22:10.031678 30599 ts_tablet_manager.cc:1434] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:22:10.032933 30599 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:10.036748 30602 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:10.039645 30601 tablet_bootstrap.cc:654] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.040114 30599 tablet_bootstrap.cc:654] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.046715 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.047139 30602 tablet_bootstrap.cc:654] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:10.049233 30448 leader_election.cc:343] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.050778 30610 raft_consensus.cc:493] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.051481 30610 raft_consensus.cc:515] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
W20260709 12:22:10.054407 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:10.055342 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.057384 30599 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.058048 30599 ts_tablet_manager.cc:1403] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.006s
W20260709 12:22:10.058141 30524 leader_election.cc:343] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.059229 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.060120 30602 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.060732 30602 ts_tablet_manager.cc:1403] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
W20260709 12:22:10.061054 30522 leader_election.cc:343] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.061551 30522 leader_election.cc:304] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c; no voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:10.061800 30599 raft_consensus.cc:359] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.062500 30607 raft_consensus.cc:2749] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.062567 30599 raft_consensus.cc:385] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.063088 30599 raft_consensus.cc:740] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.064131 30602 raft_consensus.cc:359] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.064007 30599 consensus_queue.cc:260] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.064777 30602 raft_consensus.cc:385] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.064851 30610 leader_election.cc:290] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:10.066586 30599 ts_tablet_manager.cc:1434] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:10.067535 30602 raft_consensus.cc:740] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.068719 30599 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:10.068661 30602 consensus_queue.cc:260] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.069557 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.070374 30559 raft_consensus.cc:2468] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 0.
I20260709 12:22:10.073230 30602 ts_tablet_manager.cc:1434] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:22:10.073578 30448 leader_election.cc:304] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:10.074537 30602 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:10.075243 30603 raft_consensus.cc:2804] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.078164 30603 raft_consensus.cc:493] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.078560 30603 raft_consensus.cc:3060] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.082316 30602 tablet_bootstrap.cc:654] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.076905 30599 tablet_bootstrap.cc:654] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.089886 30601 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.090586 30601 ts_tablet_manager.cc:1403] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.005s
I20260709 12:22:10.091511 30602 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.086966 30603 raft_consensus.cc:515] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.092613 30602 ts_tablet_manager.cc:1403] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:22:10.092940 30599 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.093546 30599 ts_tablet_manager.cc:1403] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.004s
I20260709 12:22:10.093878 30601 raft_consensus.cc:359] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.094760 30601 raft_consensus.cc:385] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.095018 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:10.095651 30603 leader_election.cc:290] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.096357 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.096673 30603 raft_consensus.cc:493] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:10.096769 30448 leader_election.cc:343] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.096946 30559 raft_consensus.cc:3060] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.097215 30603 raft_consensus.cc:515] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.098871 30602 raft_consensus.cc:359] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.099653 30602 raft_consensus.cc:385] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.099516 30599 raft_consensus.cc:359] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.100045 30602 raft_consensus.cc:740] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.100208 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.100426 30599 raft_consensus.cc:385] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.100920 30599 raft_consensus.cc:740] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.101140 30602 consensus_queue.cc:260] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
W20260709 12:22:10.101794 30448 leader_election.cc:343] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.101927 30599 consensus_queue.cc:260] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.103485 30603 leader_election.cc:290] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.104511 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.105244 30558 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 0.
I20260709 12:22:10.095108 30601 raft_consensus.cc:740] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.106570 30602 ts_tablet_manager.cc:1434] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:22:10.109211 30599 ts_tablet_manager.cc:1434] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.008s
I20260709 12:22:10.110291 30602 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:10.110409 30599 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:10.106810 30448 leader_election.cc:304] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:10.109969 30601 consensus_queue.cc:260] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.117103 30601 ts_tablet_manager.cc:1434] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.006s
I20260709 12:22:10.117872 30599 tablet_bootstrap.cc:654] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.117865 30602 tablet_bootstrap.cc:654] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.118654 30601 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:10.115342 30603 raft_consensus.cc:2804] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.122205 30603 raft_consensus.cc:493] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.122819 30603 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.108944 30559 raft_consensus.cc:2468] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:10.123286 30606 raft_consensus.cc:493] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.124042 30606 raft_consensus.cc:515] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.131424 30448 leader_election.cc:304] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:10.132962 30626 raft_consensus.cc:2804] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.146780 30601 tablet_bootstrap.cc:654] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.148437 30626 raft_consensus.cc:697] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:10.156569 30626 consensus_queue.cc:237] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.157827 30602 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.158551 30602 ts_tablet_manager.cc:1403] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.048s	user 0.030s	sys 0.017s
I20260709 12:22:10.149519 30606 leader_election.cc:290] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.151970 30630 raft_consensus.cc:493] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.160925 30599 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.161554 30599 ts_tablet_manager.cc:1403] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.016s
I20260709 12:22:10.161321 30630 raft_consensus.cc:515] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.142802 30603 raft_consensus.cc:515] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.164006 30630 leader_election.cc:290] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.164757 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.165155 30599 raft_consensus.cc:359] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.166210 30599 raft_consensus.cc:385] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.166507 30599 raft_consensus.cc:740] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.167766 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.168660 30559 raft_consensus.cc:2468] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 0.
I20260709 12:22:10.168740 30599 consensus_queue.cc:260] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
W20260709 12:22:10.170744 30448 leader_election.cc:343] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.171348 30599 ts_tablet_manager.cc:1434] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:10.171716 30448 leader_election.cc:304] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:10.172606 30599 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:10.173164 30630 raft_consensus.cc:2804] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.173599 30630 raft_consensus.cc:493] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.173969 30630 raft_consensus.cc:3060] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.176921 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.177886 30485 raft_consensus.cc:2468] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 0.
I20260709 12:22:10.180079 30374 leader_election.cc:304] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.182173 30606 raft_consensus.cc:2804] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.182459 30601 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.182690 30606 raft_consensus.cc:493] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.183154 30601 ts_tablet_manager.cc:1403] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.005s
I20260709 12:22:10.183279 30606 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.185027 30599 tablet_bootstrap.cc:654] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.186849 30601 raft_consensus.cc:359] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.186789 30305 catalog_manager.cc:5697] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.187805 30601 raft_consensus.cc:385] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.188884 30601 raft_consensus.cc:740] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.189581 30602 raft_consensus.cc:359] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.189872 30601 consensus_queue.cc:260] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.202636 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.203313 30559 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.205751 30601 ts_tablet_manager.cc:1434] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 12:22:10.208782 30601 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:10.215902 30602 raft_consensus.cc:385] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.196548 30603 leader_election.cc:290] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.217168 30602 raft_consensus.cc:740] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.219969 30602 consensus_queue.cc:260] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.231093 30637 raft_consensus.cc:493] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.232585 30640 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.238622 30640 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.238622 30637 raft_consensus.cc:515] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.236507 30638 raft_consensus.cc:493] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.243191 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b"
W20260709 12:22:10.245167 30448 leader_election.cc:343] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.215269 30559 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:10.236970 30606 raft_consensus.cc:515] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.241389 30640 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.234705 30602 ts_tablet_manager.cc:1434] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 12:22:10.242491 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.248554 30485 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 0.
I20260709 12:22:10.249301 30602 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:10.247334 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.250145 30606 leader_election.cc:290] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Requested vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.250208 30484 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 0.
I20260709 12:22:10.243754 30638 raft_consensus.cc:515] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.248564 30448 leader_election.cc:304] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:10.252737 30638 leader_election.cc:290] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.253275 30603 raft_consensus.cc:2804] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.253679 30630 raft_consensus.cc:515] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.254307 30603 raft_consensus.cc:697] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:10.257439 30557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.258081 30602 tablet_bootstrap.cc:654] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.259069 30556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.260510 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
W20260709 12:22:10.261757 30372 leader_election.cc:343] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:10.262971 30372 leader_election.cc:343] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.264148 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:10.264962 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.265141 30484 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.269959 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:10.270820 30410 raft_consensus.cc:3060] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.270789 30638 raft_consensus.cc:493] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.273351 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.275050 30559 raft_consensus.cc:3060] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.275007 30638 raft_consensus.cc:515] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.279022 30638 leader_election.cc:290] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.274034 30630 leader_election.cc:290] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
W20260709 12:22:10.280176 30372 leader_election.cc:343] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:10.290656 30372 leader_election.cc:343] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.283246 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.295128 30485 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 0.
I20260709 12:22:10.298525 30601 tablet_bootstrap.cc:654] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.299424 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
W20260709 12:22:10.301424 30372 leader_election.cc:343] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.287873 30559 raft_consensus.cc:2468] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:10.255524 30603 consensus_queue.cc:237] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.291452 30602 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.293815 30374 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:10.303606 30638 raft_consensus.cc:2804] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.303709 30637 leader_election.cc:290] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.304060 30638 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.304509 30638 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.304261 30374 leader_election.cc:304] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.305647 30374 leader_election.cc:304] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:10.306456 30637 raft_consensus.cc:2804] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.306656 30639 raft_consensus.cc:2804] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.306945 30637 raft_consensus.cc:493] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.307166 30639 raft_consensus.cc:493] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.307577 30639 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.308956 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.309528 30484 raft_consensus.cc:2468] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 1.
I20260709 12:22:10.302594 30599 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.310565 30599 ts_tablet_manager.cc:1403] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.138s	user 0.042s	sys 0.051s
W20260709 12:22:10.311287 30374 leader_election.cc:343] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.307374 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.302649 30602 ts_tablet_manager.cc:1403] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.010s
I20260709 12:22:10.312219 30558 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 0.
I20260709 12:22:10.307384 30637 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.309584 30410 raft_consensus.cc:2468] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:10.316118 30448 leader_election.cc:304] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.314456 30599 raft_consensus.cc:359] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.317200 30599 raft_consensus.cc:385] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.317337 30630 raft_consensus.cc:2804] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.314509 30374 leader_election.cc:304] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:10.317925 30630 raft_consensus.cc:697] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:10.318274 30606 raft_consensus.cc:2749] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.318966 30630 consensus_queue.cc:237] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.319962 30374 leader_election.cc:304] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:10.321056 30606 raft_consensus.cc:2804] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.321581 30606 raft_consensus.cc:697] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Becoming Leader. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Running, Role: LEADER
I20260709 12:22:10.322517 30606 consensus_queue.cc:237] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.324163 30602 raft_consensus.cc:359] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.325174 30602 raft_consensus.cc:385] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.325506 30602 raft_consensus.cc:740] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.317622 30599 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.326471 30602 consensus_queue.cc:260] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.329802 30599 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.335613 30602 ts_tablet_manager.cc:1434] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:22:10.337241 30602 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:10.337998 30610 raft_consensus.cc:493] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.340250 30610 raft_consensus.cc:515] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.342761 30610 leader_election.cc:290] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:10.345306 30599 ts_tablet_manager.cc:1434] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 12:22:10.345005 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.345939 30410 raft_consensus.cc:2468] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 0.
I20260709 12:22:10.346266 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.347612 30599 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:10.348567 30639 raft_consensus.cc:515] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.353852 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:10.348618 30522 leader_election.cc:304] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:10.359807 30610 raft_consensus.cc:2804] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.360196 30610 raft_consensus.cc:493] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.360514 30610 raft_consensus.cc:3060] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.361511 30601 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.362130 30601 ts_tablet_manager.cc:1403] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.154s	user 0.004s	sys 0.012s
I20260709 12:22:10.363255 30637 raft_consensus.cc:515] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.364984 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.358300 30484 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.365559 30601 raft_consensus.cc:359] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.366436 30601 raft_consensus.cc:385] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.366472 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:10.366860 30601 raft_consensus.cc:740] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.373955 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.384069 30558 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.384379 30601 consensus_queue.cc:260] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.385601 30559 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.386214 30599 tablet_bootstrap.cc:654] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.388413 30601 ts_tablet_manager.cc:1434] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.013s
I20260709 12:22:10.389776 30601 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:10.392112 30558 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 1.
I20260709 12:22:10.393662 30559 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 1.
I20260709 12:22:10.370091 30602 tablet_bootstrap.cc:654] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.375118 30637 leader_election.cc:290] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Requested vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.375460 30484 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 1.
I20260709 12:22:10.396559 30374 leader_election.cc:304] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.397981 30606 raft_consensus.cc:2804] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.398689 30606 raft_consensus.cc:697] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Becoming Leader. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Running, Role: LEADER
I20260709 12:22:10.399082 30601 tablet_bootstrap.cc:654] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.399997 30606 consensus_queue.cc:237] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.355304 30638 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.357681 30639 leader_election.cc:290] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Requested vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.382774 30610 raft_consensus.cc:515] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.368388 30303 catalog_manager.cc:5697] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b reported cstate change: term changed from 0 to 1, leader changed from <none> to 644aad4e0bf1400b898cb858699c985b (127.18.132.65). New cstate: current_term: 1 leader_uuid: "644aad4e0bf1400b898cb858699c985b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.404105 30638 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Requested vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
W20260709 12:22:10.371526 30524 leader_election.cc:343] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.406162 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
W20260709 12:22:10.406414 30524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:35701, user_credentials={real_user=slave}} blocked reactor thread for 50193.7us
I20260709 12:22:10.406960 30484 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.393613 30372 leader_election.cc:304] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:10.367190 30485 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.409744 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
W20260709 12:22:10.411830 30372 leader_election.cc:343] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.415884 30638 raft_consensus.cc:2804] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.416651 30484 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 1.
I20260709 12:22:10.417012 30638 raft_consensus.cc:697] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Becoming Leader. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Running, Role: LEADER
I20260709 12:22:10.418205 30374 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:10.418404 30638 consensus_queue.cc:237] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.419631 30639 raft_consensus.cc:2804] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.424552 30485 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644aad4e0bf1400b898cb858699c985b in term 1.
I20260709 12:22:10.439558 30599 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.440806 30599 ts_tablet_manager.cc:1403] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.002s
I20260709 12:22:10.441036 30602 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.441628 30602 ts_tablet_manager.cc:1403] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.007s
I20260709 12:22:10.444078 30599 raft_consensus.cc:359] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.444972 30599 raft_consensus.cc:385] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.444589 30602 raft_consensus.cc:359] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.445312 30599 raft_consensus.cc:740] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.445516 30602 raft_consensus.cc:385] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.445993 30602 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.446908 30602 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.447830 30601 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.448668 30601 ts_tablet_manager.cc:1403] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.032s
I20260709 12:22:10.449491 30602 ts_tablet_manager.cc:1434] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:10.450583 30602 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:10.452812 30601 raft_consensus.cc:359] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.453915 30601 raft_consensus.cc:385] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.454350 30601 raft_consensus.cc:740] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.454416 30303 catalog_manager.cc:5697] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.457213 30602 tablet_bootstrap.cc:654] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.456636 30303 catalog_manager.cc:5697] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.455725 30601 consensus_queue.cc:260] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.461617 30639 raft_consensus.cc:697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Becoming Leader. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Running, Role: LEADER
I20260709 12:22:10.462833 30639 consensus_queue.cc:237] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.466625 30599 consensus_queue.cc:260] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.471845 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:10.471896 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:10.472944 30410 raft_consensus.cc:3060] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:10.473508 30524 leader_election.cc:343] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.474156 30610 leader_election.cc:290] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:10.476563 30599 ts_tablet_manager.cc:1434] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 12:22:10.477814 30599 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Bootstrap starting.
I20260709 12:22:10.485556 30410 raft_consensus.cc:2468] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 1.
I20260709 12:22:10.486529 30602 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: No bootstrap required, opened a new log
I20260709 12:22:10.486750 30601 ts_tablet_manager.cc:1434] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:22:10.487557 30602 ts_tablet_manager.cc:1403] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.003s
I20260709 12:22:10.488579 30303 catalog_manager.cc:5697] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b reported cstate change: term changed from 0 to 1, leader changed from <none> to 644aad4e0bf1400b898cb858699c985b (127.18.132.65). New cstate: current_term: 1 leader_uuid: "644aad4e0bf1400b898cb858699c985b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.490872 30602 raft_consensus.cc:359] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.490639 30303 catalog_manager.cc:5697] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b reported cstate change: term changed from 0 to 1, leader changed from <none> to 644aad4e0bf1400b898cb858699c985b (127.18.132.65). New cstate: current_term: 1 leader_uuid: "644aad4e0bf1400b898cb858699c985b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.491640 30602 raft_consensus.cc:385] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.492009 30602 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.492913 30602 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.494489 30601 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:10.499667 30599 tablet_bootstrap.cc:654] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.501080 30601 tablet_bootstrap.cc:654] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.503139 30522 leader_election.cc:304] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:10.504791 30610 raft_consensus.cc:2804] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.505481 30610 raft_consensus.cc:697] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:10.506686 30610 consensus_queue.cc:237] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.511191 30599 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05: No bootstrap required, opened a new log
I20260709 12:22:10.511894 30599 ts_tablet_manager.cc:1403] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.003s
I20260709 12:22:10.503304 30602 ts_tablet_manager.cc:1434] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:10.515095 30599 raft_consensus.cc:359] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.515924 30599 raft_consensus.cc:385] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.516252 30599 raft_consensus.cc:740] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.517336 30607 raft_consensus.cc:493] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.517493 30599 consensus_queue.cc:260] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.518388 30607 raft_consensus.cc:515] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.522378 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.523109 30485 raft_consensus.cc:2468] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 0.
I20260709 12:22:10.524503 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.525305 30410 raft_consensus.cc:2468] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 0.
I20260709 12:22:10.525606 30303 catalog_manager.cc:5697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b reported cstate change: term changed from 0 to 1, leader changed from <none> to 644aad4e0bf1400b898cb858699c985b (127.18.132.65). New cstate: current_term: 1 leader_uuid: "644aad4e0bf1400b898cb858699c985b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.526711 30524 leader_election.cc:304] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.527773 30607 leader_election.cc:290] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:10.528414 30607 raft_consensus.cc:2804] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.528527 30601 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.528896 30607 raft_consensus.cc:493] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.528043 30305 catalog_manager.cc:5697] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 1 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.529332 30601 ts_tablet_manager.cc:1403] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.000s
I20260709 12:22:10.529415 30607 raft_consensus.cc:3060] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.525357 30599 ts_tablet_manager.cc:1434] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:10.533267 30601 raft_consensus.cc:359] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.533993 30601 raft_consensus.cc:385] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.534271 30601 raft_consensus.cc:740] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.535427 30601 consensus_queue.cc:260] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.537919 30601 ts_tablet_manager.cc:1434] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:10.538965 30601 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Bootstrap starting.
I20260709 12:22:10.538561 30607 raft_consensus.cc:515] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.541754 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:10.542384 30410 raft_consensus.cc:3060] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.546103 30601 tablet_bootstrap.cc:654] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.555033 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:10.555796 30485 raft_consensus.cc:3060] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.556201 30607 leader_election.cc:290] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:10.555320 30601 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c: No bootstrap required, opened a new log
I20260709 12:22:10.556469 30410 raft_consensus.cc:2468] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 1.
I20260709 12:22:10.557133 30601 ts_tablet_manager.cc:1403] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:22:10.558005 30522 leader_election.cc:304] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:10.559244 30607 raft_consensus.cc:2804] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.560146 30607 raft_consensus.cc:697] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:10.560253 30601 raft_consensus.cc:359] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.561121 30601 raft_consensus.cc:385] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.561437 30601 raft_consensus.cc:740] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.561221 30607 consensus_queue.cc:237] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.562274 30601 consensus_queue.cc:260] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.564325 30601 ts_tablet_manager.cc:1434] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:22:10.564121 30485 raft_consensus.cc:2468] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 1.
I20260709 12:22:10.570991 30305 catalog_manager.cc:5697] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 1 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.593791 30603 raft_consensus.cc:493] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.594403 30603 raft_consensus.cc:515] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.596320 30603 leader_election.cc:290] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.597302 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b" is_pre_election: true
I20260709 12:22:10.597522 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.598039 30410 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 0.
I20260709 12:22:10.598217 30559 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 0.
I20260709 12:22:10.599092 30448 leader_election.cc:304] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.599813 30603 raft_consensus.cc:2804] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.600139 30603 raft_consensus.cc:493] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.600435 30603 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.606282 30603 raft_consensus.cc:515] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.608062 30603 leader_election.cc:290] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.609043 30410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:10.609647 30410 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.609860 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:10.610415 30559 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.615722 30559 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:10.615947 30410 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:10.616783 30448 leader_election.cc:304] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:10.617655 30603 raft_consensus.cc:2804] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.618180 30603 raft_consensus.cc:697] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:10.619072 30603 consensus_queue.cc:237] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.627338 30305 catalog_manager.cc:5697] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.657155 30639 raft_consensus.cc:493] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.657824 30639 raft_consensus.cc:515] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.659976 30639 leader_election.cc:290] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.660802 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.661036 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "644aad4e0bf1400b898cb858699c985b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:10.661775 30559 raft_consensus.cc:2393] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 644aad4e0bf1400b898cb858699c985b in current term 1: Already voted for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in this term.
I20260709 12:22:10.662755 30372 leader_election.cc:304] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:10.663437 30639 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.669505 30410 raft_consensus.cc:3060] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.669945 30639 raft_consensus.cc:2749] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.676939 30603 consensus_queue.cc:1048] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.690562 30630 consensus_queue.cc:1048] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.722111 30559 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.729643 30639 consensus_queue.cc:1048] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.742722 30606 consensus_queue.cc:1048] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.744853 30603 consensus_queue.cc:1048] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:10.761760 30603 consensus_queue.cc:1048] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:10.772799 18961 ts_manager.cc:295] Set tserver state for 644aad4e0bf1400b898cb858699c985b to MAINTENANCE_MODE
I20260709 12:22:10.773640 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
W20260709 12:22:10.788194 30448 consensus_peers.cc:597] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:10.800644 30603 raft_consensus.cc:493] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.802318 30603 raft_consensus.cc:515] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.804258 30603 leader_election.cc:290] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:10.805953 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
W20260709 12:22:10.809295 30448 leader_election.cc:336] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:10.809885 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:10.809849 30448 leader_election.cc:304] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:10.810737 30603 raft_consensus.cc:2749] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.811894 18961 tablet_replica.cc:333] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.811618 30630 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:10.812925 18961 raft_consensus.cc:2243] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:10.813545 18961 raft_consensus.cc:2272] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.817031 18961 tablet_replica.cc:333] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.818064 18961 raft_consensus.cc:2243] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:10.818614 18961 raft_consensus.cc:2272] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.822702 18961 tablet_replica.cc:333] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.823658 18961 raft_consensus.cc:2243] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:10.824378 18961 pending_rounds.cc:70] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Trying to abort 1 pending ops.
I20260709 12:22:10.824666 18961 pending_rounds.cc:77] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624496000442368 op_type: NO_OP noop_request { }
I20260709 12:22:10.825057 18961 raft_consensus.cc:2889] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:10.825352 18961 raft_consensus.cc:2272] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.828198 18961 tablet_replica.cc:333] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.829053 18961 raft_consensus.cc:2243] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:10.830296 18961 raft_consensus.cc:2272] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.833137 18961 tablet_replica.cc:333] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.833683 18961 raft_consensus.cc:2243] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:10.834019 18961 raft_consensus.cc:2272] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.836102 18961 tablet_replica.cc:333] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.836634 18961 raft_consensus.cc:2243] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:10.836972 18961 raft_consensus.cc:2272] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.838686 18961 tablet_replica.cc:333] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.839171 18961 raft_consensus.cc:2243] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:10.839812 18961 pending_rounds.cc:70] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Trying to abort 1 pending ops.
I20260709 12:22:10.839999 18961 pending_rounds.cc:77] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624495883538432 op_type: NO_OP noop_request { }
I20260709 12:22:10.840236 18961 raft_consensus.cc:2889] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:10.840467 18961 raft_consensus.cc:2272] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.842782 18961 tablet_replica.cc:333] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.843281 18961 raft_consensus.cc:2243] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:10.843794 18961 raft_consensus.cc:2272] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.846302 18961 tablet_replica.cc:333] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.846809 18961 raft_consensus.cc:2243] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:10.847173 18961 raft_consensus.cc:2272] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.849117 18961 tablet_replica.cc:333] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: stopping tablet replica
I20260709 12:22:10.849583 18961 raft_consensus.cc:2243] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:10.850240 18961 pending_rounds.cc:70] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Trying to abort 1 pending ops.
I20260709 12:22:10.850445 18961 pending_rounds.cc:77] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624495804223488 op_type: NO_OP noop_request { }
I20260709 12:22:10.850708 18961 raft_consensus.cc:2889] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:10.851025 18961 raft_consensus.cc:2272] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:10.871166 30607 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.871941 30607 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:10.874172 30607 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:10.875460 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:10.876339 30485 raft_consensus.cc:2393] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in current term 1: Already voted for candidate 644aad4e0bf1400b898cb858699c985b in this term.
W20260709 12:22:10.879123 30522 leader_election.cc:336] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:10.879595 30522 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c; no voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:10.880283 30607 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.884357 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
I20260709 12:22:10.886734 30607 raft_consensus.cc:2749] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.944644 30485 raft_consensus.cc:3060] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.952437 30607 consensus_queue.cc:1048] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:10.968672 30522 consensus_peers.cc:597] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:10.999591 30603 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:11.016088 30448 consensus_peers.cc:597] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:11.034559 30522 consensus_peers.cc:597] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:11.055500 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:11.136332 30448 consensus_peers.cc:597] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:11.148631 30607 consensus_queue.cc:1048] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:11.244901 30448 consensus_peers.cc:597] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:12.007169 30522 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111) [suppressed 149 similar messages]
I20260709 12:22:12.024857 30626 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.025815 30626 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.028208 30626 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.030187 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:12.031113 30558 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
W20260709 12:22:12.032605 30448 leader_election.cc:336] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.033447 30448 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:12.034269 30626 raft_consensus.cc:2804] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:12.034528 30626 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.034752 30626 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.044868 30626 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.046437 30626 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.047127 30626 raft_consensus.cc:493] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.047755 30626 raft_consensus.cc:515] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.048383 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:12.049077 30558 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.049964 30626 leader_election.cc:290] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.051232 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
W20260709 12:22:12.051340 30448 leader_election.cc:336] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.052253 30559 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:12.053536 30448 leader_election.cc:304] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:12.054229 30626 raft_consensus.cc:2804] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:12.054289 30448 leader_election.cc:336] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.054693 30626 raft_consensus.cc:493] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.055069 30626 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.057287 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:12.058389 30558 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:12.059741 30448 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:12.060714 30630 raft_consensus.cc:2804] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.061363 30630 raft_consensus.cc:697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:12.062600 30630 consensus_queue.cc:237] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.063745 30626 raft_consensus.cc:515] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.065912 30626 leader_election.cc:290] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.068921 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:12.069758 30558 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.071175 30448 leader_election.cc:336] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.073148 30304 catalog_manager.cc:5697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 1 to 2, leader changed from 644aad4e0bf1400b898cb858699c985b (127.18.132.65) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.076887 30558 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:12.078140 30448 leader_election.cc:304] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:12.079089 30630 raft_consensus.cc:2804] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.079550 30630 raft_consensus.cc:697] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:12.080608 30630 consensus_queue.cc:237] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.096395 30304 catalog_manager.cc:5697] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 1 to 2, leader changed from 644aad4e0bf1400b898cb858699c985b (127.18.132.65) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.240267 30607 raft_consensus.cc:493] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 644aad4e0bf1400b898cb858699c985b)
I20260709 12:22:12.240976 30607 raft_consensus.cc:515] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.243093 30607 leader_election.cc:290] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:12.244655 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" is_pre_election: true
I20260709 12:22:12.246572 30630 raft_consensus.cc:493] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 644aad4e0bf1400b898cb858699c985b)
W20260709 12:22:12.247306 30522 leader_election.cc:336] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.247315 30630 raft_consensus.cc:515] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.247870 30522 leader_election.cc:304] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c; no voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:12.248684 30607 raft_consensus.cc:2749] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.249722 30630 leader_election.cc:290] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.251049 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:12.251727 30558 raft_consensus.cc:2468] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:12.252758 30448 leader_election.cc:304] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:12.253590 30630 raft_consensus.cc:2804] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:12.253602 30448 leader_election.cc:336] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.253969 30630 raft_consensus.cc:493] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 644aad4e0bf1400b898cb858699c985b)
I20260709 12:22:12.254351 30630 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.260917 30626 raft_consensus.cc:493] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.261693 30626 raft_consensus.cc:515] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.262753 30630 raft_consensus.cc:515] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.264065 30626 leader_election.cc:290] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.265056 30630 leader_election.cc:290] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.265713 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" is_pre_election: true
I20260709 12:22:12.266076 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:12.266676 30559 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.266901 30558 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 1.
I20260709 12:22:12.268532 30448 leader_election.cc:304] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:12.269403 30630 raft_consensus.cc:2804] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:12.269704 30448 leader_election.cc:336] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.269927 30630 raft_consensus.cc:493] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.270380 30630 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.270665 30448 leader_election.cc:336] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.275699 30559 raft_consensus.cc:2468] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:12.276942 30448 leader_election.cc:304] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:12.277731 30626 raft_consensus.cc:2804] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.278249 30626 raft_consensus.cc:697] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:12.278602 30630 raft_consensus.cc:515] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.279397 30626 consensus_queue.cc:237] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.280802 30630 leader_election.cc:290] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:12.282437 30559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:12.283181 30559 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:12.289124 30448 leader_election.cc:336] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111)
I20260709 12:22:12.290467 30559 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:12.289927 30304 catalog_manager.cc:5697] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 1 to 2, leader changed from 644aad4e0bf1400b898cb858699c985b (127.18.132.65) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.291587 30448 leader_election.cc:304] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 644aad4e0bf1400b898cb858699c985b
I20260709 12:22:12.292392 30626 raft_consensus.cc:2804] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:12.292809 30626 raft_consensus.cc:697] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:12.293756 30626 consensus_queue.cc:237] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:12.304675 30304 catalog_manager.cc:5697] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 1 to 2, leader changed from 644aad4e0bf1400b898cb858699c985b (127.18.132.65) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:12.486593 30448 consensus_peers.cc:597] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:12.551947 30448 consensus_peers.cc:597] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:12.586117 30559 raft_consensus.cc:1275] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:12.587486 30626 consensus_queue.cc:1048] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:12.616510 30559 raft_consensus.cc:1275] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:12.617880 30626 consensus_queue.cc:1048] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:12.788326 30559 raft_consensus.cc:1275] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:12.789772 30626 consensus_queue.cc:1048] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:12.805538 30448 consensus_peers.cc:597] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:12.816761 30559 raft_consensus.cc:1275] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:12.818053 30692 consensus_queue.cc:1048] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:12.830842 30448 consensus_peers.cc:597] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:13.058503 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:13.116881 30448 consensus_peers.cc:597] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:13.492264 30448 consensus_peers.cc:597] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:13.521646 30448 consensus_peers.cc:597] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:13.687757 30522 consensus_peers.cc:597] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:13.691617 30522 consensus_peers.cc:597] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:13.832312 30448 consensus_peers.cc:597] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:14.059918 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:14.695796 30448 consensus_peers.cc:597] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:15.061089 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:15.098656 30448 consensus_peers.cc:597] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:15.379413 30448 consensus_peers.cc:597] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:15.499908 30448 consensus_peers.cc:597] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:15.587199 30448 consensus_peers.cc:597] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:15.907771 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:15.915663 30698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.916221 30699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.918413 30701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:15.919514 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:15.923831 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:15.924093 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:15.924296 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599735924278 us; error 0 us; skew 500 ppm
I20260709 12:22:15.924899 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:15.928227 18961 webserver.cc:533] Webserver started at http://127.18.132.65:45689/ using document root <none> and password file <none>
I20260709 12:22:15.928812 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:15.929025 18961 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:22:15.933272 18961 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:22:15.937645 30706 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.938493 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:22:15.938807 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "644aad4e0bf1400b898cb858699c985b"
format_stamp: "Formatted at 2026-07-09 12:22:09 on dist-test-slave-xbvc"
I20260709 12:22:15.939209 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:22:15.951152 30448 consensus_peers.cc:597] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:15.960457 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:15.962164 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:15.963937 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:15.968520 30713 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:22:16.019156 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:22:16.019519 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.004s	sys 0.000s
I20260709 12:22:16.019933 18961 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:22:16.025652 30713 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.039251 30713 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.040064 30713 tablet_bootstrap.cc:492] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.040747 30713 ts_tablet_manager.cc:1403] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:22:16.044279 30713 raft_consensus.cc:359] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.045068 30713 raft_consensus.cc:740] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.045883 30713 consensus_queue.cc:260] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.048436 30713 ts_tablet_manager.cc:1434] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:16.049170 30713 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
W20260709 12:22:16.062247 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:16.063524 30713 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.063901 18961 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:22:16.064244 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.044s	sys 0.000s
I20260709 12:22:16.064551 30713 tablet_bootstrap.cc:492] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.065241 30713 ts_tablet_manager.cc:1403] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:22:16.067749 30713 raft_consensus.cc:359] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.068351 30713 raft_consensus.cc:740] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.069168 30713 consensus_queue.cc:260] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.071189 30713 ts_tablet_manager.cc:1434] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:16.072110 30713 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
W20260709 12:22:16.074797 30522 consensus_peers.cc:597] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:16.089511 30713 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.090513 30713 tablet_bootstrap.cc:492] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.091156 30713 ts_tablet_manager.cc:1403] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:22:16.093752 30713 raft_consensus.cc:359] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.094364 30713 raft_consensus.cc:740] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.095098 30713 consensus_queue.cc:260] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.096873 30713 ts_tablet_manager.cc:1434] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:22:16.097625 30713 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
W20260709 12:22:16.107698 30448 consensus_peers.cc:597] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:16.115273 30713 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:16.116477 30713 tablet_bootstrap.cc:492] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.117071 30713 ts_tablet_manager.cc:1403] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:22:16.119366 30713 raft_consensus.cc:359] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.120110 30713 raft_consensus.cc:740] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.120772 30713 consensus_queue.cc:260] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.122620 30713 ts_tablet_manager.cc:1434] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:16.123381 30713 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.137141 30713 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.137951 30713 tablet_bootstrap.cc:492] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.138563 30713 ts_tablet_manager.cc:1403] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:22:16.141232 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:38257
I20260709 12:22:16.141012 30713 raft_consensus.cc:359] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.141393 30775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:38257 every 8 connection(s)
I20260709 12:22:16.141861 30713 raft_consensus.cc:740] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.142841 30713 consensus_queue.cc:260] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.144663 30713 ts_tablet_manager.cc:1434] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:16.145466 30713 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.171352 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.171633 30713 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:16.172813 30713 tablet_bootstrap.cc:492] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.173650 30713 ts_tablet_manager.cc:1403] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.028s	user 0.025s	sys 0.000s
I20260709 12:22:16.177155 30713 raft_consensus.cc:359] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.178128 30713 raft_consensus.cc:740] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.179049 30713 consensus_queue.cc:260] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.181242 30713 ts_tablet_manager.cc:1434] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:16.182670 30713 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.192480 30776 heartbeater.cc:344] Connected to a master server at 127.18.132.126:41455
I20260709 12:22:16.193241 30776 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:16.194633 30776 heartbeater.cc:507] Master 127.18.132.126:41455 requested a full tablet report, sending...
I20260709 12:22:16.203634 30713 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.204499 30713 tablet_bootstrap.cc:492] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.205175 30713 ts_tablet_manager.cc:1403] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:22:16.208030 30305 ts_manager.cc:194] Re-registered known tserver with Master: 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257)
I20260709 12:22:16.209939 30713 raft_consensus.cc:359] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.210754 30713 raft_consensus.cc:740] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.211679 30713 consensus_queue.cc:260] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.213230 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:16.214035 30713 ts_tablet_manager.cc:1434] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:16.214048 30485 raft_consensus.cc:606] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:16.215080 30713 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.217013 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:16.217561 30485 raft_consensus.cc:606] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:16.220009 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:16.220476 30485 raft_consensus.cc:606] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:16.220801 30305 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44316
I20260709 12:22:16.222962 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:16.223429 30485 raft_consensus.cc:606] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:16.224593 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:16.225153 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:16.225047 30776 heartbeater.cc:499] Master 127.18.132.126:41455 was elected leader, sending a full tablet report...
I20260709 12:22:16.226140 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.230173 30713 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.231084 30713 tablet_bootstrap.cc:492] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.231887 30713 ts_tablet_manager.cc:1403] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 12:22:16.234700 30713 raft_consensus.cc:359] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.235453 30713 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.236348 30713 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.238559 30713 ts_tablet_manager.cc:1434] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:22:16.239486 30713 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.253509 30713 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:16.254300 30713 tablet_bootstrap.cc:492] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.254864 30713 ts_tablet_manager.cc:1403] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 12:22:16.256958 30713 raft_consensus.cc:359] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.257817 30713 raft_consensus.cc:740] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.258467 30713 consensus_queue.cc:260] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.260519 30713 ts_tablet_manager.cc:1434] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:22:16.261369 30713 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Bootstrap starting.
I20260709 12:22:16.276620 30713 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.277453 30713 tablet_bootstrap.cc:492] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Bootstrap complete.
I20260709 12:22:16.278249 30713 ts_tablet_manager.cc:1403] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:22:16.280893 30713 raft_consensus.cc:359] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.281368 30713 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644aad4e0bf1400b898cb858699c985b, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.281852 30713 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.283267 30713 ts_tablet_manager.cc:1434] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:22:16.320268 30750 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.327523 30750 pending_rounds.cc:85] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Aborting all ops after (but not including) 0
I20260709 12:22:16.327800 30750 pending_rounds.cc:107] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:16.328060 30750 raft_consensus.cc:2889] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:16.336681 30697 raft_consensus.cc:993] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.337296 30694 raft_consensus.cc:1081] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.338780 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:16.339277 30559 raft_consensus.cc:493] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.339660 30559 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.345517 30559 raft_consensus.cc:515] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.347014 30559 leader_election.cc:290] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:16.347936 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:16.348165 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:16.348637 30750 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.348799 30485 raft_consensus.cc:3055] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.349192 30485 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:16.350063 30485 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.351193 30485 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.354539 30750 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:16.355813 30522 leader_election.cc:304] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:16.356572 30607 raft_consensus.cc:2804] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.357869 30485 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:16.357986 30607 raft_consensus.cc:697] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:16.359373 30607 consensus_queue.cc:237] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.360595 30750 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.368826 30305 catalog_manager.cc:5697] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 1 to 2, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.380313 30697 raft_consensus.cc:993] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.380832 30694 raft_consensus.cc:1081] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.382623 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:16.383190 30559 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.383550 30559 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.390219 30559 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.391744 30559 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:16.392547 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:16.392913 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:16.393291 30750 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.393584 30485 raft_consensus.cc:3055] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.393922 30485 raft_consensus.cc:740] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:16.394842 30485 consensus_queue.cc:260] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.396345 30485 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.401224 30750 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:16.402498 30522 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:16.403353 30607 raft_consensus.cc:2804] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:16.403795 30607 raft_consensus.cc:697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:16.404445 30485 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:16.404667 30607 consensus_queue.cc:237] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.412559 30304 catalog_manager.cc:5697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 2 to 3, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 3 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.433960 30750 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.440227 30750 pending_rounds.cc:85] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Aborting all ops after (but not including) 0
I20260709 12:22:16.440474 30750 pending_rounds.cc:107] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:16.440752 30750 raft_consensus.cc:2889] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:16.484058 30697 raft_consensus.cc:993] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.484593 30694 raft_consensus.cc:1081] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.485939 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:16.486456 30559 raft_consensus.cc:493] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.486791 30559 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.492592 30697 raft_consensus.cc:993] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.493184 30694 raft_consensus.cc:1081] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:16.492969 30559 raft_consensus.cc:515] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.494791 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:16.494935 30559 leader_election.cc:290] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:16.495368 30558 raft_consensus.cc:493] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:16.495837 30558 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.496095 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:16.495958 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df4c1cb04e740c19ef4570a66176246" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:16.496876 30485 raft_consensus.cc:3055] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.496941 30750 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.497328 30485 raft_consensus.cc:740] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:16.498215 30485 consensus_queue.cc:260] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.499601 30485 raft_consensus.cc:3060] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.501904 30558 raft_consensus.cc:515] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.503892 30558 leader_election.cc:290] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:16.504968 30749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:16.505147 30750 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:16.505749 30749 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.505697 30484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:16.506498 30484 raft_consensus.cc:3055] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.506827 30484 raft_consensus.cc:740] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:16.506774 30522 leader_election.cc:304] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:16.508066 30607 raft_consensus.cc:2804] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:16.508574 30607 raft_consensus.cc:697] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:16.508140 30484 consensus_queue.cc:260] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.509531 30607 consensus_queue.cc:237] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.509827 30484 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.514554 30749 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:16.516117 30485 raft_consensus.cc:2468] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:16.516286 30522 leader_election.cc:304] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:16.517211 30607 raft_consensus.cc:2804] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:16.517714 30607 raft_consensus.cc:697] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:16.518733 30607 consensus_queue.cc:237] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:16.519894 30484 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:16.519830 30304 catalog_manager.cc:5697] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 2 to 3, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 3 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.533344 30304 catalog_manager.cc:5697] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 2 to 3, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 3 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.839362 30484 raft_consensus.cc:1275] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.840750 30607 consensus_queue.cc:1048] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.852182 30749 raft_consensus.cc:1275] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.854102 30804 consensus_queue.cc:1048] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.889191 30484 raft_consensus.cc:1275] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.890621 30791 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.900758 30749 raft_consensus.cc:1275] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.902518 30804 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:16.918815 30484 raft_consensus.cc:1275] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.920115 30804 consensus_queue.cc:1048] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.931275 30749 raft_consensus.cc:1275] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.932912 30791 consensus_queue.cc:1048] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:16.933550 30791 consensus_queue.cc:1243] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Peer 644aad4e0bf1400b898cb858699c985b log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:22:16.936918 30750 pending_rounds.cc:85] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Aborting all ops after (but not including) 0
I20260709 12:22:16.937219 30750 pending_rounds.cc:107] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:16.937461 30750 raft_consensus.cc:2889] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:16.984246 30750 raft_consensus.cc:1275] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.985520 30607 consensus_queue.cc:1048] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.993127 30484 raft_consensus.cc:1275] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:16.995085 30791 consensus_queue.cc:1048] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:17.063302 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:17.237818 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.246902 30484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:17.247517 30484 raft_consensus.cc:606] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:17.259676 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
mode: GRACEFUL
new_leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:22:17.260207 30558 raft_consensus.cc:606] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Received request to transfer leadership to TS 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:17.262570 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
mode: GRACEFUL
new_leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:22:17.263059 30558 raft_consensus.cc:606] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Received request to transfer leadership to TS 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:17.264101 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:17.264653 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.265267 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.289335 30804 raft_consensus.cc:993] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: : Instructing follower 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:17.289976 30791 raft_consensus.cc:1081] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Signalling peer 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:17.291421 30484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:47894
I20260709 12:22:17.291949 30484 raft_consensus.cc:493] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.292205 30484 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.298071 30484 raft_consensus.cc:515] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.299687 30484 leader_election.cc:290] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 4 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:17.300557 30749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:17.301235 30749 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.301507 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4ec027d2e45dfb765ba52139c6b54" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:17.302232 30558 raft_consensus.cc:3055] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.302660 30558 raft_consensus.cc:740] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:17.303668 30558 consensus_queue.cc:260] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.305204 30558 raft_consensus.cc:3060] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.309149 30749 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 4.
I20260709 12:22:17.310508 30448 leader_election.cc:304] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:17.311328 30697 raft_consensus.cc:2804] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.311854 30697 raft_consensus.cc:697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:17.312747 30697 consensus_queue.cc:237] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.313441 30558 raft_consensus.cc:2468] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 4.
I20260709 12:22:17.319172 30304 catalog_manager.cc:5697] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 3 to 4, leader changed from 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.389411 30607 raft_consensus.cc:993] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: : Instructing follower 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:17.389894 30791 raft_consensus.cc:1081] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Signalling peer 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:17.391356 30484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:47894
I20260709 12:22:17.391894 30484 raft_consensus.cc:493] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.392204 30484 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.398525 30484 raft_consensus.cc:515] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.401414 30484 leader_election.cc:290] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 3 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:17.401443 30749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:17.402714 30749 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.403270 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:17.403955 30558 raft_consensus.cc:3055] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.404254 30558 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:17.405095 30558 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.406468 30558 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.409111 30749 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 3.
I20260709 12:22:17.410231 30448 leader_election.cc:304] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:17.410893 30697 raft_consensus.cc:2804] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.411293 30697 raft_consensus.cc:697] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:17.412194 30697 consensus_queue.cc:237] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.412882 30558 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 3.
I20260709 12:22:17.418599 30304 catalog_manager.cc:5697] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 2 to 3, leader changed from 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.547628 30694 raft_consensus.cc:993] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:17.548162 30697 raft_consensus.cc:1081] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:17.549552 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:17.550017 30558 raft_consensus.cc:493] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.550276 30558 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.556545 30558 raft_consensus.cc:515] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.558195 30558 leader_election.cc:290] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:17.558979 30749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:17.559206 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40badf82971d49c28fabd4a9338fd466" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:17.559660 30749 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.559907 30485 raft_consensus.cc:3055] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.560309 30485 raft_consensus.cc:740] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:17.561322 30485 consensus_queue.cc:260] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.562387 30485 raft_consensus.cc:3060] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.565861 30749 raft_consensus.cc:2468] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:17.567062 30522 leader_election.cc:304] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:17.567991 30791 raft_consensus.cc:2804] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.568457 30791 raft_consensus.cc:697] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:17.569440 30791 consensus_queue.cc:237] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:17.569881 30485 raft_consensus.cc:2468] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 3.
I20260709 12:22:17.576512 30304 catalog_manager.cc:5697] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 2 to 3, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 3 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:17.809309 30558 raft_consensus.cc:1275] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:17.810539 30697 consensus_queue.cc:1048] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:17.819439 30750 raft_consensus.cc:1275] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:17.823262 30694 consensus_queue.cc:1048] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:17.853119 30750 raft_consensus.cc:1275] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:17.854650 30694 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:17.862825 30558 raft_consensus.cc:1275] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:17.865442 30824 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.031919 30750 raft_consensus.cc:1275] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.033361 30804 consensus_queue.cc:1048] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.043300 30485 raft_consensus.cc:1275] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:18.045269 30804 consensus_queue.cc:1048] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:18.064206 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:18.271617 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:18.279626 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
mode: GRACEFUL
new_leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:22:18.280238 30558 raft_consensus.cc:606] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Received request to transfer leadership to TS 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:18.282820 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:18.283280 30485 raft_consensus.cc:606] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:18.285844 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:18.286365 30485 raft_consensus.cc:606] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:18.287357 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:18.287899 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.288497 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:18.416630 30826 raft_consensus.cc:993] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: : Instructing follower 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:18.417197 30804 raft_consensus.cc:1081] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Signalling peer 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:18.418720 30485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:47894
I20260709 12:22:18.419184 30485 raft_consensus.cc:493] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.419440 30485 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.425356 30485 raft_consensus.cc:515] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.426914 30485 leader_election.cc:290] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 4 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:18.427778 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:18.427975 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bcf73411c04337bc79f66ee592c842" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:18.428547 30750 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.428690 30558 raft_consensus.cc:3055] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:18.429111 30558 raft_consensus.cc:740] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:18.429863 30558 consensus_queue.cc:260] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.431198 30558 raft_consensus.cc:3060] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.435478 30750 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 4.
I20260709 12:22:18.436745 30448 leader_election.cc:304] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:18.437464 30824 raft_consensus.cc:2804] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:18.437727 30558 raft_consensus.cc:2468] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 4.
I20260709 12:22:18.437896 30824 raft_consensus.cc:697] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:18.438956 30824 consensus_queue.cc:237] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.446102 30305 catalog_manager.cc:5697] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 3 to 4, leader changed from 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 4 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.504984 30694 raft_consensus.cc:993] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:18.505499 30824 raft_consensus.cc:1081] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:18.506982 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:18.507443 30558 raft_consensus.cc:493] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.507762 30558 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.513386 30558 raft_consensus.cc:515] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.515058 30558 leader_election.cc:290] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:18.515967 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:18.516223 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:18.516616 30750 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.516856 30485 raft_consensus.cc:3055] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:18.517205 30485 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:18.518000 30485 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.519119 30485 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.522468 30750 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:18.523785 30522 leader_election.cc:304] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:18.524577 30804 raft_consensus.cc:2804] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:18.525043 30804 raft_consensus.cc:697] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:18.525334 30485 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:18.525934 30804 consensus_queue.cc:237] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.533535 30305 catalog_manager.cc:5697] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 1 to 2, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.806223 30694 raft_consensus.cc:993] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:18.806735 30824 raft_consensus.cc:1081] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:18.808234 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:18.808770 30558 raft_consensus.cc:493] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:18.809098 30558 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.815156 30558 raft_consensus.cc:515] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.817075 30558 leader_election.cc:290] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 4 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:18.817909 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:18.818173 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de75a4cf11264e6b8f84530c68841c6e" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:18.818701 30750 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.818850 30485 raft_consensus.cc:3055] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:18.819602 30485 raft_consensus.cc:740] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:18.820518 30485 consensus_queue.cc:260] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.821597 30485 raft_consensus.cc:3060] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.826066 30750 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 4.
I20260709 12:22:18.826526 30485 raft_consensus.cc:2468] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 4.
I20260709 12:22:18.827311 30522 leader_election.cc:304] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:18.828186 30804 raft_consensus.cc:2804] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:18.828575 30804 raft_consensus.cc:697] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:18.829365 30804 consensus_queue.cc:237] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:18.836011 30305 catalog_manager.cc:5697] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 3 to 4, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 4 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.900774 30558 raft_consensus.cc:1275] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:18.902045 30824 consensus_queue.cc:1048] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.911244 30750 raft_consensus.cc:1275] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:18.912927 30836 consensus_queue.cc:1048] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.932336 30485 raft_consensus.cc:1275] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.933578 30804 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.942505 30750 raft_consensus.cc:1275] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.945115 30804 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:19.065203 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:19.278251 30750 raft_consensus.cc:1275] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:19.280828 30804 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:19.289490 30485 raft_consensus.cc:1275] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:19.290999 30833 consensus_queue.cc:1048] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:19.296296 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.306854 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:19.307462 30485 raft_consensus.cc:606] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:19.309969 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
mode: GRACEFUL
new_leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:22:19.310359 30558 raft_consensus.cc:606] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Received request to transfer leadership to TS 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:19.312518 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
mode: GRACEFUL
new_leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:22:19.312886 30558 raft_consensus.cc:606] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Received request to transfer leadership to TS 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:19.313748 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:19.314196 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:19.314690 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.350572 30804 raft_consensus.cc:993] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: : Instructing follower 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:19.351403 30833 raft_consensus.cc:1081] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Signalling peer 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:19.353083 30485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:47894
I20260709 12:22:19.353624 30485 raft_consensus.cc:493] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.353930 30485 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.360288 30485 raft_consensus.cc:515] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.361809 30485 leader_election.cc:290] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 3 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:19.362609 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:19.362767 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:19.363308 30750 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.363422 30558 raft_consensus.cc:3055] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:19.363873 30558 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:19.364514 30558 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.365517 30558 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.368571 30750 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 3.
I20260709 12:22:19.369602 30448 leader_election.cc:304] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:19.370314 30824 raft_consensus.cc:2804] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:19.370743 30824 raft_consensus.cc:697] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:19.371336 30558 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 3.
I20260709 12:22:19.371513 30824 consensus_queue.cc:237] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.378305 30305 catalog_manager.cc:5697] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 2 to 3, leader changed from 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:19.509068 30804 raft_consensus.cc:993] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: : Instructing follower 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:19.509562 30833 raft_consensus.cc:1081] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Signalling peer 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:19.511030 30485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:47894
I20260709 12:22:19.511539 30485 raft_consensus.cc:493] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.511868 30485 raft_consensus.cc:3060] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.517158 30485 raft_consensus.cc:515] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.518620 30485 leader_election.cc:290] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:19.519434 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:19.519641 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e645d41e747b48a1922a4d79f214c7c2" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:19.520102 30750 raft_consensus.cc:3060] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.520328 30558 raft_consensus.cc:3055] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:19.520699 30558 raft_consensus.cc:740] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:19.521459 30558 consensus_queue.cc:260] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.522601 30558 raft_consensus.cc:3060] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.525449 30750 raft_consensus.cc:2468] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:19.526522 30448 leader_election.cc:304] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:19.527212 30848 raft_consensus.cc:2804] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:19.527710 30848 raft_consensus.cc:697] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:19.527745 30558 raft_consensus.cc:2468] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:19.528729 30848 consensus_queue.cc:237] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.536341 30305 catalog_manager.cc:5697] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 1 to 2, leader changed from 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:19.761868 30750 raft_consensus.cc:1275] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:19.763249 30848 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:19.770902 30558 raft_consensus.cc:1275] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:19.772675 30836 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:19.802830 30824 raft_consensus.cc:993] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:19.803419 30836 raft_consensus.cc:1081] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:19.805132 30558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:19.805605 30558 raft_consensus.cc:493] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:19.805928 30558 raft_consensus.cc:3060] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.811038 30558 raft_consensus.cc:515] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.812449 30558 leader_election.cc:290] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:19.813416 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:19.813534 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c05517115e84eb5a3a83ff5de185004" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:19.814057 30750 raft_consensus.cc:3060] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.814142 30485 raft_consensus.cc:3055] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:19.814544 30485 raft_consensus.cc:740] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:19.815218 30485 consensus_queue.cc:260] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.816277 30485 raft_consensus.cc:3060] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:19.819078 30750 raft_consensus.cc:2468] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:19.820209 30522 leader_election.cc:304] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:19.820933 30826 raft_consensus.cc:2804] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:19.821357 30826 raft_consensus.cc:697] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:19.821470 30485 raft_consensus.cc:2468] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:19.822306 30826 consensus_queue.cc:237] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:19.829721 30305 catalog_manager.cc:5697] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 1 to 2, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.042155 30750 raft_consensus.cc:1275] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.043471 30836 consensus_queue.cc:1048] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:20.053495 30558 raft_consensus.cc:1275] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.056622 30848 consensus_queue.cc:1048] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:20.066075 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:20.238408 30485 raft_consensus.cc:1275] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.239706 30826 consensus_queue.cc:1048] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:20.248528 30750 raft_consensus.cc:1275] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.250196 30826 consensus_queue.cc:1048] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:20.320873 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.328599 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:20.329138 30485 raft_consensus.cc:606] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:20.331406 30485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
mode: GRACEFUL
new_leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:47920
I20260709 12:22:20.331902 30485 raft_consensus.cc:606] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Received request to transfer leadership to TS 6355a43d0eaf4dd09ada3f9fdae58e6c
I20260709 12:22:20.334153 30558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
mode: GRACEFUL
new_leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:22:20.334609 30558 raft_consensus.cc:606] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Received request to transfer leadership to TS 7330fa7d46a94ea1ad2c7a23cf1afe05
I20260709 12:22:20.335712 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:22:20.336272 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:20.336901 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.367004 30854 raft_consensus.cc:993] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: : Instructing follower 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:20.367702 30826 raft_consensus.cc:1081] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Signalling peer 7330fa7d46a94ea1ad2c7a23cf1afe05 to start an election
I20260709 12:22:20.369078 30485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610"
dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
 from {username='slave'} at 127.0.0.1:47894
I20260709 12:22:20.369601 30485 raft_consensus.cc:493] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.369901 30485 raft_consensus.cc:3060] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.375262 30485 raft_consensus.cc:515] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.376938 30485 leader_election.cc:290] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67:35313)
I20260709 12:22:20.377660 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:20.378293 30750 raft_consensus.cc:3060] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.378146 30558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b868a30dff4d44e5a53a8502edd00610" candidate_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
I20260709 12:22:20.378883 30558 raft_consensus.cc:3055] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:20.379189 30558 raft_consensus.cc:740] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:20.380002 30558 consensus_queue.cc:260] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.381081 30558 raft_consensus.cc:3060] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.383735 30750 raft_consensus.cc:2468] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:20.384792 30448 leader_election.cc:304] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644aad4e0bf1400b898cb858699c985b, 7330fa7d46a94ea1ad2c7a23cf1afe05; no voters: 
I20260709 12:22:20.385602 30848 raft_consensus.cc:2804] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:20.386041 30848 raft_consensus.cc:697] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Becoming Leader. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:20.386618 30558 raft_consensus.cc:2468] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7330fa7d46a94ea1ad2c7a23cf1afe05 in term 2.
I20260709 12:22:20.386916 30848 consensus_queue.cc:237] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.394697 30304 catalog_manager.cc:5697] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 reported cstate change: term changed from 1 to 2, leader changed from 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67) to 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:20.549367 30824 raft_consensus.cc:993] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:20.550007 30860 raft_consensus.cc:1081] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:20.551541 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:20.552136 30559 raft_consensus.cc:493] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.552480 30559 raft_consensus.cc:3060] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.559479 30559 raft_consensus.cc:515] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.561163 30559 leader_election.cc:290] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:20.561976 30750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:20.562326 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798b5a5c646b4a7095d425cab4827063" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:20.562660 30750 raft_consensus.cc:3060] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.562928 30485 raft_consensus.cc:3055] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:20.563208 30485 raft_consensus.cc:740] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:20.564045 30485 consensus_queue.cc:260] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.565347 30485 raft_consensus.cc:3060] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.569975 30750 raft_consensus.cc:2468] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:20.571221 30522 leader_election.cc:304] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:20.572052 30826 raft_consensus.cc:2804] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:20.572589 30826 raft_consensus.cc:697] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:20.572679 30485 raft_consensus.cc:2468] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 2.
I20260709 12:22:20.573514 30826 consensus_queue.cc:237] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.581507 30304 catalog_manager.cc:5697] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 1 to 2, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 2 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.687726 30824 raft_consensus.cc:993] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: : Instructing follower 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:20.688232 30860 raft_consensus.cc:1081] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Signalling peer 6355a43d0eaf4dd09ada3f9fdae58e6c to start an election
I20260709 12:22:20.689667 30559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b"
dest_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c"
 from {username='slave'} at 127.0.0.1:35122
I20260709 12:22:20.690088 30559 raft_consensus.cc:493] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.690308 30559 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.695457 30559 raft_consensus.cc:515] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.696986 30559 leader_election.cc:290] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 4 election: Requested vote from peers 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257), 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701)
I20260709 12:22:20.697800 30749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "644aad4e0bf1400b898cb858699c985b"
I20260709 12:22:20.698025 30485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c230c0c4a604ce5a010226733ec0f0b" candidate_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05"
I20260709 12:22:20.698514 30749 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.698554 30485 raft_consensus.cc:3055] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:20.699000 30485 raft_consensus.cc:740] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7330fa7d46a94ea1ad2c7a23cf1afe05, State: Running, Role: LEADER
I20260709 12:22:20.699884 30485 consensus_queue.cc:260] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.701154 30485 raft_consensus.cc:3060] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.705745 30749 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 4.
I20260709 12:22:20.706923 30522 leader_election.cc:304] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6355a43d0eaf4dd09ada3f9fdae58e6c, 644aad4e0bf1400b898cb858699c985b; no voters: 
I20260709 12:22:20.707612 30826 raft_consensus.cc:2804] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:20.708086 30826 raft_consensus.cc:697] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 LEADER]: Becoming Leader. State: Replica: 6355a43d0eaf4dd09ada3f9fdae58e6c, State: Running, Role: LEADER
I20260709 12:22:20.708624 30485 raft_consensus.cc:2468] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6355a43d0eaf4dd09ada3f9fdae58e6c in term 4.
I20260709 12:22:20.708956 30826 consensus_queue.cc:237] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } }
I20260709 12:22:20.714996 30304 catalog_manager.cc:5697] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c reported cstate change: term changed from 3 to 4, leader changed from 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66) to 6355a43d0eaf4dd09ada3f9fdae58e6c (127.18.132.67). New cstate: current_term: 4 leader_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.792248 30559 raft_consensus.cc:1275] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.793383 30860 consensus_queue.cc:1048] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6355a43d0eaf4dd09ada3f9fdae58e6c" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 35313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:20.805781 30749 raft_consensus.cc:1275] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Refusing update from remote peer 7330fa7d46a94ea1ad2c7a23cf1afe05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:20.807367 30860 consensus_queue.cc:1048] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:21.067157 30355 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:21.100250 30485 raft_consensus.cc:1275] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:21.101536 30854 consensus_queue.cc:1048] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:21.110797 30749 raft_consensus.cc:1275] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:21.112623 30854 consensus_queue.cc:1048] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:21.131335 30749 raft_consensus.cc:1275] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.132501 30854 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "644aad4e0bf1400b898cb858699c985b" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 38257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.141306 30485 raft_consensus.cc:1275] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Refusing update from remote peer 6355a43d0eaf4dd09ada3f9fdae58e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.142820 30854 consensus_queue.cc:1048] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7330fa7d46a94ea1ad2c7a23cf1afe05" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 35701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:21.343519 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.374325 18961 tablet_server.cc:179] TabletServer@127.18.132.65:38257 shutting down...
I20260709 12:22:21.394186 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:21.394834 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.395516 18961 raft_consensus.cc:2243] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.396028 18961 raft_consensus.cc:2272] T 56bcf73411c04337bc79f66ee592c842 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.398157 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.398733 18961 raft_consensus.cc:2243] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.399147 18961 raft_consensus.cc:2272] T de75a4cf11264e6b8f84530c68841c6e P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.401091 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.401659 18961 raft_consensus.cc:2243] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.402027 18961 raft_consensus.cc:2272] T 2df4c1cb04e740c19ef4570a66176246 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.403957 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.404472 18961 raft_consensus.cc:2243] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.404831 18961 raft_consensus.cc:2272] T 798b5a5c646b4a7095d425cab4827063 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.407692 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.408200 18961 raft_consensus.cc:2243] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.408589 18961 raft_consensus.cc:2272] T e645d41e747b48a1922a4d79f214c7c2 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.410419 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.410897 18961 raft_consensus.cc:2243] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.411242 18961 raft_consensus.cc:2272] T 4c05517115e84eb5a3a83ff5de185004 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.413235 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.413740 18961 raft_consensus.cc:2243] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.414125 18961 raft_consensus.cc:2272] T 7fb4ec027d2e45dfb765ba52139c6b54 P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.416033 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.416493 18961 raft_consensus.cc:2243] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.416930 18961 raft_consensus.cc:2272] T 40badf82971d49c28fabd4a9338fd466 P 644aad4e0bf1400b898cb858699c985b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.419081 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.419742 18961 raft_consensus.cc:2243] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.420265 18961 raft_consensus.cc:2272] T 6c230c0c4a604ce5a010226733ec0f0b P 644aad4e0bf1400b898cb858699c985b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.422765 18961 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:21.423261 18961 raft_consensus.cc:2243] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.423758 18961 raft_consensus.cc:2272] T b868a30dff4d44e5a53a8502edd00610 P 644aad4e0bf1400b898cb858699c985b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.453987 18961 tablet_server.cc:196] TabletServer@127.18.132.65:38257 shutdown complete.
W20260709 12:22:21.470722 30448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111) [suppressed 91 similar messages]
W20260709 12:22:21.474577 30448 consensus_peers.cc:597] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.510738 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
I20260709 12:22:21.547022 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:21.548022 18961 tablet_replica.cc:333] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.548940 18961 raft_consensus.cc:2243] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.550771 18961 raft_consensus.cc:2272] T b868a30dff4d44e5a53a8502edd00610 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.555547 18961 tablet_replica.cc:333] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.556478 18961 raft_consensus.cc:2243] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.557199 18961 raft_consensus.cc:2272] T 6c230c0c4a604ce5a010226733ec0f0b P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.562363 18961 tablet_replica.cc:333] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.563050 18961 raft_consensus.cc:2243] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.563791 18961 raft_consensus.cc:2272] T 2df4c1cb04e740c19ef4570a66176246 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.566651 18961 tablet_replica.cc:333] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.567205 18961 raft_consensus.cc:2243] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.568874 18961 raft_consensus.cc:2272] T 7fb4ec027d2e45dfb765ba52139c6b54 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.571915 18961 tablet_replica.cc:333] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.572582 18961 raft_consensus.cc:2243] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.574235 18961 raft_consensus.cc:2272] T 56bcf73411c04337bc79f66ee592c842 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.577312 18961 tablet_replica.cc:333] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.577913 18961 raft_consensus.cc:2243] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.578413 18961 raft_consensus.cc:2272] T de75a4cf11264e6b8f84530c68841c6e P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.581465 18961 tablet_replica.cc:333] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.582057 18961 raft_consensus.cc:2243] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.582623 18961 raft_consensus.cc:2272] T 798b5a5c646b4a7095d425cab4827063 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.586104 18961 tablet_replica.cc:333] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.586664 18961 raft_consensus.cc:2243] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.588213 18961 raft_consensus.cc:2272] T e645d41e747b48a1922a4d79f214c7c2 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.590736 18961 tablet_replica.cc:333] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.591296 18961 raft_consensus.cc:2243] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.591943 18961 raft_consensus.cc:2272] T 4c05517115e84eb5a3a83ff5de185004 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.595104 18961 tablet_replica.cc:333] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05: stopping tablet replica
I20260709 12:22:21.595782 18961 raft_consensus.cc:2243] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.596789 18961 raft_consensus.cc:2272] T 40badf82971d49c28fabd4a9338fd466 P 7330fa7d46a94ea1ad2c7a23cf1afe05 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.603672 30522 consensus_peers.cc:597] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.621644 30522 consensus_peers.cc:597] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.643848 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
W20260709 12:22:21.655489 30524 consensus_peers.cc:597] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Couldn't send request to peer 7330fa7d46a94ea1ad2c7a23cf1afe05. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:35701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:21.689678 30524 consensus_peers.cc:597] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 7330fa7d46a94ea1ad2c7a23cf1afe05 (127.18.132.66:35701): Couldn't send request to peer 7330fa7d46a94ea1ad2c7a23cf1afe05. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:35701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.693151 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
W20260709 12:22:21.694499 30522 consensus_peers.cc:597] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.727877 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:21.728711 18961 tablet_replica.cc:333] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.729986 18961 raft_consensus.cc:2243] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.732512 18961 raft_consensus.cc:2272] T 40badf82971d49c28fabd4a9338fd466 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:21.735867 30522 consensus_peers.cc:597] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c -> Peer 644aad4e0bf1400b898cb858699c985b (127.18.132.65:38257): Couldn't send request to peer 644aad4e0bf1400b898cb858699c985b. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:38257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:21.736716 18961 tablet_replica.cc:333] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.737560 18961 raft_consensus.cc:2243] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.738255 18961 raft_consensus.cc:2272] T 7fb4ec027d2e45dfb765ba52139c6b54 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.741274 18961 tablet_replica.cc:333] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.741997 18961 raft_consensus.cc:2243] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.742686 18961 raft_consensus.cc:2272] T 56bcf73411c04337bc79f66ee592c842 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.745626 18961 tablet_replica.cc:333] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.746272 18961 raft_consensus.cc:2243] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.747503 18961 raft_consensus.cc:2272] T 2df4c1cb04e740c19ef4570a66176246 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.750006 18961 tablet_replica.cc:333] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.750573 18961 raft_consensus.cc:2243] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.751780 18961 raft_consensus.cc:2272] T 798b5a5c646b4a7095d425cab4827063 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.755788 18961 tablet_replica.cc:333] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.756399 18961 raft_consensus.cc:2243] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.757093 18961 raft_consensus.cc:2272] T b868a30dff4d44e5a53a8502edd00610 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.760658 18961 tablet_replica.cc:333] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.761264 18961 raft_consensus.cc:2243] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.762283 18961 raft_consensus.cc:2272] T 6c230c0c4a604ce5a010226733ec0f0b P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.765149 18961 tablet_replica.cc:333] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.765765 18961 raft_consensus.cc:2243] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.766906 18961 raft_consensus.cc:2272] T de75a4cf11264e6b8f84530c68841c6e P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.769533 18961 tablet_replica.cc:333] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.770186 18961 raft_consensus.cc:2243] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:21.770817 18961 raft_consensus.cc:2272] T e645d41e747b48a1922a4d79f214c7c2 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.773636 18961 tablet_replica.cc:333] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c: stopping tablet replica
I20260709 12:22:21.774190 18961 raft_consensus.cc:2243] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.775627 18961 raft_consensus.cc:2272] T 4c05517115e84eb5a3a83ff5de185004 P 6355a43d0eaf4dd09ada3f9fdae58e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.813607 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
I20260709 12:22:21.848786 18961 master.cc:562] Master@127.18.132.126:41455 shutting down...
I20260709 12:22:21.877902 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:21.878820 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:21.879223 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3648e69b58a14d8c987fd89c2649fc9f: stopping tablet replica
I20260709 12:22:21.902619 18961 master.cc:584] Master@127.18.132.126:41455 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13062 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:22:21.957242 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:34739
I20260709 12:22:21.958745 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:21.965322 30884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:21.965420 30883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:21.965958 30886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:21.967900 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:21.968843 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:21.969022 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:21.969135 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599741969124 us; error 0 us; skew 500 ppm
I20260709 12:22:21.969645 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:21.972146 18961 webserver.cc:533] Webserver started at http://127.18.132.126:35305/ using document root <none> and password file <none>
I20260709 12:22:21.972651 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:21.972813 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:21.973057 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:21.974356 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "f2f24edcea4943fc8e6ef83c70a9bec8"
format_stamp: "Formatted at 2026-07-09 12:22:21 on dist-test-slave-xbvc"
I20260709 12:22:21.979260 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:22:21.982955 30891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:21.983789 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:21.984074 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "f2f24edcea4943fc8e6ef83c70a9bec8"
format_stamp: "Formatted at 2026-07-09 12:22:21 on dist-test-slave-xbvc"
I20260709 12:22:21.984403 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.001408 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.002774 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.046036 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:34739
I20260709 12:22:22.046137 30942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:34739 every 8 connection(s)
I20260709 12:22:22.050316 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.064512 30943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8: Bootstrap starting.
I20260709 12:22:22.070051 30943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.075018 30943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8: No bootstrap required, opened a new log
I20260709 12:22:22.077657 30943 raft_consensus.cc:359] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" member_type: VOTER }
I20260709 12:22:22.078153 30943 raft_consensus.cc:385] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.078394 30943 raft_consensus.cc:740] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2f24edcea4943fc8e6ef83c70a9bec8, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.079030 30943 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" member_type: VOTER }
I20260709 12:22:22.079557 30943 raft_consensus.cc:399] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:22.079811 30943 raft_consensus.cc:493] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:22.080158 30943 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.085736 30943 raft_consensus.cc:515] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" member_type: VOTER }
I20260709 12:22:22.086320 30943 leader_election.cc:304] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2f24edcea4943fc8e6ef83c70a9bec8; no voters: 
I20260709 12:22:22.087532 30943 leader_election.cc:290] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:22.087965 30946 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:22.089452 30946 raft_consensus.cc:697] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 1 LEADER]: Becoming Leader. State: Replica: f2f24edcea4943fc8e6ef83c70a9bec8, State: Running, Role: LEADER
I20260709 12:22:22.090212 30946 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" member_type: VOTER }
I20260709 12:22:22.090764 30943 sys_catalog.cc:565] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:22.093477 30947 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" member_type: VOTER } }
I20260709 12:22:22.093478 30948 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2f24edcea4943fc8e6ef83c70a9bec8. Latest consensus state: current_term: 1 leader_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f24edcea4943fc8e6ef83c70a9bec8" member_type: VOTER } }
I20260709 12:22:22.094375 30947 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:22.094445 30948 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:22.104192 30951 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:22.110724 30951 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:22.111858 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:22.120573 30951 catalog_manager.cc:1383] Generated new cluster ID: 0f73fd39406945eba9174d7c8bf2d30f
I20260709 12:22:22.120962 30951 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:22.142969 30951 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:22.144534 30951 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:22.159806 30951 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8: Generated new TSK 0
I20260709 12:22:22.160440 30951 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:22.178581 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:22.185571 30964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.186874 30965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.188046 30967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.188728 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:22.189755 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:22.189970 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:22.190146 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599742190126 us; error 0 us; skew 500 ppm
I20260709 12:22:22.190755 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:22.193338 18961 webserver.cc:533] Webserver started at http://127.18.132.65:37287/ using document root <none> and password file <none>
I20260709 12:22:22.193888 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:22.194103 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:22.194402 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:22.195710 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "66fe6e09dab3484baa7133e5c1772f89"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-xbvc"
I20260709 12:22:22.200642 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:22:22.204234 30972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.205015 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:22.205327 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "66fe6e09dab3484baa7133e5c1772f89"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-xbvc"
I20260709 12:22:22.205637 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.214658 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.215950 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.217481 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:22.219928 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:22.220144 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.220387 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:22.220583 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.266376 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:37047
I20260709 12:22:22.266484 31034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:37047 every 8 connection(s)
I20260709 12:22:22.272071 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:22.281106 31040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.281091 31039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.284395 31042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.286535 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:22.287129 31035 heartbeater.cc:344] Connected to a master server at 127.18.132.126:34739
I20260709 12:22:22.287628 31035 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:22.287811 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:22.288094 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:22.288295 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599742288254 us; error 0 us; skew 500 ppm
I20260709 12:22:22.288542 31035 heartbeater.cc:507] Master 127.18.132.126:34739 requested a full tablet report, sending...
I20260709 12:22:22.289052 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:22.291047 30908 ts_manager.cc:194] Registered new tserver with Master: 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047)
I20260709 12:22:22.292280 18961 webserver.cc:533] Webserver started at http://127.18.132.66:36177/ using document root <none> and password file <none>
I20260709 12:22:22.292902 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:22.293121 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:22.293383 30908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47230
I20260709 12:22:22.293401 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:22.295351 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "2c0101db16b54c0a8382e7e1c137f991"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-xbvc"
I20260709 12:22:22.300516 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:22:22.304021 31047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.304780 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:22.305095 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "2c0101db16b54c0a8382e7e1c137f991"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-xbvc"
I20260709 12:22:22.305403 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.321280 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.322507 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.324064 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:22.326351 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:22.326581 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.326836 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:22.327009 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.372213 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:44637
I20260709 12:22:22.372313 31109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:44637 every 8 connection(s)
I20260709 12:22:22.377523 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:22.386934 31113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.387836 31114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.390182 31116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.391052 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:22.391325 31110 heartbeater.cc:344] Connected to a master server at 127.18.132.126:34739
I20260709 12:22:22.391844 31110 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:22.392342 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:22.392690 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:22.392858 31110 heartbeater.cc:507] Master 127.18.132.126:34739 requested a full tablet report, sending...
I20260709 12:22:22.392925 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599742392900 us; error 0 us; skew 500 ppm
I20260709 12:22:22.394104 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:22.395658 30908 ts_manager.cc:194] Registered new tserver with Master: 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:22.397054 18961 webserver.cc:533] Webserver started at http://127.18.132.67:46169/ using document root <none> and password file <none>
I20260709 12:22:22.397796 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:22.397817 30908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47240
I20260709 12:22:22.398198 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:22.398566 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:22.400130 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "f9e59759864644599762735ce07fa524"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-xbvc"
I20260709 12:22:22.405056 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:22.408991 31121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.409747 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:22.410048 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "f9e59759864644599762735ce07fa524"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-xbvc"
I20260709 12:22:22.410351 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.436233 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.437533 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.439157 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:22.441594 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:22.441831 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.442080 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:22.442253 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.488492 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:36969
I20260709 12:22:22.488622 31183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:36969 every 8 connection(s)
I20260709 12:22:22.504143 31184 heartbeater.cc:344] Connected to a master server at 127.18.132.126:34739
I20260709 12:22:22.504691 31184 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:22.505777 31184 heartbeater.cc:507] Master 127.18.132.126:34739 requested a full tablet report, sending...
I20260709 12:22:22.508291 30908 ts_manager.cc:194] Registered new tserver with Master: f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
I20260709 12:22:22.509023 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016882333s
I20260709 12:22:22.509785 30908 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47252
I20260709 12:22:22.537202 30908 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47268:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:22.539654 30908 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:22.589444 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 8edcde650ffd46ecb2390785aaba5ac4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=922f2a56a3c448988e1ed9dd33e40c3e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:22.591213 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edcde650ffd46ecb2390785aaba5ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.592917 31148 tablet_service.cc:1511] Processing CreateTablet for tablet e0e9ba94d7594f2b85ea991d3eafe518 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=922f2a56a3c448988e1ed9dd33e40c3e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:22.594520 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e9ba94d7594f2b85ea991d3eafe518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.595974 31000 tablet_service.cc:1511] Processing CreateTablet for tablet 8edcde650ffd46ecb2390785aaba5ac4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=922f2a56a3c448988e1ed9dd33e40c3e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:22.597536 31000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edcde650ffd46ecb2390785aaba5ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.605335 30999 tablet_service.cc:1511] Processing CreateTablet for tablet e0e9ba94d7594f2b85ea991d3eafe518 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=922f2a56a3c448988e1ed9dd33e40c3e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:22.606523 30999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e9ba94d7594f2b85ea991d3eafe518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.608286 31075 tablet_service.cc:1511] Processing CreateTablet for tablet 8edcde650ffd46ecb2390785aaba5ac4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=922f2a56a3c448988e1ed9dd33e40c3e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:22.609289 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edcde650ffd46ecb2390785aaba5ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.612884 31074 tablet_service.cc:1511] Processing CreateTablet for tablet e0e9ba94d7594f2b85ea991d3eafe518 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=922f2a56a3c448988e1ed9dd33e40c3e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:22.614357 31074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e9ba94d7594f2b85ea991d3eafe518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.618907 31199 tablet_bootstrap.cc:492] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: Bootstrap starting.
I20260709 12:22:22.628067 31199 tablet_bootstrap.cc:654] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.640300 31199 tablet_bootstrap.cc:492] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: No bootstrap required, opened a new log
I20260709 12:22:22.640983 31199 ts_tablet_manager.cc:1403] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:22:22.644415 31199 raft_consensus.cc:359] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.645356 31199 raft_consensus.cc:385] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.645665 31199 raft_consensus.cc:740] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.646461 31199 consensus_queue.cc:260] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.658291 31184 heartbeater.cc:499] Master 127.18.132.126:34739 was elected leader, sending a full tablet report...
I20260709 12:22:22.658694 31199 ts_tablet_manager.cc:1434] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.012s
I20260709 12:22:22.659976 31200 tablet_bootstrap.cc:492] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89: Bootstrap starting.
I20260709 12:22:22.660058 31199 tablet_bootstrap.cc:492] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: Bootstrap starting.
I20260709 12:22:22.668689 31203 tablet_bootstrap.cc:492] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991: Bootstrap starting.
I20260709 12:22:22.669162 31200 tablet_bootstrap.cc:654] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.675457 31199 tablet_bootstrap.cc:654] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.678627 31200 tablet_bootstrap.cc:492] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89: No bootstrap required, opened a new log
I20260709 12:22:22.679121 31200 ts_tablet_manager.cc:1403] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:22:22.679164 31203 tablet_bootstrap.cc:654] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.681981 31199 tablet_bootstrap.cc:492] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: No bootstrap required, opened a new log
I20260709 12:22:22.681998 31200 raft_consensus.cc:359] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.682786 31199 ts_tablet_manager.cc:1403] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:22:22.683065 31200 raft_consensus.cc:385] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.683476 31200 raft_consensus.cc:740] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.684376 31200 consensus_queue.cc:260] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.685407 31203 tablet_bootstrap.cc:492] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991: No bootstrap required, opened a new log
I20260709 12:22:22.686192 31203 ts_tablet_manager.cc:1403] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:22:22.686071 31199 raft_consensus.cc:359] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.687099 31199 raft_consensus.cc:385] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.687160 31035 heartbeater.cc:499] Master 127.18.132.126:34739 was elected leader, sending a full tablet report...
I20260709 12:22:22.687642 31200 ts_tablet_manager.cc:1434] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:22:22.687500 31199 raft_consensus.cc:740] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.690205 31203 raft_consensus.cc:359] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.693187 31203 raft_consensus.cc:385] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.693519 31203 raft_consensus.cc:740] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0101db16b54c0a8382e7e1c137f991, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.693652 31200 tablet_bootstrap.cc:492] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89: Bootstrap starting.
I20260709 12:22:22.693574 31199 consensus_queue.cc:260] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.696406 31199 ts_tablet_manager.cc:1434] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:22:22.694463 31203 consensus_queue.cc:260] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.702998 31200 tablet_bootstrap.cc:654] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.709306 31110 heartbeater.cc:499] Master 127.18.132.126:34739 was elected leader, sending a full tablet report...
I20260709 12:22:22.709741 31203 ts_tablet_manager.cc:1434] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 12:22:22.710031 31200 tablet_bootstrap.cc:492] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89: No bootstrap required, opened a new log
I20260709 12:22:22.710632 31200 ts_tablet_manager.cc:1403] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:22:22.710800 31203 tablet_bootstrap.cc:492] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991: Bootstrap starting.
I20260709 12:22:22.714130 31200 raft_consensus.cc:359] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.714876 31200 raft_consensus.cc:385] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.715133 31200 raft_consensus.cc:740] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.715864 31200 consensus_queue.cc:260] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.717973 31200 ts_tablet_manager.cc:1434] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:22:22.719167 31203 tablet_bootstrap.cc:654] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.724872 31203 tablet_bootstrap.cc:492] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991: No bootstrap required, opened a new log
I20260709 12:22:22.725383 31203 ts_tablet_manager.cc:1403] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:22:22.727872 31203 raft_consensus.cc:359] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.728463 31203 raft_consensus.cc:385] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.728708 31203 raft_consensus.cc:740] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0101db16b54c0a8382e7e1c137f991, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.729310 31203 consensus_queue.cc:260] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.731061 31203 ts_tablet_manager.cc:1434] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:22.732926 31202 raft_consensus.cc:493] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.733526 31202 raft_consensus.cc:515] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.740691 31202 leader_election.cc:290] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:22.746165 31208 raft_consensus.cc:493] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.746835 31208 raft_consensus.cc:515] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.749908 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89" is_pre_election: true
I20260709 12:22:22.751000 31010 raft_consensus.cc:2468] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 0.
I20260709 12:22:22.753423 31125 leader_election.cc:304] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:22.753959 31208 leader_election.cc:290] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
I20260709 12:22:22.754418 31202 raft_consensus.cc:2804] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:22.754987 31202 raft_consensus.cc:493] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.755403 31202 raft_consensus.cc:3060] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.757063 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991" is_pre_election: true
I20260709 12:22:22.758024 31085 raft_consensus.cc:2468] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 0.
I20260709 12:22:22.764808 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "2c0101db16b54c0a8382e7e1c137f991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89" is_pre_election: true
I20260709 12:22:22.765400 31010 raft_consensus.cc:2468] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0101db16b54c0a8382e7e1c137f991 in term 0.
I20260709 12:22:22.766335 31202 raft_consensus.cc:515] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.766773 31051 leader_election.cc:304] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0101db16b54c0a8382e7e1c137f991, 66fe6e09dab3484baa7133e5c1772f89; no voters: 
I20260709 12:22:22.767817 31208 raft_consensus.cc:2804] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:22.768157 31208 raft_consensus.cc:493] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.768460 31208 raft_consensus.cc:3060] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.769104 31202 leader_election.cc:290] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 election: Requested vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:22.769955 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
I20260709 12:22:22.770413 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:22.770617 31010 raft_consensus.cc:3060] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.771926 31202 raft_consensus.cc:493] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.772511 31202 raft_consensus.cc:515] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.775671 31202 leader_election.cc:290] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:22.775578 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89" is_pre_election: true
I20260709 12:22:22.776393 31009 raft_consensus.cc:2468] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 0.
I20260709 12:22:22.777329 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991" is_pre_election: true
I20260709 12:22:22.777678 31125 leader_election.cc:304] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:22.778064 31084 raft_consensus.cc:2468] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 0.
I20260709 12:22:22.779740 31202 raft_consensus.cc:2804] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:22.780185 31202 raft_consensus.cc:493] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:22.780601 31202 raft_consensus.cc:3060] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.781807 31010 raft_consensus.cc:2468] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 1.
I20260709 12:22:22.782006 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "2c0101db16b54c0a8382e7e1c137f991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9e59759864644599762735ce07fa524" is_pre_election: true
I20260709 12:22:22.782816 31208 raft_consensus.cc:515] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.783984 31159 raft_consensus.cc:2393] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c0101db16b54c0a8382e7e1c137f991 in current term 1: Already voted for candidate f9e59759864644599762735ce07fa524 in this term.
I20260709 12:22:22.784340 31085 raft_consensus.cc:2393] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9e59759864644599762735ce07fa524 in current term 1: Already voted for candidate 2c0101db16b54c0a8382e7e1c137f991 in this term.
I20260709 12:22:22.785728 31208 leader_election.cc:290] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [CANDIDATE]: Term 1 election: Requested vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
I20260709 12:22:22.787708 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "2c0101db16b54c0a8382e7e1c137f991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
I20260709 12:22:22.788661 31009 raft_consensus.cc:2393] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c0101db16b54c0a8382e7e1c137f991 in current term 1: Already voted for candidate f9e59759864644599762735ce07fa524 in this term.
I20260709 12:22:22.788429 31125 leader_election.cc:304] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 2c0101db16b54c0a8382e7e1c137f991
I20260709 12:22:22.788897 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "2c0101db16b54c0a8382e7e1c137f991" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9e59759864644599762735ce07fa524"
I20260709 12:22:22.789881 31159 raft_consensus.cc:2393] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c0101db16b54c0a8382e7e1c137f991 in current term 1: Already voted for candidate f9e59759864644599762735ce07fa524 in this term.
I20260709 12:22:22.791128 31050 leader_election.cc:304] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c0101db16b54c0a8382e7e1c137f991; no voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524
I20260709 12:22:22.791649 31202 raft_consensus.cc:515] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.792392 31208 raft_consensus.cc:2749] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:22.792981 31213 raft_consensus.cc:2804] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:22.794102 31202 leader_election.cc:290] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 election: Requested vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:22.794719 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
I20260709 12:22:22.795397 31009 raft_consensus.cc:3060] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.795513 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:22.796357 31085 raft_consensus.cc:3060] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.800330 31213 raft_consensus.cc:697] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Becoming Leader. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:22.801276 31213 consensus_queue.cc:237] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.805900 31009 raft_consensus.cc:2468] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 1.
I20260709 12:22:22.806674 31085 raft_consensus.cc:2468] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 1.
I20260709 12:22:22.808075 31125 leader_election.cc:304] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:22.809033 31213 raft_consensus.cc:2804] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:22.809520 31213 raft_consensus.cc:697] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Becoming Leader. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:22.809602 30908 catalog_manager.cc:5697] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9e59759864644599762735ce07fa524 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "f9e59759864644599762735ce07fa524" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:22.810467 31213 consensus_queue.cc:237] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:22.822916 30908 catalog_manager.cc:5697] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9e59759864644599762735ce07fa524 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "f9e59759864644599762735ce07fa524" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:22.885453 30908 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47280:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:22.887722 30908 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:22.912387 30999 tablet_service.cc:1511] Processing CreateTablet for tablet 27c7f711cead4c6f89deb334caf791e1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a0d48ca0319043a1a9c515d0250e850c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:22.913276 31074 tablet_service.cc:1511] Processing CreateTablet for tablet 27c7f711cead4c6f89deb334caf791e1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a0d48ca0319043a1a9c515d0250e850c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:22.913827 30999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c7f711cead4c6f89deb334caf791e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.914711 31074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c7f711cead4c6f89deb334caf791e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.915323 31149 tablet_service.cc:1511] Processing CreateTablet for tablet 27c7f711cead4c6f89deb334caf791e1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a0d48ca0319043a1a9c515d0250e850c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:22.916579 31149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c7f711cead4c6f89deb334caf791e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.922817 31075 tablet_service.cc:1511] Processing CreateTablet for tablet 79ae30ebc1bf4c059f0d17afedf05b94 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a0d48ca0319043a1a9c515d0250e850c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:22.924247 31075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ae30ebc1bf4c059f0d17afedf05b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.924047 31000 tablet_service.cc:1511] Processing CreateTablet for tablet 79ae30ebc1bf4c059f0d17afedf05b94 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a0d48ca0319043a1a9c515d0250e850c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:22.925354 31000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ae30ebc1bf4c059f0d17afedf05b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.928942 31148 tablet_service.cc:1511] Processing CreateTablet for tablet 79ae30ebc1bf4c059f0d17afedf05b94 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a0d48ca0319043a1a9c515d0250e850c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:22.930212 31148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79ae30ebc1bf4c059f0d17afedf05b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.932281 31203 tablet_bootstrap.cc:492] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991: Bootstrap starting.
I20260709 12:22:22.939189 31203 tablet_bootstrap.cc:654] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.939937 31199 tablet_bootstrap.cc:492] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: Bootstrap starting.
I20260709 12:22:22.945803 31203 tablet_bootstrap.cc:492] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991: No bootstrap required, opened a new log
I20260709 12:22:22.946446 31199 tablet_bootstrap.cc:654] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.946727 31203 ts_tablet_manager.cc:1403] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:22:22.950170 31203 raft_consensus.cc:359] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.950974 31203 raft_consensus.cc:385] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.951319 31203 raft_consensus.cc:740] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0101db16b54c0a8382e7e1c137f991, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.952311 31203 consensus_queue.cc:260] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.954628 31203 ts_tablet_manager.cc:1434] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:22:22.955844 31203 tablet_bootstrap.cc:492] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991: Bootstrap starting.
I20260709 12:22:22.961112 31200 tablet_bootstrap.cc:492] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89: Bootstrap starting.
I20260709 12:22:22.962658 31203 tablet_bootstrap.cc:654] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.968827 31203 tablet_bootstrap.cc:492] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991: No bootstrap required, opened a new log
I20260709 12:22:22.969316 31203 ts_tablet_manager.cc:1403] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:22:22.969714 31200 tablet_bootstrap.cc:654] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.972849 31203 raft_consensus.cc:359] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.973897 31203 raft_consensus.cc:385] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.974361 31203 raft_consensus.cc:740] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0101db16b54c0a8382e7e1c137f991, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.975257 31203 consensus_queue.cc:260] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.975920 31200 tablet_bootstrap.cc:492] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89: No bootstrap required, opened a new log
I20260709 12:22:22.977972 31200 ts_tablet_manager.cc:1403] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:22:22.977993 31199 tablet_bootstrap.cc:492] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: No bootstrap required, opened a new log
I20260709 12:22:22.978777 31199 ts_tablet_manager.cc:1403] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.006s
I20260709 12:22:22.978976 31203 ts_tablet_manager.cc:1434] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:22.981647 31199 raft_consensus.cc:359] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.982414 31199 raft_consensus.cc:385] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.982669 31199 raft_consensus.cc:740] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.983451 31199 consensus_queue.cc:260] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.984313 31213 raft_consensus.cc:493] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.984789 31213 raft_consensus.cc:515] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.986191 31199 ts_tablet_manager.cc:1434] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:22.986406 31200 raft_consensus.cc:359] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.987329 31200 raft_consensus.cc:385] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.987381 31199 tablet_bootstrap.cc:492] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: Bootstrap starting.
I20260709 12:22:22.987746 31200 raft_consensus.cc:740] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.988737 31200 consensus_queue.cc:260] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:22.993204 31200 ts_tablet_manager.cc:1434] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:22:22.994279 31200 tablet_bootstrap.cc:492] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: Bootstrap starting.
I20260709 12:22:22.995486 31199 tablet_bootstrap.cc:654] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.997762 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89" is_pre_election: true
I20260709 12:22:22.998605 31009 raft_consensus.cc:2468] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 0.
I20260709 12:22:23.000001 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991" is_pre_election: true
I20260709 12:22:23.000393 31125 leader_election.cc:304] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:23.000726 31085 raft_consensus.cc:2468] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 0.
I20260709 12:22:23.001786 31200 tablet_bootstrap.cc:654] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.001789 31214 raft_consensus.cc:2804] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:23.002357 31214 raft_consensus.cc:493] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.002724 31214 raft_consensus.cc:3060] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.003278 31213 leader_election.cc:290] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:23.017359 31214 raft_consensus.cc:515] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.020553 31200 tablet_bootstrap.cc:492] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: No bootstrap required, opened a new log
I20260709 12:22:23.020651 31199 tablet_bootstrap.cc:492] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: No bootstrap required, opened a new log
I20260709 12:22:23.021237 31200 ts_tablet_manager.cc:1403] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:22:23.021381 31199 ts_tablet_manager.cc:1403] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.013s
I20260709 12:22:23.021076 31009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
I20260709 12:22:23.024529 31009 raft_consensus.cc:3060] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.024873 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:23.024930 31200 raft_consensus.cc:359] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.025202 31199 raft_consensus.cc:359] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.025686 31085 raft_consensus.cc:3060] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.025852 31200 raft_consensus.cc:385] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.026036 31199 raft_consensus.cc:385] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.026247 31200 raft_consensus.cc:740] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.026441 31199 raft_consensus.cc:740] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.027184 31200 consensus_queue.cc:260] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.027335 31199 consensus_queue.cc:260] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.029753 31200 ts_tablet_manager.cc:1434] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:23.032079 31199 ts_tablet_manager.cc:1434] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:23.035625 31009 raft_consensus.cc:2468] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 1.
I20260709 12:22:23.036801 31125 leader_election.cc:304] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:23.037756 31213 raft_consensus.cc:2804] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:23.038225 31213 raft_consensus.cc:697] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Becoming Leader. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:23.039084 31213 consensus_queue.cc:237] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.039736 31214 leader_election.cc:290] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 1 election: Requested vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:23.039757 31085 raft_consensus.cc:2468] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 1.
I20260709 12:22:23.048159 30908 catalog_manager.cc:5697] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9e59759864644599762735ce07fa524 (127.18.132.67). New cstate: current_term: 1 leader_uuid: "f9e59759864644599762735ce07fa524" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:23.074029 31207 raft_consensus.cc:493] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.074671 31207 raft_consensus.cc:515] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.077136 31207 leader_election.cc:290] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637), f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
I20260709 12:22:23.089669 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991" is_pre_election: true
I20260709 12:22:23.090327 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9e59759864644599762735ce07fa524" is_pre_election: true
I20260709 12:22:23.090624 31085 raft_consensus.cc:2468] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 0.
I20260709 12:22:23.091174 31159 raft_consensus.cc:2468] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 0.
I20260709 12:22:23.091995 30975 leader_election.cc:304] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0101db16b54c0a8382e7e1c137f991, 66fe6e09dab3484baa7133e5c1772f89; no voters: 
I20260709 12:22:23.092715 31207 raft_consensus.cc:2804] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:23.093160 31207 raft_consensus.cc:493] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.093479 31207 raft_consensus.cc:3060] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.100216 31207 raft_consensus.cc:515] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.103004 31207 leader_election.cc:290] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 1 election: Requested vote from peers 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637), f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
W20260709 12:22:23.103782 30956 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:23.103672 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:23.103996 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9e59759864644599762735ce07fa524"
I20260709 12:22:23.104765 31085 raft_consensus.cc:3060] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.104759 31159 raft_consensus.cc:3060] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.111475 31159 raft_consensus.cc:2468] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 1.
I20260709 12:22:23.111639 31085 raft_consensus.cc:2468] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 1.
I20260709 12:22:23.112735 30975 leader_election.cc:304] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:23.113721 31207 raft_consensus.cc:2804] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:23.114697 31207 raft_consensus.cc:697] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 LEADER]: Becoming Leader. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Running, Role: LEADER
I20260709 12:22:23.115483 31207 consensus_queue.cc:237] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.123603 30908 catalog_manager.cc:5697] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65). New cstate: current_term: 1 leader_uuid: "66fe6e09dab3484baa7133e5c1772f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.157764 31159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4"
dest_uuid: "f9e59759864644599762735ce07fa524"
mode: GRACEFUL
new_leader_uuid: "66fe6e09dab3484baa7133e5c1772f89"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:22:23.158382 31159 raft_consensus.cc:606] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Received request to transfer leadership to TS 66fe6e09dab3484baa7133e5c1772f89
I20260709 12:22:23.163875 31159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518"
dest_uuid: "f9e59759864644599762735ce07fa524"
mode: GRACEFUL
new_leader_uuid: "2c0101db16b54c0a8382e7e1c137f991"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:22:23.164347 31159 raft_consensus.cc:606] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Received request to transfer leadership to TS 2c0101db16b54c0a8382e7e1c137f991
I20260709 12:22:23.169708 31159 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1"
dest_uuid: "f9e59759864644599762735ce07fa524"
mode: GRACEFUL
new_leader_uuid: "66fe6e09dab3484baa7133e5c1772f89"
 from {username='slave'} at 127.0.0.1:52020
I20260709 12:22:23.170140 31159 raft_consensus.cc:606] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Received request to transfer leadership to TS 66fe6e09dab3484baa7133e5c1772f89
I20260709 12:22:23.279382 31213 consensus_queue.cc:1048] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:23.294574 31202 consensus_queue.cc:1048] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:23.302836 31202 consensus_queue.cc:1048] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:23.311704 31202 raft_consensus.cc:993] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: : Instructing follower 66fe6e09dab3484baa7133e5c1772f89 to start an election
I20260709 12:22:23.312934 31240 raft_consensus.cc:993] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: : Instructing follower 2c0101db16b54c0a8382e7e1c137f991 to start an election
I20260709 12:22:23.313623 31214 raft_consensus.cc:1081] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Signalling peer 2c0101db16b54c0a8382e7e1c137f991 to start an election
I20260709 12:22:23.313925 31202 raft_consensus.cc:1081] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Signalling peer 66fe6e09dab3484baa7133e5c1772f89 to start an election
I20260709 12:22:23.315716 31010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4"
dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
 from {username='slave'} at 127.0.0.1:39962
I20260709 12:22:23.316361 31010 raft_consensus.cc:493] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.316732 31010 raft_consensus.cc:3060] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.317495 31202 consensus_queue.cc:1048] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:23.325358 31085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518"
dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
 from {username='slave'} at 127.0.0.1:57964
I20260709 12:22:23.325865 31085 raft_consensus.cc:493] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.326203 31085 raft_consensus.cc:3060] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.334183 31010 raft_consensus.cc:515] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:23.336514 31010 leader_election.cc:290] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 2 election: Requested vote from peers f9e59759864644599762735ce07fa524 (127.18.132.67:36969), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:23.338136 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9e59759864644599762735ce07fa524"
I20260709 12:22:23.338778 31159 raft_consensus.cc:3055] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.339047 31159 raft_consensus.cc:740] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:23.340049 31084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcde650ffd46ecb2390785aaba5ac4" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:23.339823 31159 consensus_queue.cc:260] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:23.340170 31085 raft_consensus.cc:515] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.340754 31084 raft_consensus.cc:3060] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.341149 31159 raft_consensus.cc:3060] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.342533 31085 leader_election.cc:290] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [CANDIDATE]: Term 2 election: Requested vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
I20260709 12:22:23.344427 31158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "2c0101db16b54c0a8382e7e1c137f991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9e59759864644599762735ce07fa524"
I20260709 12:22:23.345047 31158 raft_consensus.cc:3055] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.345386 31158 raft_consensus.cc:740] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:23.346226 31158 consensus_queue.cc:260] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.347738 31158 raft_consensus.cc:3060] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.351315 31008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e9ba94d7594f2b85ea991d3eafe518" candidate_uuid: "2c0101db16b54c0a8382e7e1c137f991" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
I20260709 12:22:23.352097 31008 raft_consensus.cc:3060] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.353681 31084 raft_consensus.cc:2468] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 2.
I20260709 12:22:23.356593 30975 leader_election.cc:304] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0101db16b54c0a8382e7e1c137f991, 66fe6e09dab3484baa7133e5c1772f89; no voters: 
I20260709 12:22:23.357476 31207 raft_consensus.cc:2804] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:23.357981 31207 raft_consensus.cc:697] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 LEADER]: Becoming Leader. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Running, Role: LEADER
I20260709 12:22:23.358808 31207 consensus_queue.cc:237] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } }
I20260709 12:22:23.363907 31008 raft_consensus.cc:2468] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0101db16b54c0a8382e7e1c137f991 in term 2.
I20260709 12:22:23.365291 31051 leader_election.cc:304] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0101db16b54c0a8382e7e1c137f991, 66fe6e09dab3484baa7133e5c1772f89; no voters: 
I20260709 12:22:23.365725 31158 raft_consensus.cc:2468] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0101db16b54c0a8382e7e1c137f991 in term 2.
I20260709 12:22:23.366355 31208 raft_consensus.cc:2804] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:23.366658 30906 catalog_manager.cc:5697] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 reported cstate change: term changed from 1 to 2, leader changed from f9e59759864644599762735ce07fa524 (127.18.132.67) to 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "66fe6e09dab3484baa7133e5c1772f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.367861 31208 raft_consensus.cc:697] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 LEADER]: Becoming Leader. State: Replica: 2c0101db16b54c0a8382e7e1c137f991, State: Running, Role: LEADER
I20260709 12:22:23.368821 31208 consensus_queue.cc:237] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.370630 31159 raft_consensus.cc:2468] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 2.
I20260709 12:22:23.377168 30907 catalog_manager.cc:5697] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 reported cstate change: term changed from 1 to 2, leader changed from f9e59759864644599762735ce07fa524 (127.18.132.67) to 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "2c0101db16b54c0a8382e7e1c137f991" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.574179 31240 consensus_queue.cc:1048] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:23.580924 31202 raft_consensus.cc:993] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: : Instructing follower 66fe6e09dab3484baa7133e5c1772f89 to start an election
I20260709 12:22:23.581410 31213 raft_consensus.cc:1081] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Signalling peer 66fe6e09dab3484baa7133e5c1772f89 to start an election
I20260709 12:22:23.583621 31010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1"
dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
 from {username='slave'} at 127.0.0.1:39962
I20260709 12:22:23.584237 31010 raft_consensus.cc:493] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:23.584548 31010 raft_consensus.cc:3060] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.587237 31202 consensus_queue.cc:1048] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:23.591609 31207 consensus_queue.cc:1048] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:23.609953 31231 consensus_queue.cc:1048] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:23.616550 31010 raft_consensus.cc:515] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.617848 31008 raft_consensus.cc:1240] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Rejecting Update request from peer f9e59759864644599762735ce07fa524 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:23.618731 31010 leader_election.cc:290] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 2 election: Requested vote from peers 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637), f9e59759864644599762735ce07fa524 (127.18.132.67:36969)
I20260709 12:22:23.621106 31159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9e59759864644599762735ce07fa524"
I20260709 12:22:23.621835 31159 raft_consensus.cc:3055] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:23.622176 31159 raft_consensus.cc:740] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:23.622313 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c7f711cead4c6f89deb334caf791e1" candidate_uuid: "66fe6e09dab3484baa7133e5c1772f89" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:23.622933 31085 raft_consensus.cc:3060] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.623165 31159 consensus_queue.cc:260] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.624658 31159 raft_consensus.cc:3060] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.632714 31159 raft_consensus.cc:2468] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 2.
I20260709 12:22:23.633845 30975 leader_election.cc:304] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66fe6e09dab3484baa7133e5c1772f89, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:23.634756 31231 raft_consensus.cc:2804] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:23.635308 31231 raft_consensus.cc:697] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 LEADER]: Becoming Leader. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Running, Role: LEADER
I20260709 12:22:23.636301 31231 consensus_queue.cc:237] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:23.637117 31085 raft_consensus.cc:2468] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66fe6e09dab3484baa7133e5c1772f89 in term 2.
I20260709 12:22:23.644165 30906 catalog_manager.cc:5697] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 reported cstate change: term changed from 1 to 2, leader changed from f9e59759864644599762735ce07fa524 (127.18.132.67) to 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65). New cstate: current_term: 2 leader_uuid: "66fe6e09dab3484baa7133e5c1772f89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:23.841930 31008 raft_consensus.cc:1275] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Refusing update from remote peer 2c0101db16b54c0a8382e7e1c137f991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:23.843359 31208 consensus_queue.cc:1048] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.852242 31159 raft_consensus.cc:1275] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Refusing update from remote peer 2c0101db16b54c0a8382e7e1c137f991: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:23.854691 31248 consensus_queue.cc:1048] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.923460 31159 raft_consensus.cc:1275] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Refusing update from remote peer 66fe6e09dab3484baa7133e5c1772f89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:23.925146 31231 consensus_queue.cc:1048] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.932932 18961 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:22:23.935153 31085 raft_consensus.cc:1275] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Refusing update from remote peer 66fe6e09dab3484baa7133e5c1772f89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:23.936064 18961 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:22:23.936739 18961 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:22:23.937281 31231 consensus_queue.cc:1048] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:23.969177 31008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94"
dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
mode: GRACEFUL
new_leader_uuid: "f9e59759864644599762735ce07fa524"
 from {username='slave'} at 127.0.0.1:39970
I20260709 12:22:23.969763 31008 raft_consensus.cc:606] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 LEADER]: Received request to transfer leadership to TS f9e59759864644599762735ce07fa524
I20260709 12:22:23.971053 18961 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:22:24.043164 31085 raft_consensus.cc:1275] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Refusing update from remote peer 66fe6e09dab3484baa7133e5c1772f89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:24.044580 31249 consensus_queue.cc:1048] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:24.052794 31159 raft_consensus.cc:1275] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Refusing update from remote peer 66fe6e09dab3484baa7133e5c1772f89: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:24.054545 31250 consensus_queue.cc:1048] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:24.123543 31207 raft_consensus.cc:993] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: : Instructing follower f9e59759864644599762735ce07fa524 to start an election
I20260709 12:22:24.124156 31250 raft_consensus.cc:1081] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 LEADER]: Signalling peer f9e59759864644599762735ce07fa524 to start an election
I20260709 12:22:24.125551 31159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94"
dest_uuid: "f9e59759864644599762735ce07fa524"
 from {username='slave'} at 127.0.0.1:52018
I20260709 12:22:24.126029 31159 raft_consensus.cc:493] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:24.126263 31159 raft_consensus.cc:3060] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.131943 31159 raft_consensus.cc:515] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:24.133522 31159 leader_election.cc:290] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 2 election: Requested vote from peers 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65:37047), 2c0101db16b54c0a8382e7e1c137f991 (127.18.132.66:44637)
I20260709 12:22:24.134457 31008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66fe6e09dab3484baa7133e5c1772f89"
I20260709 12:22:24.134752 31085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79ae30ebc1bf4c059f0d17afedf05b94" candidate_uuid: "f9e59759864644599762735ce07fa524" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c0101db16b54c0a8382e7e1c137f991"
I20260709 12:22:24.135288 31008 raft_consensus.cc:3055] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.135340 31085 raft_consensus.cc:3060] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.135747 31008 raft_consensus.cc:740] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66fe6e09dab3484baa7133e5c1772f89, State: Running, Role: LEADER
I20260709 12:22:24.136679 31008 consensus_queue.cc:260] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:24.138056 31008 raft_consensus.cc:3060] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.143216 31085 raft_consensus.cc:2468] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 2.
I20260709 12:22:24.144585 31124 leader_election.cc:304] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0101db16b54c0a8382e7e1c137f991, f9e59759864644599762735ce07fa524; no voters: 
I20260709 12:22:24.145370 31202 raft_consensus.cc:2804] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:24.145638 31008 raft_consensus.cc:2468] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e59759864644599762735ce07fa524 in term 2.
I20260709 12:22:24.146437 31202 raft_consensus.cc:697] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 2 LEADER]: Becoming Leader. State: Replica: f9e59759864644599762735ce07fa524, State: Running, Role: LEADER
I20260709 12:22:24.147419 31202 consensus_queue.cc:237] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } }
I20260709 12:22:24.154258 30907 catalog_manager.cc:5697] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 reported cstate change: term changed from 1 to 2, leader changed from 66fe6e09dab3484baa7133e5c1772f89 (127.18.132.65) to f9e59759864644599762735ce07fa524 (127.18.132.67). New cstate: current_term: 2 leader_uuid: "f9e59759864644599762735ce07fa524" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66fe6e09dab3484baa7133e5c1772f89" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 37047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0101db16b54c0a8382e7e1c137f991" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 44637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9e59759864644599762735ce07fa524" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 36969 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:24.187391 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
I20260709 12:22:24.210352 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:24.211081 18961 tablet_replica.cc:333] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89: stopping tablet replica
I20260709 12:22:24.211946 18961 raft_consensus.cc:2243] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.212404 18961 raft_consensus.cc:2272] T 79ae30ebc1bf4c059f0d17afedf05b94 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.214807 18961 tablet_replica.cc:333] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89: stopping tablet replica
I20260709 12:22:24.215430 18961 raft_consensus.cc:2243] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:24.216367 18961 raft_consensus.cc:2272] T 27c7f711cead4c6f89deb334caf791e1 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.218713 18961 tablet_replica.cc:333] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89: stopping tablet replica
I20260709 12:22:24.219265 18961 raft_consensus.cc:2243] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:24.220185 18961 raft_consensus.cc:2272] T 8edcde650ffd46ecb2390785aaba5ac4 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.222383 18961 tablet_replica.cc:333] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89: stopping tablet replica
I20260709 12:22:24.222910 18961 raft_consensus.cc:2243] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.223359 18961 raft_consensus.cc:2272] T e0e9ba94d7594f2b85ea991d3eafe518 P 66fe6e09dab3484baa7133e5c1772f89 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.247756 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
I20260709 12:22:24.262884 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
I20260709 12:22:24.286201 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:24.286913 18961 tablet_replica.cc:333] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991: stopping tablet replica
I20260709 12:22:24.287557 18961 raft_consensus.cc:2243] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.288136 18961 raft_consensus.cc:2272] T 79ae30ebc1bf4c059f0d17afedf05b94 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.290581 18961 tablet_replica.cc:333] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991: stopping tablet replica
I20260709 12:22:24.291177 18961 raft_consensus.cc:2243] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.291706 18961 raft_consensus.cc:2272] T 27c7f711cead4c6f89deb334caf791e1 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.294191 18961 tablet_replica.cc:333] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991: stopping tablet replica
I20260709 12:22:24.294750 18961 raft_consensus.cc:2243] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:24.295738 18961 raft_consensus.cc:2272] T e0e9ba94d7594f2b85ea991d3eafe518 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.298286 18961 tablet_replica.cc:333] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991: stopping tablet replica
I20260709 12:22:24.298784 18961 raft_consensus.cc:2243] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.299292 18961 raft_consensus.cc:2272] T 8edcde650ffd46ecb2390785aaba5ac4 P 2c0101db16b54c0a8382e7e1c137f991 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.323199 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
I20260709 12:22:24.337523 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
I20260709 12:22:24.356009 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:24.356720 18961 tablet_replica.cc:333] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: stopping tablet replica
I20260709 12:22:24.357352 18961 raft_consensus.cc:2243] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:24.358055 18961 pending_rounds.cc:70] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: Trying to abort 1 pending ops.
I20260709 12:22:24.358271 18961 pending_rounds.cc:77] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624552035352576 op_type: NO_OP noop_request { }
I20260709 12:22:24.358590 18961 raft_consensus.cc:2889] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:24.358891 18961 raft_consensus.cc:2272] T 79ae30ebc1bf4c059f0d17afedf05b94 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.361464 18961 tablet_replica.cc:333] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524: stopping tablet replica
I20260709 12:22:24.362023 18961 raft_consensus.cc:2243] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.362484 18961 raft_consensus.cc:2272] T 27c7f711cead4c6f89deb334caf791e1 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.364771 18961 tablet_replica.cc:333] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524: stopping tablet replica
I20260709 12:22:24.365325 18961 raft_consensus.cc:2243] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.365780 18961 raft_consensus.cc:2272] T e0e9ba94d7594f2b85ea991d3eafe518 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.368052 18961 tablet_replica.cc:333] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524: stopping tablet replica
I20260709 12:22:24.368561 18961 raft_consensus.cc:2243] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:24.369010 18961 raft_consensus.cc:2272] T 8edcde650ffd46ecb2390785aaba5ac4 P f9e59759864644599762735ce07fa524 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.392383 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
I20260709 12:22:24.406632 18961 master.cc:562] Master@127.18.132.126:34739 shutting down...
I20260709 12:22:24.425508 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:24.426144 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:24.426499 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P f2f24edcea4943fc8e6ef83c70a9bec8: stopping tablet replica
I20260709 12:22:24.445713 18961 master.cc:584] Master@127.18.132.126:34739 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2523 ms)
[----------] 6 tests from LeaderRebalancerTest (395747 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:22:24.479468 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:38887
I20260709 12:22:24.480722 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:24.486171 31257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.486863 31258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.487766 31260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:24.488554 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:24.489362 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:24.489543 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:24.489653 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599744489643 us; error 0 us; skew 500 ppm
I20260709 12:22:24.490135 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:24.492744 18961 webserver.cc:533] Webserver started at http://127.18.132.126:44151/ using document root <none> and password file <none>
I20260709 12:22:24.493209 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:24.493363 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:24.493575 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:24.494690 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "c4c10e27db464effb8b56106b78e149f"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.499310 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:22:24.502786 31265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.503619 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:24.503924 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "c4c10e27db464effb8b56106b78e149f"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.504258 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:24.522056 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:24.523125 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:24.562816 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:38887
I20260709 12:22:24.562930 31316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:38887 every 8 connection(s)
I20260709 12:22:24.567029 31317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:24.580430 31317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f: Bootstrap starting.
I20260709 12:22:24.585279 31317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.589365 31317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f: No bootstrap required, opened a new log
I20260709 12:22:24.591507 31317 raft_consensus.cc:359] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c10e27db464effb8b56106b78e149f" member_type: VOTER }
I20260709 12:22:24.591915 31317 raft_consensus.cc:385] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.592099 31317 raft_consensus.cc:740] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4c10e27db464effb8b56106b78e149f, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.592633 31317 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c10e27db464effb8b56106b78e149f" member_type: VOTER }
I20260709 12:22:24.593063 31317 raft_consensus.cc:399] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:24.593248 31317 raft_consensus.cc:493] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:24.593458 31317 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.598548 31317 raft_consensus.cc:515] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c10e27db464effb8b56106b78e149f" member_type: VOTER }
I20260709 12:22:24.599028 31317 leader_election.cc:304] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4c10e27db464effb8b56106b78e149f; no voters: 
I20260709 12:22:24.600221 31317 leader_election.cc:290] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:24.600616 31320 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.602231 31320 raft_consensus.cc:697] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 1 LEADER]: Becoming Leader. State: Replica: c4c10e27db464effb8b56106b78e149f, State: Running, Role: LEADER
I20260709 12:22:24.602887 31320 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c10e27db464effb8b56106b78e149f" member_type: VOTER }
I20260709 12:22:24.603294 31317 sys_catalog.cc:565] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:24.608358 31322 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4c10e27db464effb8b56106b78e149f. Latest consensus state: current_term: 1 leader_uuid: "c4c10e27db464effb8b56106b78e149f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c10e27db464effb8b56106b78e149f" member_type: VOTER } }
I20260709 12:22:24.608826 31321 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4c10e27db464effb8b56106b78e149f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4c10e27db464effb8b56106b78e149f" member_type: VOTER } }
I20260709 12:22:24.609196 31322 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:24.609627 31321 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:24.612355 31328 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:24.617619 31328 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:24.620733 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:24.627884 31328 catalog_manager.cc:1383] Generated new cluster ID: 7423d2a706ce444aa5cd86abfc09b55e
I20260709 12:22:24.628188 31328 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:24.660148 31328 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:24.661690 31328 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:24.679049 31328 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f: Generated new TSK 0
I20260709 12:22:24.679798 31328 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:24.691452 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:24.698164 31338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.699208 31339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.701517 31341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:24.702510 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:24.703609 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:24.703824 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:24.703999 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599744703962 us; error 0 us; skew 500 ppm
I20260709 12:22:24.704603 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:24.707659 18961 webserver.cc:533] Webserver started at http://127.18.132.65:41721/ using document root <none> and password file <none>
I20260709 12:22:24.708171 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:24.708436 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:24.708746 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:24.709939 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.714918 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:22:24.718734 31346 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.719787 18961 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:24.720108 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.720435 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:24.737363 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:24.738610 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:24.740360 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:24.742949 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:24.743177 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.743424 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:24.743633 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:24.786494 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:39611
I20260709 12:22:24.786620 31409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:39611 every 8 connection(s)
I20260709 12:22:24.792182 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:24.799213 31414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.801083 31415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:24.803205 18961 server_base.cc:1061] running on GCE node
W20260709 12:22:24.803714 31417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:24.805572 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:24.805806 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:24.806051 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599744806026 us; error 0 us; skew 500 ppm
I20260709 12:22:24.806097 31410 heartbeater.cc:344] Connected to a master server at 127.18.132.126:38887
I20260709 12:22:24.806607 31410 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:24.806721 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:24.807514 31410 heartbeater.cc:507] Master 127.18.132.126:38887 requested a full tablet report, sending...
I20260709 12:22:24.809753 18961 webserver.cc:533] Webserver started at http://127.18.132.66:38171/ using document root <none> and password file <none>
I20260709 12:22:24.809963 31282 ts_manager.cc:194] Registered new tserver with Master: 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611)
I20260709 12:22:24.810436 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:24.810719 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:24.811017 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:24.812103 31282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48732
I20260709 12:22:24.812249 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "01dd6da1ae404576a76d694869fc9750"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.817296 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:24.820679 31422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.821442 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:24.821767 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "01dd6da1ae404576a76d694869fc9750"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.822074 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:24.832760 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:24.833884 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:24.835358 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:24.837764 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:24.837999 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.838251 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:24.838428 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.885731 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:36267
I20260709 12:22:24.885860 31484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:36267 every 8 connection(s)
I20260709 12:22:24.891146 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:24.899014 31488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.900218 31489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:24.902534 31491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:24.902791 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:24.904054 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:24.904342 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:24.904551 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599744904529 us; error 0 us; skew 500 ppm
I20260709 12:22:24.905228 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:24.905539 31485 heartbeater.cc:344] Connected to a master server at 127.18.132.126:38887
I20260709 12:22:24.906036 31485 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:24.907002 31485 heartbeater.cc:507] Master 127.18.132.126:38887 requested a full tablet report, sending...
I20260709 12:22:24.908049 18961 webserver.cc:533] Webserver started at http://127.18.132.67:45227/ using document root <none> and password file <none>
I20260709 12:22:24.908716 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:24.908934 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:24.909215 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:24.909233 31282 ts_manager.cc:194] Registered new tserver with Master: 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:24.910485 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "9eae65ab07f6425297e6b87360b844fd"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.910952 31282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48734
I20260709 12:22:24.915266 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 12:22:24.919394 31496 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.920234 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:24.920537 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "9eae65ab07f6425297e6b87360b844fd"
format_stamp: "Formatted at 2026-07-09 12:22:24 on dist-test-slave-xbvc"
I20260709 12:22:24.920849 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:24.945510 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:24.946727 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:24.948344 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:24.950825 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:24.951052 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.951293 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:24.951467 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:24.996569 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:37267
I20260709 12:22:24.996665 31558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:37267 every 8 connection(s)
I20260709 12:22:25.012040 31559 heartbeater.cc:344] Connected to a master server at 127.18.132.126:38887
I20260709 12:22:25.012537 31559 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:25.013294 31559 heartbeater.cc:507] Master 127.18.132.126:38887 requested a full tablet report, sending...
I20260709 12:22:25.015323 31282 ts_manager.cc:194] Registered new tserver with Master: 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.016204 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015812162s
I20260709 12:22:25.016824 31282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48750
I20260709 12:22:25.042518 31282 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48764:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:25.045360 31282 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:25.119102 31524 tablet_service.cc:1511] Processing CreateTablet for tablet f2722ac415d549faa1fabd2749db3f81 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:25.120790 31524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2722ac415d549faa1fabd2749db3f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.124262 31523 tablet_service.cc:1511] Processing CreateTablet for tablet b986577335a348c883f0c6c9b9f7a789 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:25.125828 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b986577335a348c883f0c6c9b9f7a789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.126729 31450 tablet_service.cc:1511] Processing CreateTablet for tablet f2722ac415d549faa1fabd2749db3f81 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:25.127504 31448 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9bdacf1dd14e0da7b2a4fff1cef146 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:25.128187 31450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2722ac415d549faa1fabd2749db3f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.129173 31448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9bdacf1dd14e0da7b2a4fff1cef146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.130936 31449 tablet_service.cc:1511] Processing CreateTablet for tablet b986577335a348c883f0c6c9b9f7a789 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:25.131217 31447 tablet_service.cc:1511] Processing CreateTablet for tablet ffed97c67b394156b3d2f394d5f9683b (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:25.132474 31449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b986577335a348c883f0c6c9b9f7a789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.133198 31447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffed97c67b394156b3d2f394d5f9683b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.135301 31446 tablet_service.cc:1511] Processing CreateTablet for tablet d823a306626d49339205b1d3c96988bd (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:25.136729 31446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d823a306626d49339205b1d3c96988bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.136804 31522 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9bdacf1dd14e0da7b2a4fff1cef146 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:25.138437 31522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9bdacf1dd14e0da7b2a4fff1cef146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.140812 31521 tablet_service.cc:1511] Processing CreateTablet for tablet ffed97c67b394156b3d2f394d5f9683b (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:25.142104 31520 tablet_service.cc:1511] Processing CreateTablet for tablet d823a306626d49339205b1d3c96988bd (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:25.142647 31521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffed97c67b394156b3d2f394d5f9683b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.143877 31520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d823a306626d49339205b1d3c96988bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.146216 31445 tablet_service.cc:1511] Processing CreateTablet for tablet b92c02e4234a41ada8be4b831541c0c0 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:25.147799 31445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92c02e4234a41ada8be4b831541c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.155368 31519 tablet_service.cc:1511] Processing CreateTablet for tablet b92c02e4234a41ada8be4b831541c0c0 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:25.156836 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92c02e4234a41ada8be4b831541c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.160784 31444 tablet_service.cc:1511] Processing CreateTablet for tablet 1946d02b4477418db137ece17af0fa38 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:25.162252 31444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1946d02b4477418db137ece17af0fa38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.165162 31518 tablet_service.cc:1511] Processing CreateTablet for tablet 1946d02b4477418db137ece17af0fa38 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:25.166586 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1946d02b4477418db137ece17af0fa38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.167819 31443 tablet_service.cc:1511] Processing CreateTablet for tablet 7f955bce464f4a3d8b537eff14ebe805 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:25.169402 31443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f955bce464f4a3d8b537eff14ebe805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.173216 31517 tablet_service.cc:1511] Processing CreateTablet for tablet 7f955bce464f4a3d8b537eff14ebe805 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:25.174607 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f955bce464f4a3d8b537eff14ebe805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.176084 31442 tablet_service.cc:1511] Processing CreateTablet for tablet 47c87e7aed8f4af98f22e77b6cc0c24c (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:25.177466 31442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c87e7aed8f4af98f22e77b6cc0c24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.181162 31516 tablet_service.cc:1511] Processing CreateTablet for tablet 47c87e7aed8f4af98f22e77b6cc0c24c (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:25.182547 31516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c87e7aed8f4af98f22e77b6cc0c24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.220309 31374 tablet_service.cc:1511] Processing CreateTablet for tablet f2722ac415d549faa1fabd2749db3f81 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:25.221972 31374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2722ac415d549faa1fabd2749db3f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.224306 31373 tablet_service.cc:1511] Processing CreateTablet for tablet b986577335a348c883f0c6c9b9f7a789 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:25.226186 31373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b986577335a348c883f0c6c9b9f7a789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.228557 31372 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9bdacf1dd14e0da7b2a4fff1cef146 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:25.229945 31372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9bdacf1dd14e0da7b2a4fff1cef146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.235510 31367 tablet_service.cc:1511] Processing CreateTablet for tablet 7f955bce464f4a3d8b537eff14ebe805 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:25.236958 31367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f955bce464f4a3d8b537eff14ebe805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.236601 31371 tablet_service.cc:1511] Processing CreateTablet for tablet ffed97c67b394156b3d2f394d5f9683b (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:25.237982 31371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffed97c67b394156b3d2f394d5f9683b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.239073 31366 tablet_service.cc:1511] Processing CreateTablet for tablet 47c87e7aed8f4af98f22e77b6cc0c24c (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:25.240473 31366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c87e7aed8f4af98f22e77b6cc0c24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.240629 31370 tablet_service.cc:1511] Processing CreateTablet for tablet d823a306626d49339205b1d3c96988bd (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:25.241945 31370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d823a306626d49339205b1d3c96988bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.244589 31369 tablet_service.cc:1511] Processing CreateTablet for tablet b92c02e4234a41ada8be4b831541c0c0 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:25.245899 31369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92c02e4234a41ada8be4b831541c0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.248584 31368 tablet_service.cc:1511] Processing CreateTablet for tablet 1946d02b4477418db137ece17af0fa38 (DEFAULT_TABLE table=test-workload [id=a007197e95e4465b922627db078d9389]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:25.249964 31368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1946d02b4477418db137ece17af0fa38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:25.309202 31574 tablet_bootstrap.cc:492] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.356737 31575 tablet_bootstrap.cc:492] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.364420 31575 tablet_bootstrap.cc:654] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.369177 31574 tablet_bootstrap.cc:654] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.379451 31576 tablet_bootstrap.cc:492] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.381362 31575 tablet_bootstrap.cc:492] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.381994 31575 ts_tablet_manager.cc:1403] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 12:22:25.387846 31576 tablet_bootstrap.cc:654] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.389243 31575 raft_consensus.cc:359] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.390180 31575 raft_consensus.cc:385] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.390519 31575 raft_consensus.cc:740] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.391583 31575 consensus_queue.cc:260] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.394716 31485 heartbeater.cc:499] Master 127.18.132.126:38887 was elected leader, sending a full tablet report...
I20260709 12:22:25.395503 31576 tablet_bootstrap.cc:492] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.395438 31574 tablet_bootstrap.cc:492] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.395393 31575 ts_tablet_manager.cc:1434] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:22:25.396415 31574 ts_tablet_manager.cc:1403] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.008s
I20260709 12:22:25.397082 31575 tablet_bootstrap.cc:492] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.397758 31576 ts_tablet_manager.cc:1403] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.014s
I20260709 12:22:25.399916 31574 raft_consensus.cc:359] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.400867 31574 raft_consensus.cc:385] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.401288 31574 raft_consensus.cc:740] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.402422 31574 consensus_queue.cc:260] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.404251 31575 tablet_bootstrap.cc:654] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.405275 31576 raft_consensus.cc:359] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.406348 31576 raft_consensus.cc:385] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.406690 31576 raft_consensus.cc:740] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.407543 31576 consensus_queue.cc:260] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.413434 31574 ts_tablet_manager.cc:1434] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:22:25.414597 31559 heartbeater.cc:499] Master 127.18.132.126:38887 was elected leader, sending a full tablet report...
I20260709 12:22:25.417239 31410 heartbeater.cc:499] Master 127.18.132.126:38887 was elected leader, sending a full tablet report...
I20260709 12:22:25.417362 31576 ts_tablet_manager.cc:1434] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.009s
I20260709 12:22:25.419064 31575 tablet_bootstrap.cc:492] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.419716 31575 ts_tablet_manager.cc:1403] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:22:25.422777 31576 tablet_bootstrap.cc:492] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.423484 31575 raft_consensus.cc:359] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.424465 31575 raft_consensus.cc:385] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.424872 31575 raft_consensus.cc:740] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.426016 31575 consensus_queue.cc:260] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.428694 31575 ts_tablet_manager.cc:1434] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:25.429517 31576 tablet_bootstrap.cc:654] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.429993 31575 tablet_bootstrap.cc:492] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.432358 31574 tablet_bootstrap.cc:492] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.437188 31575 tablet_bootstrap.cc:654] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.443600 31576 tablet_bootstrap.cc:492] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.443758 31574 tablet_bootstrap.cc:654] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.444308 31576 ts_tablet_manager.cc:1403] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.003s
I20260709 12:22:25.445259 31575 tablet_bootstrap.cc:492] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.445833 31575 ts_tablet_manager.cc:1403] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:22:25.447999 31576 raft_consensus.cc:359] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.448925 31576 raft_consensus.cc:385] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.448866 31575 raft_consensus.cc:359] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.449604 31576 raft_consensus.cc:740] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.449903 31575 raft_consensus.cc:385] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.450739 31575 raft_consensus.cc:740] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.450817 31576 consensus_queue.cc:260] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.451946 31575 consensus_queue.cc:260] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.454178 31576 ts_tablet_manager.cc:1434] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:25.455766 31576 tablet_bootstrap.cc:492] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.454281 31575 ts_tablet_manager.cc:1434] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:25.458904 31575 tablet_bootstrap.cc:492] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.463907 31576 tablet_bootstrap.cc:654] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.465934 31575 tablet_bootstrap.cc:654] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.470472 31574 tablet_bootstrap.cc:492] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.471261 31574 ts_tablet_manager.cc:1403] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.011s
I20260709 12:22:25.475124 31574 raft_consensus.cc:359] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.476006 31574 raft_consensus.cc:385] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.476339 31574 raft_consensus.cc:740] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.476653 31576 tablet_bootstrap.cc:492] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.477267 31576 ts_tablet_manager.cc:1403] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:22:25.477357 31574 consensus_queue.cc:260] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.480916 31576 raft_consensus.cc:359] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.481577 31574 ts_tablet_manager.cc:1434] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:22:25.481930 31576 raft_consensus.cc:385] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.482362 31576 raft_consensus.cc:740] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.482789 31574 tablet_bootstrap.cc:492] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.482837 31575 tablet_bootstrap.cc:492] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.483649 31575 ts_tablet_manager.cc:1403] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 12:22:25.483530 31576 consensus_queue.cc:260] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.487231 31575 raft_consensus.cc:359] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.488054 31575 raft_consensus.cc:385] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.488396 31575 raft_consensus.cc:740] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.489060 31576 ts_tablet_manager.cc:1434] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:22:25.489480 31575 consensus_queue.cc:260] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.490473 31576 tablet_bootstrap.cc:492] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.491531 31574 tablet_bootstrap.cc:654] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.496805 31575 ts_tablet_manager.cc:1434] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:22:25.498085 31575 tablet_bootstrap.cc:492] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.499027 31576 tablet_bootstrap.cc:654] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.505772 31575 tablet_bootstrap.cc:654] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.511442 31580 raft_consensus.cc:493] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.512166 31580 raft_consensus.cc:515] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.513520 31576 tablet_bootstrap.cc:492] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.514076 31576 ts_tablet_manager.cc:1403] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 12:22:25.520071 31580 leader_election.cc:290] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.520304 31576 raft_consensus.cc:359] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.521236 31576 raft_consensus.cc:385] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.521582 31576 raft_consensus.cc:740] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.522746 31576 consensus_queue.cc:260] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.524716 31575 tablet_bootstrap.cc:492] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.525597 31575 ts_tablet_manager.cc:1403] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 12:22:25.525929 31576 ts_tablet_manager.cc:1434] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:22:25.527192 31576 tablet_bootstrap.cc:492] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.529525 31575 raft_consensus.cc:359] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.531172 31575 raft_consensus.cc:385] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.534559 31576 tablet_bootstrap.cc:654] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.531806 31575 raft_consensus.cc:740] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.538728 31575 consensus_queue.cc:260] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.540731 31574 tablet_bootstrap.cc:492] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.541584 31574 ts_tablet_manager.cc:1403] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.021s
I20260709 12:22:25.544390 31575 ts_tablet_manager.cc:1434] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:22:25.545699 31575 tablet_bootstrap.cc:492] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.545921 31574 raft_consensus.cc:359] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.547122 31574 raft_consensus.cc:385] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.547601 31574 raft_consensus.cc:740] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.548872 31574 consensus_queue.cc:260] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.552484 31574 ts_tablet_manager.cc:1434] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:22:25.553712 31575 tablet_bootstrap.cc:654] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.553956 31574 tablet_bootstrap.cc:492] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.560266 31581 raft_consensus.cc:493] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.561034 31581 raft_consensus.cc:515] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.564729 31574 tablet_bootstrap.cc:654] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.587230 31581 leader_election.cc:290] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:25.588783 31580 raft_consensus.cc:493] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.603389 31575 tablet_bootstrap.cc:492] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.604159 31575 ts_tablet_manager.cc:1403] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.034s
I20260709 12:22:25.600232 31580 raft_consensus.cc:515] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.609277 31583 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.608222 31576 tablet_bootstrap.cc:492] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.610332 31574 tablet_bootstrap.cc:492] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.616935 31574 ts_tablet_manager.cc:1403] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.021s
I20260709 12:22:25.615386 31583 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.618109 31580 leader_election.cc:290] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267), 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611)
I20260709 12:22:25.618693 31580 raft_consensus.cc:493] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.619163 31330 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:25.619647 31583 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.619133 31580 raft_consensus.cc:515] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.624244 31580 leader_election.cc:290] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.625846 31576 ts_tablet_manager.cc:1403] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.099s	user 0.031s	sys 0.024s
I20260709 12:22:25.639675 31574 raft_consensus.cc:359] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.640625 31574 raft_consensus.cc:385] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.640941 31574 raft_consensus.cc:740] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.641764 31574 consensus_queue.cc:260] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.644199 31574 ts_tablet_manager.cc:1434] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:25.646086 31576 raft_consensus.cc:359] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.650004 31575 raft_consensus.cc:359] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.651141 31575 raft_consensus.cc:385] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.651516 31575 raft_consensus.cc:740] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.647284 31576 raft_consensus.cc:385] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.655036 31575 consensus_queue.cc:260] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.656692 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d823a306626d49339205b1d3c96988bd" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.657079 31534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d823a306626d49339205b1d3c96988bd" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.657533 31384 raft_consensus.cc:2468] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.658031 31575 ts_tablet_manager.cc:1434] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:22:25.658674 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2722ac415d549faa1fabd2749db3f81" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.659006 31575 tablet_bootstrap.cc:492] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.660156 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.662256 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2722ac415d549faa1fabd2749db3f81" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.663748 31574 tablet_bootstrap.cc:492] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
W20260709 12:22:25.664532 31424 leader_election.cc:343] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.664568 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
W20260709 12:22:25.665516 31424 leader_election.cc:343] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:25.666365 31424 leader_election.cc:343] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.666491 31425 leader_election.cc:304] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.667940 31599 raft_consensus.cc:2804] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:22:25.668181 31425 leader_election.cc:343] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.668388 31599 raft_consensus.cc:493] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.668706 31425 leader_election.cc:304] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750; no voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.668857 31599 raft_consensus.cc:3060] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.669533 31580 raft_consensus.cc:2749] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:25.672607 31574 tablet_bootstrap.cc:654] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.672361 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
W20260709 12:22:25.674557 31497 leader_election.cc:343] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:25.670835 31425 leader_election.cc:343] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.675297 31425 leader_election.cc:304] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750; no voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.676067 31580 raft_consensus.cc:2749] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:25.653146 31576 raft_consensus.cc:740] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.683851 31576 consensus_queue.cc:260] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.686405 31576 ts_tablet_manager.cc:1434] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:22:25.687507 31576 tablet_bootstrap.cc:492] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.687886 31575 tablet_bootstrap.cc:654] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.690764 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.692257 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
W20260709 12:22:25.693852 31348 leader_election.cc:343] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.694242 31599 raft_consensus.cc:515] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
W20260709 12:22:25.694772 31499 leader_election.cc:343] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.695282 31499 leader_election.cc:304] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9eae65ab07f6425297e6b87360b844fd; no voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:25.697160 31599 leader_election.cc:290] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.697193 31581 raft_consensus.cc:2749] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:25.700536 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d823a306626d49339205b1d3c96988bd" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:25.701458 31384 raft_consensus.cc:3060] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.701905 31574 tablet_bootstrap.cc:492] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.702494 31574 ts_tablet_manager.cc:1403] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.002s
I20260709 12:22:25.703987 31576 tablet_bootstrap.cc:654] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.703946 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d823a306626d49339205b1d3c96988bd" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.706028 31574 raft_consensus.cc:359] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
W20260709 12:22:25.706418 31424 leader_election.cc:343] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.706890 31574 raft_consensus.cc:385] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.707332 31574 raft_consensus.cc:740] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.708386 31574 consensus_queue.cc:260] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.717422 31574 ts_tablet_manager.cc:1434] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.009s
I20260709 12:22:25.718703 31574 tablet_bootstrap.cc:492] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.721410 31599 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.722067 31599 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.723821 31384 raft_consensus.cc:2468] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:25.724558 31599 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.725656 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
W20260709 12:22:25.727279 31424 leader_election.cc:343] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.728560 31425 leader_election.cc:304] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.729228 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.729907 31383 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.730013 31599 raft_consensus.cc:2804] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:25.730517 31599 raft_consensus.cc:697] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:25.731446 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:25.731434 31599 consensus_queue.cc:237] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.732260 31460 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:25.733673 31425 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.735147 31574 tablet_bootstrap.cc:654] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.734882 31347 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.735682 31580 raft_consensus.cc:2804] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.736078 31580 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.736449 31580 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.739761 31575 tablet_bootstrap.cc:492] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.739879 31583 raft_consensus.cc:2804] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.740669 31583 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.740742 31575 ts_tablet_manager.cc:1403] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.017s
I20260709 12:22:25.741199 31583 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.745386 31575 raft_consensus.cc:359] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.746542 31575 raft_consensus.cc:385] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.746901 31575 raft_consensus.cc:740] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.747217 31610 raft_consensus.cc:493] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.747838 31610 raft_consensus.cc:515] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.748229 31575 consensus_queue.cc:260] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.751310 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:25.751999 31460 raft_consensus.cc:2468] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:25.752475 31581 raft_consensus.cc:493] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.752791 31574 tablet_bootstrap.cc:492] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.753542 31574 ts_tablet_manager.cc:1403] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.002s
I20260709 12:22:25.753302 31347 leader_election.cc:304] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:25.753288 31581 raft_consensus.cc:515] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.757128 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.757800 31384 raft_consensus.cc:2468] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:25.759951 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.760617 31532 raft_consensus.cc:2468] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:25.761783 31499 leader_election.cc:304] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:25.761878 31610 leader_election.cc:290] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.761296 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:25.764444 31610 raft_consensus.cc:2804] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.764832 31610 raft_consensus.cc:493] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.764648 31460 raft_consensus.cc:2468] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:25.765305 31610 raft_consensus.cc:3060] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.765883 31583 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.766412 31575 ts_tablet_manager.cc:1434] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 12:22:25.768113 31575 tablet_bootstrap.cc:492] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.762307 31581 leader_election.cc:290] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:25.773365 31581 raft_consensus.cc:2804] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.773886 31581 raft_consensus.cc:493] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.774468 31581 raft_consensus.cc:3060] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.757807 31574 raft_consensus.cc:359] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.775833 31574 raft_consensus.cc:385] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.776276 31574 raft_consensus.cc:740] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.777381 31574 consensus_queue.cc:260] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.778018 31576 tablet_bootstrap.cc:492] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.778615 31576 ts_tablet_manager.cc:1403] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.091s	user 0.005s	sys 0.016s
I20260709 12:22:25.782081 31580 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.786348 31575 tablet_bootstrap.cc:654] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.786842 31574 ts_tablet_manager.cc:1434] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 12:22:25.790472 31574 tablet_bootstrap.cc:492] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.792924 31610 raft_consensus.cc:515] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.797791 31574 tablet_bootstrap.cc:654] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.798761 31581 raft_consensus.cc:515] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.799492 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.800966 31611 raft_consensus.cc:493] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.801625 31611 raft_consensus.cc:515] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.808030 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.808454 31580 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.808756 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.809460 31533 raft_consensus.cc:2468] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.809851 31583 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.808827 31384 raft_consensus.cc:2468] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
W20260709 12:22:25.810860 31347 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.66:36267, user_credentials={real_user=slave}} blocked reactor thread for 57666.9us
I20260709 12:22:25.812635 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:25.813249 31460 raft_consensus.cc:3060] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.813604 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:25.814550 31459 raft_consensus.cc:2393] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ff8d80cb13e4d8abeb9b265c29961ef in current term 1: Already voted for candidate 01dd6da1ae404576a76d694869fc9750 in this term.
I20260709 12:22:25.814455 31281 catalog_manager.cc:5697] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.815989 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:25.816860 31384 raft_consensus.cc:2393] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 01dd6da1ae404576a76d694869fc9750 in current term 1: Already voted for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in this term.
I20260709 12:22:25.802814 31576 raft_consensus.cc:359] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.817348 31576 raft_consensus.cc:385] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.814482 31424 leader_election.cc:304] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:25.818367 31581 leader_election.cc:290] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:25.818747 31532 raft_consensus.cc:2393] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ff8d80cb13e4d8abeb9b265c29961ef in current term 1: Already voted for candidate 9eae65ab07f6425297e6b87360b844fd in this term.
I20260709 12:22:25.819046 31581 raft_consensus.cc:493] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.819828 31599 raft_consensus.cc:2804] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.819653 31581 raft_consensus.cc:515] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.820075 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.820313 31599 raft_consensus.cc:493] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.820721 31599 raft_consensus.cc:3060] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.822083 31581 leader_election.cc:290] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:25.795503 31610 leader_election.cc:290] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.823726 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
W20260709 12:22:25.824609 31424 leader_election.cc:343] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.825677 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:25.826097 31425 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750; no voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.826531 31460 raft_consensus.cc:2468] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 1.
I20260709 12:22:25.827628 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.827745 31347 leader_election.cc:304] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.828616 31611 leader_election.cc:290] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.829520 31611 raft_consensus.cc:2749] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:22:25.830122 31348 leader_election.cc:343] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:25.830624 31348 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:25.831599 31583 raft_consensus.cc:2749] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:25.830653 31610 raft_consensus.cc:2804] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:25.832479 31610 raft_consensus.cc:697] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:25.833192 31599 raft_consensus.cc:515] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.833452 31610 consensus_queue.cc:237] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.834458 31458 raft_consensus.cc:2393] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9eae65ab07f6425297e6b87360b844fd in current term 1: Already voted for candidate 01dd6da1ae404576a76d694869fc9750 in this term.
I20260709 12:22:25.817708 31576 raft_consensus.cc:740] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.835975 31574 tablet_bootstrap.cc:492] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.836778 31574 ts_tablet_manager.cc:1403] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.002s
I20260709 12:22:25.836721 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffed97c67b394156b3d2f394d5f9683b" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:25.839517 31576 consensus_queue.cc:260] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.842051 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.841863 31574 raft_consensus.cc:359] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.842742 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:25.843931 31499 leader_election.cc:304] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9eae65ab07f6425297e6b87360b844fd; no voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:25.842825 31384 raft_consensus.cc:2468] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:25.845674 31574 raft_consensus.cc:385] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.846114 31574 raft_consensus.cc:740] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.846534 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.846709 31599 leader_election.cc:290] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.847301 31533 raft_consensus.cc:3060] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.847137 31574 consensus_queue.cc:260] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.852697 31499 leader_election.cc:304] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 01dd6da1ae404576a76d694869fc9750
I20260709 12:22:25.855939 31576 ts_tablet_manager.cc:1434] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.003s
I20260709 12:22:25.857795 31576 tablet_bootstrap.cc:492] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.858496 31599 raft_consensus.cc:493] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.859062 31599 raft_consensus.cc:515] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.859344 31533 raft_consensus.cc:2468] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:25.861049 31424 leader_election.cc:304] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:25.861466 31599 leader_election.cc:290] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.862059 31599 raft_consensus.cc:2804] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:25.862407 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92c02e4234a41ada8be4b831541c0c0" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.862557 31599 raft_consensus.cc:697] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:25.863142 31384 raft_consensus.cc:2468] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.863590 31599 consensus_queue.cc:237] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.864786 31425 leader_election.cc:304] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:25.865787 31611 raft_consensus.cc:2804] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.866171 31611 raft_consensus.cc:493] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.866529 31611 raft_consensus.cc:3060] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.868479 31581 raft_consensus.cc:2749] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:25.869215 31581 raft_consensus.cc:2764] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:25.870076 31575 tablet_bootstrap.cc:492] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.870683 31575 ts_tablet_manager.cc:1403] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.024s
I20260709 12:22:25.874155 31575 raft_consensus.cc:359] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.874840 31575 raft_consensus.cc:385] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.875138 31575 raft_consensus.cc:740] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.875686 31611 raft_consensus.cc:515] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.879251 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92c02e4234a41ada8be4b831541c0c0" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:25.879984 31384 raft_consensus.cc:3060] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.880465 31575 consensus_queue.cc:260] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.883028 31575 ts_tablet_manager.cc:1434] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:22:25.883189 31576 tablet_bootstrap.cc:654] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.884168 31575 tablet_bootstrap.cc:492] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:25.889320 31384 raft_consensus.cc:2468] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:25.890766 31425 leader_election.cc:304] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:25.891604 31599 raft_consensus.cc:2804] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:25.892091 31599 raft_consensus.cc:697] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:25.892434 31575 tablet_bootstrap.cc:654] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.893028 31599 consensus_queue.cc:237] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.898353 31574 ts_tablet_manager.cc:1434] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.006s
I20260709 12:22:25.898265 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92c02e4234a41ada8be4b831541c0c0" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.899271 31533 raft_consensus.cc:2468] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.903401 31611 leader_election.cc:290] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.904349 31576 tablet_bootstrap.cc:492] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.905027 31576 ts_tablet_manager.cc:1403] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.004s
I20260709 12:22:25.907366 31575 tablet_bootstrap.cc:492] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:25.911068 31575 ts_tablet_manager.cc:1403] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 12:22:25.908627 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92c02e4234a41ada8be4b831541c0c0" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.911926 31533 raft_consensus.cc:3060] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.911814 31280 catalog_manager.cc:5697] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.914359 31575 raft_consensus.cc:359] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.915247 31575 raft_consensus.cc:385] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.915521 31575 raft_consensus.cc:740] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.914211 31576 raft_consensus.cc:359] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.919039 31576 raft_consensus.cc:385] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.919382 31576 raft_consensus.cc:740] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.909989 31574 tablet_bootstrap.cc:492] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.920380 31576 consensus_queue.cc:260] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.922803 31576 ts_tablet_manager.cc:1434] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:22:25.923913 31576 tablet_bootstrap.cc:492] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.916464 31575 consensus_queue.cc:260] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.925769 31533 raft_consensus.cc:2468] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:25.927646 31575 ts_tablet_manager.cc:1434] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:22:25.928552 31574 tablet_bootstrap.cc:654] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.930613 31576 tablet_bootstrap.cc:654] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.933889 31574 tablet_bootstrap.cc:492] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.934401 31574 ts_tablet_manager.cc:1403] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 12:22:25.935822 31576 tablet_bootstrap.cc:492] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.934973 31278 catalog_manager.cc:5697] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.936288 31576 ts_tablet_manager.cc:1403] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 12:22:25.937353 31574 raft_consensus.cc:359] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.937181 31278 catalog_manager.cc:5697] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.938050 31574 raft_consensus.cc:385] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.938367 31574 raft_consensus.cc:740] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.938683 31576 raft_consensus.cc:359] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.939391 31576 raft_consensus.cc:385] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.939303 31574 consensus_queue.cc:260] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.941635 31574 ts_tablet_manager.cc:1434] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:25.943077 31574 tablet_bootstrap.cc:492] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:25.939802 31576 raft_consensus.cc:740] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.946009 31576 consensus_queue.cc:260] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.948786 31574 tablet_bootstrap.cc:654] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.950909 31576 ts_tablet_manager.cc:1434] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:22:25.952019 31576 tablet_bootstrap.cc:492] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:25.960075 31574 tablet_bootstrap.cc:492] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:25.960675 31574 ts_tablet_manager.cc:1403] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:22:25.963182 31574 raft_consensus.cc:359] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.964066 31574 raft_consensus.cc:385] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.964162 31576 tablet_bootstrap.cc:654] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:25.964344 31574 raft_consensus.cc:740] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.965106 31574 consensus_queue.cc:260] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.966991 31574 ts_tablet_manager.cc:1434] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:25.969314 31576 tablet_bootstrap.cc:492] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:25.969763 31576 ts_tablet_manager.cc:1403] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:22:25.970201 31610 raft_consensus.cc:493] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.970741 31610 raft_consensus.cc:515] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.972147 31576 raft_consensus.cc:359] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.972754 31576 raft_consensus.cc:385] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:25.973099 31610 leader_election.cc:290] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:25.973917 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2722ac415d549faa1fabd2749db3f81" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.974226 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2722ac415d549faa1fabd2749db3f81" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:25.974589 31533 raft_consensus.cc:2468] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:25.974754 31611 raft_consensus.cc:493] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.974957 31460 raft_consensus.cc:2468] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:25.975270 31611 raft_consensus.cc:515] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.976014 31576 raft_consensus.cc:740] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:25.976063 31348 leader_election.cc:304] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:25.976948 31576 consensus_queue.cc:260] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.977622 31611 leader_election.cc:290] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.978138 31583 raft_consensus.cc:2804] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.978533 31583 raft_consensus.cc:493] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.978906 31583 raft_consensus.cc:3060] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.979461 31576 ts_tablet_manager.cc:1434] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:25.979547 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:25.980418 31384 raft_consensus.cc:2468] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.982537 31425 leader_election.cc:304] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:25.983419 31611 raft_consensus.cc:2804] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:25.983855 31611 raft_consensus.cc:493] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.984257 31611 raft_consensus.cc:3060] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.984388 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:25.985121 31533 raft_consensus.cc:2468] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:25.988298 31583 raft_consensus.cc:515] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:25.990244 31583 leader_election.cc:290] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Requested vote from peers 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:25.992244 31611 raft_consensus.cc:515] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:25.992528 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2722ac415d549faa1fabd2749db3f81" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:25.992544 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2722ac415d549faa1fabd2749db3f81" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.993417 31460 raft_consensus.cc:3060] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.993503 31533 raft_consensus.cc:3060] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.994578 31611 leader_election.cc:290] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:25.996054 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:25.996706 31532 raft_consensus.cc:3060] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:25.996773 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:25.997430 31384 raft_consensus.cc:3060] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.001868 31460 raft_consensus.cc:2468] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 1.
I20260709 12:22:26.003159 31533 raft_consensus.cc:2468] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 1.
I20260709 12:22:26.003980 31347 leader_election.cc:304] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:26.004959 31583 raft_consensus.cc:2804] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:26.005537 31583 raft_consensus.cc:697] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:26.006405 31583 consensus_queue.cc:237] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } }
I20260709 12:22:26.006837 31384 raft_consensus.cc:2468] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:26.008018 31425 leader_election.cc:304] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:26.008813 31611 raft_consensus.cc:2804] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:26.009258 31611 raft_consensus.cc:697] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:26.010039 31611 consensus_queue.cc:237] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.004944 31532 raft_consensus.cc:2468] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:26.019860 31278 catalog_manager.cc:5697] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.021428 31281 catalog_manager.cc:5697] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.057186 31611 raft_consensus.cc:493] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.057817 31611 raft_consensus.cc:515] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.060060 31611 leader_election.cc:290] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:26.060833 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1946d02b4477418db137ece17af0fa38" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:26.061264 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1946d02b4477418db137ece17af0fa38" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:26.061636 31384 raft_consensus.cc:2468] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:26.061975 31532 raft_consensus.cc:2468] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:26.062870 31425 leader_election.cc:304] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:26.063699 31611 raft_consensus.cc:2804] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:26.064110 31611 raft_consensus.cc:493] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.064430 31611 raft_consensus.cc:3060] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.070487 31611 raft_consensus.cc:515] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.071890 31620 raft_consensus.cc:493] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.072477 31611 leader_election.cc:290] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:26.072459 31620 raft_consensus.cc:515] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.073417 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1946d02b4477418db137ece17af0fa38" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:26.073873 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1946d02b4477418db137ece17af0fa38" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:26.074043 31384 raft_consensus.cc:3060] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.074522 31532 raft_consensus.cc:3060] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.075004 31620 leader_election.cc:290] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:26.075776 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d823a306626d49339205b1d3c96988bd" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:26.076555 31383 raft_consensus.cc:2393] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9eae65ab07f6425297e6b87360b844fd in current term 1: Already voted for candidate 01dd6da1ae404576a76d694869fc9750 in this term.
I20260709 12:22:26.076330 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d823a306626d49339205b1d3c96988bd" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:26.078521 31497 leader_election.cc:304] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9eae65ab07f6425297e6b87360b844fd; no voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:26.079352 31620 raft_consensus.cc:3060] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.081866 31384 raft_consensus.cc:2468] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:26.082631 31532 raft_consensus.cc:2468] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:26.082862 31425 leader_election.cc:304] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:26.083914 31611 raft_consensus.cc:2804] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:26.084475 31611 raft_consensus.cc:697] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:26.085350 31611 consensus_queue.cc:237] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.087006 31620 raft_consensus.cc:2749] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:26.093155 31281 catalog_manager.cc:5697] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.102407 31620 raft_consensus.cc:493] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.103296 31620 raft_consensus.cc:515] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.105343 31620 leader_election.cc:290] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:26.106251 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:26.106529 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:26.106914 31384 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:26.107204 31460 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:26.107971 31499 leader_election.cc:304] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:26.108848 31620 raft_consensus.cc:2804] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:26.109126 31620 raft_consensus.cc:493] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.109352 31620 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.114914 31620 raft_consensus.cc:515] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.116569 31620 leader_election.cc:290] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:26.117401 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:26.117654 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:26.118034 31384 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.118239 31460 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.124325 31460 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:26.124454 31384 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:26.125452 31497 leader_election.cc:304] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:26.126258 31620 raft_consensus.cc:2804] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:26.126713 31620 raft_consensus.cc:697] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:26.127413 31620 consensus_queue.cc:237] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.136004 31281 catalog_manager.cc:5697] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:26.185277 31620 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.185945 31620 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:26.188213 31620 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:26.188850 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:26.189270 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:26.189815 31384 raft_consensus.cc:2393] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9eae65ab07f6425297e6b87360b844fd in current term 1: Already voted for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in this term.
I20260709 12:22:26.190171 31460 raft_consensus.cc:2393] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9eae65ab07f6425297e6b87360b844fd in current term 1: Already voted for candidate 01dd6da1ae404576a76d694869fc9750 in this term.
I20260709 12:22:26.190239 31611 consensus_queue.cc:1048] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:26.191447 31497 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9eae65ab07f6425297e6b87360b844fd; no voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:26.192194 31620 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.200074 31620 raft_consensus.cc:2749] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:26.207466 31636 consensus_queue.cc:1048] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.248119 31384 raft_consensus.cc:3060] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:26.255472 31636 consensus_queue.cc:1048] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.268898 31636 consensus_queue.cc:1048] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.332130 31583 consensus_queue.cc:1048] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.344683 31583 consensus_queue.cc:1048] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:26.412138 31636 consensus_queue.cc:1048] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.423826 31636 consensus_queue.cc:1048] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:26.455807 31583 consensus_queue.cc:1048] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.467648 31583 consensus_queue.cc:1048] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:26.578979 31636 consensus_queue.cc:1048] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.579710 31611 consensus_queue.cc:1048] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.607913 31636 consensus_queue.cc:1048] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:26.619880 31636 consensus_queue.cc:1048] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:26.630571 31330 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:26.665833 31620 consensus_queue.cc:1048] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:26.679004 31613 consensus_queue.cc:1048] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:27.637513 31330 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:27.647105 31583 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.647917 31583 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:27.649999 31583 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:27.651106 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:27.651178 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:27.651899 31460 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 1.
I20260709 12:22:27.651989 31532 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 1.
I20260709 12:22:27.653249 31347 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:27.653981 31583 raft_consensus.cc:2804] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:27.654356 31583 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.654603 31583 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.660410 31583 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:27.662593 31583 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:27.663435 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:27.663688 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:27.664085 31460 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.664341 31532 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.669749 31532 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:27.669983 31460 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:27.670758 31348 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:27.671754 31583 raft_consensus.cc:2804] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:27.672724 31583 raft_consensus.cc:697] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:27.673601 31583 consensus_queue.cc:237] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:27.681262 31279 catalog_manager.cc:5697] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 0 to 2, leader changed from <none> to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.824119 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:27.824848 31532 raft_consensus.cc:606] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:27.840092 31460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
mode: GRACEFUL
new_leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:51380
I20260709 12:22:27.840976 31460 raft_consensus.cc:606] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Received request to transfer leadership to TS 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:27.866765 31383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
mode: GRACEFUL
new_leader_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:50946
I20260709 12:22:27.867506 31383 raft_consensus.cc:606] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Received request to transfer leadership to TS 01dd6da1ae404576a76d694869fc9750
I20260709 12:22:27.873368 31460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
mode: GRACEFUL
new_leader_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:51380
I20260709 12:22:27.873984 31460 raft_consensus.cc:606] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Received request to transfer leadership to TS 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:27.880055 31636 raft_consensus.cc:993] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: : Instructing follower 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:27.880546 31661 raft_consensus.cc:1081] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Signalling peer 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:27.882157 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:54464
I20260709 12:22:27.882661 31532 raft_consensus.cc:493] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:27.882975 31532 raft_consensus.cc:3060] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.889178 31532 raft_consensus.cc:515] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:27.890884 31532 leader_election.cc:290] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 2 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:27.892078 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:27.891930 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c87e7aed8f4af98f22e77b6cc0c24c" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:27.892788 31460 raft_consensus.cc:3055] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.892832 31383 raft_consensus.cc:3060] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.893250 31460 raft_consensus.cc:740] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:27.894189 31460 consensus_queue.cc:260] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:27.895622 31460 raft_consensus.cc:3060] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.901180 31383 raft_consensus.cc:2468] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 2.
I20260709 12:22:27.902536 31499 leader_election.cc:304] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:27.903374 31613 raft_consensus.cc:2804] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:27.903694 31460 raft_consensus.cc:2468] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 2.
I20260709 12:22:27.904832 31613 raft_consensus.cc:697] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 2 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:27.905838 31613 consensus_queue.cc:237] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:27.913638 31279 catalog_manager.cc:5697] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 1 to 2, leader changed from 01dd6da1ae404576a76d694869fc9750 (127.18.132.66) to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 2 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:28.076788 31636 raft_consensus.cc:993] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: : Instructing follower 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:28.077320 31661 raft_consensus.cc:1081] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Signalling peer 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:28.079115 31383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:50780
I20260709 12:22:28.079783 31383 raft_consensus.cc:493] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.080153 31383 raft_consensus.cc:3060] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.085853 31383 raft_consensus.cc:515] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.087627 31383 leader_election.cc:290] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:28.088495 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:28.088842 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9bdacf1dd14e0da7b2a4fff1cef146" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:28.089288 31460 raft_consensus.cc:3055] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.089460 31532 raft_consensus.cc:3060] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.089668 31460 raft_consensus.cc:740] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:28.090665 31460 consensus_queue.cc:260] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.092089 31460 raft_consensus.cc:3060] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.097721 31532 raft_consensus.cc:2468] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:28.099224 31348 leader_election.cc:304] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:28.099828 31460 raft_consensus.cc:2468] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:28.100062 31583 raft_consensus.cc:2804] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.101609 31583 raft_consensus.cc:697] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:28.102552 31583 consensus_queue.cc:237] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.111841 31279 catalog_manager.cc:5697] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 1 to 2, leader changed from 01dd6da1ae404576a76d694869fc9750 (127.18.132.66) to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.145823 31460 raft_consensus.cc:1275] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:28.147114 31583 consensus_queue.cc:1048] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:28.154134 31668 raft_consensus.cc:993] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: : Instructing follower 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:28.154719 31655 raft_consensus.cc:1081] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Signalling peer 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:28.156816 31458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:42498
I20260709 12:22:28.160578 31458 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.161000 31458 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.161438 31532 raft_consensus.cc:1275] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:28.162874 31655 consensus_queue.cc:1048] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:28.169322 31458 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.176896 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:28.177510 31532 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.178539 31458 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 3 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:28.179970 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:28.180639 31383 raft_consensus.cc:3055] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:28.180934 31383 raft_consensus.cc:740] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:28.181777 31383 consensus_queue.cc:260] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.183331 31383 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.185815 31532 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 3.
I20260709 12:22:28.187139 31424 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:28.188066 31661 raft_consensus.cc:2804] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:28.188561 31661 raft_consensus.cc:697] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:28.189452 31661 consensus_queue.cc:237] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.190734 31383 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 3.
I20260709 12:22:28.196467 31281 catalog_manager.cc:5697] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 2 to 3, leader changed from 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65) to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 3 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.268586 31666 raft_consensus.cc:993] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:28.269094 31666 raft_consensus.cc:1081] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:28.270648 31383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:50792
I20260709 12:22:28.271178 31383 raft_consensus.cc:493] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.271513 31383 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.277420 31383 raft_consensus.cc:515] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.279083 31383 leader_election.cc:290] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:28.280144 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:28.280282 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:28.280803 31458 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.280911 31532 raft_consensus.cc:3055] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.281448 31532 raft_consensus.cc:740] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:28.282159 31532 consensus_queue.cc:260] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.283232 31532 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.288161 31458 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:28.289407 31347 leader_election.cc:304] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:28.289467 31532 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:28.290230 31583 raft_consensus.cc:2804] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.290759 31583 raft_consensus.cc:697] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:28.291636 31583 consensus_queue.cc:237] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:28.300320 31281 catalog_manager.cc:5697] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.444052 31458 raft_consensus.cc:1275] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.445546 31666 consensus_queue.cc:1048] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.456094 31383 raft_consensus.cc:1275] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.458348 31666 consensus_queue.cc:1048] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.636106 31458 raft_consensus.cc:1275] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.637776 31583 consensus_queue.cc:1048] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.644447 31383 raft_consensus.cc:1275] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:28.646044 31661 consensus_queue.cc:1048] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.656322 31532 raft_consensus.cc:1275] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.665364 31532 raft_consensus.cc:1275] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:28.665148 31668 consensus_queue.cc:1048] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:28.667075 31661 consensus_queue.cc:1048] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.712587 31458 raft_consensus.cc:1275] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.713985 31668 consensus_queue.cc:1048] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.724220 31533 raft_consensus.cc:1275] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.726094 31668 consensus_queue.cc:1048] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:30.901400 31281 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59934:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:30.903815 31281 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:30.956251 31373 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6ad7de6a334859b17dd7d72886ca6c (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:30.957208 31448 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6ad7de6a334859b17dd7d72886ca6c (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:30.957844 31373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6ad7de6a334859b17dd7d72886ca6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.958716 31448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6ad7de6a334859b17dd7d72886ca6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.960549 31374 tablet_service.cc:1511] Processing CreateTablet for tablet 606c2eda0a8445c483d029374e41ff58 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:30.961480 31444 tablet_service.cc:1511] Processing CreateTablet for tablet 606c2eda0a8445c483d029374e41ff58 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:30.961930 31374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c2eda0a8445c483d029374e41ff58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.962783 31444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c2eda0a8445c483d029374e41ff58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.964735 31518 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6ad7de6a334859b17dd7d72886ca6c (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:30.966050 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6ad7de6a334859b17dd7d72886ca6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.988049 31523 tablet_service.cc:1511] Processing CreateTablet for tablet 606c2eda0a8445c483d029374e41ff58 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:30.989635 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c2eda0a8445c483d029374e41ff58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.989760 31373 tablet_service.cc:1511] Processing CreateTablet for tablet a066e76e16964b22a262b5007d2eb789 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:30.991142 31373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a066e76e16964b22a262b5007d2eb789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:30.998983 31447 tablet_service.cc:1511] Processing CreateTablet for tablet a066e76e16964b22a262b5007d2eb789 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:31.001042 31447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a066e76e16964b22a262b5007d2eb789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.010982 31517 tablet_service.cc:1511] Processing CreateTablet for tablet a066e76e16964b22a262b5007d2eb789 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:31.012490 31372 tablet_service.cc:1511] Processing CreateTablet for tablet edd98b4bc43b4b2a98d24ee520a281a2 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:31.013036 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a066e76e16964b22a262b5007d2eb789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.013870 31372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd98b4bc43b4b2a98d24ee520a281a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.018126 31445 tablet_service.cc:1511] Processing CreateTablet for tablet edd98b4bc43b4b2a98d24ee520a281a2 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:31.020330 31445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd98b4bc43b4b2a98d24ee520a281a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.040246 31698 tablet_bootstrap.cc:492] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.042903 31366 tablet_service.cc:1511] Processing CreateTablet for tablet 0268aae96e6541408d586b5ad2c04b2e (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:31.043676 31519 tablet_service.cc:1511] Processing CreateTablet for tablet edd98b4bc43b4b2a98d24ee520a281a2 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:31.044404 31366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0268aae96e6541408d586b5ad2c04b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.045059 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd98b4bc43b4b2a98d24ee520a281a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.045182 31443 tablet_service.cc:1511] Processing CreateTablet for tablet 0268aae96e6541408d586b5ad2c04b2e (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:31.048143 31520 tablet_service.cc:1511] Processing CreateTablet for tablet 0268aae96e6541408d586b5ad2c04b2e (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:31.049388 31520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0268aae96e6541408d586b5ad2c04b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.049522 31443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0268aae96e6541408d586b5ad2c04b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.065984 31374 tablet_service.cc:1511] Processing CreateTablet for tablet 736cc75f5ed54fe398e3811e3de1661d (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:31.067479 31374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736cc75f5ed54fe398e3811e3de1661d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.076727 31444 tablet_service.cc:1511] Processing CreateTablet for tablet 736cc75f5ed54fe398e3811e3de1661d (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:31.079056 31444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736cc75f5ed54fe398e3811e3de1661d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.079553 31699 tablet_bootstrap.cc:492] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.093281 31698 tablet_bootstrap.cc:654] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.097868 31523 tablet_service.cc:1511] Processing CreateTablet for tablet 736cc75f5ed54fe398e3811e3de1661d (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:31.094367 31700 tablet_bootstrap.cc:492] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.098572 31368 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd8e9c8603476f9405414dbdf21aa5 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:31.099320 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736cc75f5ed54fe398e3811e3de1661d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.100046 31368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd8e9c8603476f9405414dbdf21aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.109957 31448 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd8e9c8603476f9405414dbdf21aa5 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:31.111445 31448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd8e9c8603476f9405414dbdf21aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.122925 31519 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd8e9c8603476f9405414dbdf21aa5 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:31.124912 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd8e9c8603476f9405414dbdf21aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.127285 31447 tablet_service.cc:1511] Processing CreateTablet for tablet 45694a8578ce4797bc5fba3e3e3c638b (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:31.128860 31447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45694a8578ce4797bc5fba3e3e3c638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.133893 31517 tablet_service.cc:1511] Processing CreateTablet for tablet 45694a8578ce4797bc5fba3e3e3c638b (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:31.142339 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45694a8578ce4797bc5fba3e3e3c638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.143302 31374 tablet_service.cc:1511] Processing CreateTablet for tablet a44b2ecd297142058daa88bb99c000f1 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:31.141088 31368 tablet_service.cc:1511] Processing CreateTablet for tablet 45694a8578ce4797bc5fba3e3e3c638b (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:31.151500 31700 tablet_bootstrap.cc:654] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.158248 31699 tablet_bootstrap.cc:654] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.158927 31450 tablet_service.cc:1511] Processing CreateTablet for tablet a44b2ecd297142058daa88bb99c000f1 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:31.160418 31698 tablet_bootstrap.cc:492] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.167893 31698 ts_tablet_manager.cc:1403] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.005s
I20260709 12:22:31.167320 31450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a44b2ecd297142058daa88bb99c000f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.162562 31368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45694a8578ce4797bc5fba3e3e3c638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.173444 31698 raft_consensus.cc:359] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.174257 31698 raft_consensus.cc:385] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.174613 31698 raft_consensus.cc:740] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.175441 31698 consensus_queue.cc:260] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.175967 31374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a44b2ecd297142058daa88bb99c000f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.178076 31698 ts_tablet_manager.cc:1434] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:22:31.179319 31698 tablet_bootstrap.cc:492] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.188534 31523 tablet_service.cc:1511] Processing CreateTablet for tablet a44b2ecd297142058daa88bb99c000f1 (DEFAULT_TABLE table=soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:31.190267 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a44b2ecd297142058daa88bb99c000f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:31.203091 31698 tablet_bootstrap.cc:654] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.206557 31700 tablet_bootstrap.cc:492] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.213083 31700 ts_tablet_manager.cc:1403] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.009s
I20260709 12:22:31.216737 31700 raft_consensus.cc:359] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.217518 31700 raft_consensus.cc:385] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.217888 31700 raft_consensus.cc:740] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.218766 31700 consensus_queue.cc:260] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.222535 31699 tablet_bootstrap.cc:492] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.223280 31699 ts_tablet_manager.cc:1403] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.000s
I20260709 12:22:31.226791 31699 raft_consensus.cc:359] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.227546 31699 raft_consensus.cc:385] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.227926 31699 raft_consensus.cc:740] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.228720 31699 consensus_queue.cc:260] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.231439 31700 ts_tablet_manager.cc:1434] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:22:31.231552 31699 ts_tablet_manager.cc:1434] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:22:31.232890 31700 tablet_bootstrap.cc:492] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.237846 31698 tablet_bootstrap.cc:492] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.238515 31698 ts_tablet_manager.cc:1403] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.006s
I20260709 12:22:31.242069 31698 raft_consensus.cc:359] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.242934 31698 raft_consensus.cc:385] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.243291 31698 raft_consensus.cc:740] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.244071 31698 consensus_queue.cc:260] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.246554 31698 ts_tablet_manager.cc:1434] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:22:31.248811 31700 tablet_bootstrap.cc:654] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.256004 31699 tablet_bootstrap.cc:492] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.264503 31699 tablet_bootstrap.cc:654] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.266202 31698 tablet_bootstrap.cc:492] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.270160 31666 raft_consensus.cc:493] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.270704 31666 raft_consensus.cc:515] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.272716 31666 leader_election.cc:290] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.272902 31700 tablet_bootstrap.cc:492] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.273504 31700 ts_tablet_manager.cc:1403] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 12:22:31.273604 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.273922 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.274776 31458 raft_consensus.cc:2468] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.274804 31383 raft_consensus.cc:2468] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.276139 31497 leader_election.cc:304] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.276921 31700 raft_consensus.cc:359] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.277350 31666 raft_consensus.cc:2804] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.277822 31700 raft_consensus.cc:385] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.277887 31666 raft_consensus.cc:493] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.278226 31700 raft_consensus.cc:740] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.278386 31666 raft_consensus.cc:3060] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.279217 31700 consensus_queue.cc:260] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.283229 31698 tablet_bootstrap.cc:654] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.290323 31699 tablet_bootstrap.cc:492] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.291009 31699 ts_tablet_manager.cc:1403] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.016s
I20260709 12:22:31.295303 31666 raft_consensus.cc:515] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.295931 31699 raft_consensus.cc:359] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.297029 31699 raft_consensus.cc:385] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.297492 31699 raft_consensus.cc:740] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.298578 31699 consensus_queue.cc:260] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.301529 31699 ts_tablet_manager.cc:1434] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:22:31.299144 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.302793 31699 tablet_bootstrap.cc:492] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.302989 31383 raft_consensus.cc:3060] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.310505 31699 tablet_bootstrap.cc:654] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.318977 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.319710 31458 raft_consensus.cc:3060] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.321480 31698 tablet_bootstrap.cc:492] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.322316 31698 ts_tablet_manager.cc:1403] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.017s
I20260709 12:22:31.326478 31698 raft_consensus.cc:359] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.327279 31698 raft_consensus.cc:385] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.327621 31698 raft_consensus.cc:740] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.328931 31699 tablet_bootstrap.cc:492] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.329582 31699 ts_tablet_manager.cc:1403] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 12:22:31.328514 31698 consensus_queue.cc:260] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.332444 31698 ts_tablet_manager.cc:1434] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:31.333079 31699 raft_consensus.cc:359] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.333868 31698 tablet_bootstrap.cc:492] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.333889 31699 raft_consensus.cc:385] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.334501 31699 raft_consensus.cc:740] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.342304 31698 tablet_bootstrap.cc:654] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.343245 31702 raft_consensus.cc:493] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.343843 31702 raft_consensus.cc:515] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.346364 31702 leader_election.cc:290] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.335352 31699 consensus_queue.cc:260] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.348387 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.348825 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:31.349255 31384 raft_consensus.cc:2468] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:31.349596 31532 raft_consensus.cc:2468] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:31.351068 31424 leader_election.cc:304] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.351404 31699 ts_tablet_manager.cc:1434] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:22:31.352224 31702 raft_consensus.cc:2804] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.352581 31699 tablet_bootstrap.cc:492] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.352759 31702 raft_consensus.cc:493] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.353307 31702 raft_consensus.cc:3060] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.371065 31699 tablet_bootstrap.cc:654] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.375466 31698 tablet_bootstrap.cc:492] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.376088 31698 ts_tablet_manager.cc:1403] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.018s
I20260709 12:22:31.379462 31698 raft_consensus.cc:359] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.380383 31698 raft_consensus.cc:385] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.380725 31698 raft_consensus.cc:740] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.381582 31698 consensus_queue.cc:260] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.384894 31698 ts_tablet_manager.cc:1434] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:31.386410 31698 tablet_bootstrap.cc:492] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.388095 31666 leader_election.cc:290] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.388991 31458 raft_consensus.cc:2468] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.397020 31699 tablet_bootstrap.cc:492] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.393972 31698 tablet_bootstrap.cc:654] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.397512 31497 leader_election.cc:304] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.398074 31702 raft_consensus.cc:515] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.397606 31699 ts_tablet_manager.cc:1403] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.001s
I20260709 12:22:31.400440 31708 raft_consensus.cc:2804] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.394039 31383 raft_consensus.cc:2468] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.401793 31700 ts_tablet_manager.cc:1434] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.128s	user 0.047s	sys 0.040s
I20260709 12:22:31.403736 31700 tablet_bootstrap.cc:492] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.403553 31699 raft_consensus.cc:359] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.401839 31708 raft_consensus.cc:697] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:31.405622 31708 consensus_queue.cc:237] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.404455 31699 raft_consensus.cc:385] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.410917 31699 raft_consensus.cc:740] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.411829 31699 consensus_queue.cc:260] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.412919 31700 tablet_bootstrap.cc:654] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.414615 31699 ts_tablet_manager.cc:1434] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:31.418962 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.420221 31383 raft_consensus.cc:3060] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.420830 31687 raft_consensus.cc:493] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.421613 31687 raft_consensus.cc:515] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.425753 31700 tablet_bootstrap.cc:492] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.426340 31700 ts_tablet_manager.cc:1403] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 12:22:31.426586 31687 leader_election.cc:290] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.425591 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.428193 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
W20260709 12:22:31.428413 31347 leader_election.cc:343] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.430517 31700 raft_consensus.cc:359] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
W20260709 12:22:31.430826 31348 leader_election.cc:343] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.431355 31700 raft_consensus.cc:385] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.431494 31348 leader_election.cc:304] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:31.431742 31700 raft_consensus.cc:740] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.433231 31687 raft_consensus.cc:2749] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:31.436368 31700 consensus_queue.cc:260] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.436771 31702 leader_election.cc:290] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.438277 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:31.438966 31532 raft_consensus.cc:3060] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.439188 31700 ts_tablet_manager.cc:1434] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:31.440441 31700 tablet_bootstrap.cc:492] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.443523 31698 tablet_bootstrap.cc:492] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.444208 31698 ts_tablet_manager.cc:1403] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.058s	user 0.033s	sys 0.020s
I20260709 12:22:31.446561 31383 raft_consensus.cc:2468] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:31.447690 31698 raft_consensus.cc:359] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.450393 31698 raft_consensus.cc:385] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.450608 31699 tablet_bootstrap.cc:492] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.450709 31698 raft_consensus.cc:740] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.451710 31698 consensus_queue.cc:260] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.452032 31425 leader_election.cc:304] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:31.455107 31698 ts_tablet_manager.cc:1434] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:22:31.456168 31698 tablet_bootstrap.cc:492] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.456904 31702 raft_consensus.cc:2804] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.457458 31702 raft_consensus.cc:697] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:31.457580 31281 catalog_manager.cc:5697] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.458417 31702 consensus_queue.cc:237] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.459141 31699 tablet_bootstrap.cc:654] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.448151 31700 tablet_bootstrap.cc:654] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.462276 31532 raft_consensus.cc:2468] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:31.463310 31698 tablet_bootstrap.cc:654] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.474809 31279 catalog_manager.cc:5697] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.491078 31698 tablet_bootstrap.cc:492] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.491847 31698 ts_tablet_manager.cc:1403] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.007s
I20260709 12:22:31.493518 31699 tablet_bootstrap.cc:492] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.494361 31699 ts_tablet_manager.cc:1403] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.003s
I20260709 12:22:31.494915 31698 raft_consensus.cc:359] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.495698 31698 raft_consensus.cc:385] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.496057 31698 raft_consensus.cc:740] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.497066 31698 consensus_queue.cc:260] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.500108 31698 ts_tablet_manager.cc:1434] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:31.500475 31700 tablet_bootstrap.cc:492] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.501157 31700 ts_tablet_manager.cc:1403] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.011s
I20260709 12:22:31.501408 31698 tablet_bootstrap.cc:492] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.502565 31699 raft_consensus.cc:359] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.503388 31699 raft_consensus.cc:385] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.503690 31699 raft_consensus.cc:740] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.504485 31699 consensus_queue.cc:260] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.506980 31700 raft_consensus.cc:359] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.508035 31699 ts_tablet_manager.cc:1434] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:22:31.510296 31699 tablet_bootstrap.cc:492] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.511026 31698 tablet_bootstrap.cc:654] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.514706 31700 raft_consensus.cc:385] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.515091 31700 raft_consensus.cc:740] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.515982 31700 consensus_queue.cc:260] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.518842 31700 ts_tablet_manager.cc:1434] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:22:31.519158 31699 tablet_bootstrap.cc:654] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.519894 31700 tablet_bootstrap.cc:492] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.520627 31698 tablet_bootstrap.cc:492] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.521302 31698 ts_tablet_manager.cc:1403] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:22:31.525844 31698 raft_consensus.cc:359] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.526919 31698 raft_consensus.cc:385] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.527308 31698 raft_consensus.cc:740] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.529330 31698 consensus_queue.cc:260] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.530544 31700 tablet_bootstrap.cc:654] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.531509 31698 ts_tablet_manager.cc:1434] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:31.532680 31698 tablet_bootstrap.cc:492] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.537415 31700 tablet_bootstrap.cc:492] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.538020 31700 ts_tablet_manager.cc:1403] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.006s
I20260709 12:22:31.538360 31699 tablet_bootstrap.cc:492] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.538966 31699 ts_tablet_manager.cc:1403] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.003s
I20260709 12:22:31.539517 31698 tablet_bootstrap.cc:654] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.541497 31700 raft_consensus.cc:359] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.542073 31699 raft_consensus.cc:359] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.542351 31700 raft_consensus.cc:385] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.542833 31699 raft_consensus.cc:385] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.542953 31700 raft_consensus.cc:740] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.543234 31699 raft_consensus.cc:740] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.544070 31699 consensus_queue.cc:260] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.544093 31700 consensus_queue.cc:260] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.547039 31699 ts_tablet_manager.cc:1434] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:22:31.548856 31699 tablet_bootstrap.cc:492] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.549441 31700 ts_tablet_manager.cc:1434] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 12:22:31.550762 31700 tablet_bootstrap.cc:492] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.551949 31698 tablet_bootstrap.cc:492] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.552549 31698 ts_tablet_manager.cc:1403] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.015s
I20260709 12:22:31.608527 31699 tablet_bootstrap.cc:654] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.613878 31708 raft_consensus.cc:493] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.621217 31711 raft_consensus.cc:493] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.622835 31708 raft_consensus.cc:515] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.623909 31711 raft_consensus.cc:515] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.627271 31708 leader_election.cc:290] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.627254 31711 leader_election.cc:290] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.628916 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.629285 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.613934 31700 tablet_bootstrap.cc:654] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.636384 31384 raft_consensus.cc:2468] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.637775 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.639112 31458 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.642376 31497 leader_election.cc:304] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.641776 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.644562 31499 leader_election.cc:304] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.645136 31711 raft_consensus.cc:2804] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.645153 31458 raft_consensus.cc:2468] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.645877 31708 raft_consensus.cc:2804] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.646006 31711 raft_consensus.cc:493] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.646467 31708 raft_consensus.cc:493] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.646591 31711 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.646919 31708 raft_consensus.cc:3060] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.640251 31383 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.660735 31698 raft_consensus.cc:359] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.661904 31698 raft_consensus.cc:385] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.662269 31698 raft_consensus.cc:740] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.669368 31700 tablet_bootstrap.cc:492] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.669526 31711 raft_consensus.cc:515] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.670423 31700 ts_tablet_manager.cc:1403] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.005s
I20260709 12:22:31.663403 31698 consensus_queue.cc:260] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.674547 31711 leader_election.cc:290] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.675529 31708 raft_consensus.cc:515] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.677290 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.677006 31700 raft_consensus.cc:359] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.677580 31708 leader_election.cc:290] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.677935 31700 raft_consensus.cc:385] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.678335 31700 raft_consensus.cc:740] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.679349 31700 consensus_queue.cc:260] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.680204 31699 tablet_bootstrap.cc:492] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.681499 31699 ts_tablet_manager.cc:1403] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.011s
I20260709 12:22:31.683229 31700 ts_tablet_manager.cc:1434] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:22:31.685011 31698 ts_tablet_manager.cc:1434] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.132s	user 0.010s	sys 0.001s
I20260709 12:22:31.685077 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.685995 31383 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.686319 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.687201 31382 raft_consensus.cc:3060] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.687214 31698 tablet_bootstrap.cc:492] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: Bootstrap starting.
I20260709 12:22:31.679996 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.695154 31700 tablet_bootstrap.cc:492] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.695410 31460 raft_consensus.cc:3060] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.677958 31458 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.697840 31699 raft_consensus.cc:359] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.702419 31699 raft_consensus.cc:385] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.703672 31699 raft_consensus.cc:740] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.706861 31383 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
W20260709 12:22:31.708777 31330 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:31.713897 31382 raft_consensus.cc:2468] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.716827 31700 tablet_bootstrap.cc:654] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.717242 31460 raft_consensus.cc:2468] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.718676 31699 consensus_queue.cc:260] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.719087 31499 leader_election.cc:304] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.721581 31708 raft_consensus.cc:2804] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.721836 31497 leader_election.cc:304] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.722112 31708 raft_consensus.cc:697] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:31.723452 31708 consensus_queue.cc:237] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.723941 31698 tablet_bootstrap.cc:654] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.723804 31666 raft_consensus.cc:2804] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.726576 31666 raft_consensus.cc:697] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:31.728094 31666 consensus_queue.cc:237] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.731647 31699 ts_tablet_manager.cc:1434] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.004s
I20260709 12:22:31.733826 31699 tablet_bootstrap.cc:492] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.736526 31685 raft_consensus.cc:493] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.737442 31685 raft_consensus.cc:515] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.738353 31700 tablet_bootstrap.cc:492] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.740973 31685 leader_election.cc:290] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.739292 31700 ts_tablet_manager.cc:1403] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.002s
I20260709 12:22:31.745697 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.747624 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
W20260709 12:22:31.749805 31347 leader_election.cc:343] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:31.751417 31348 leader_election.cc:343] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:31.751868 31348 leader_election.cc:304] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:31.753734 31700 raft_consensus.cc:359] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.754957 31700 raft_consensus.cc:385] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.754489 31687 raft_consensus.cc:2749] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:31.765866 31699 tablet_bootstrap.cc:654] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.755375 31700 raft_consensus.cc:740] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.776345 31700 consensus_queue.cc:260] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.769289 31458 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.780606 31700 ts_tablet_manager.cc:1434] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:22:31.781262 31698 tablet_bootstrap.cc:492] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: No bootstrap required, opened a new log
I20260709 12:22:31.783481 31698 ts_tablet_manager.cc:1403] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.021s
I20260709 12:22:31.763434 31278 catalog_manager.cc:5697] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.782346 31700 tablet_bootstrap.cc:492] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.786908 31698 raft_consensus.cc:359] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.787731 31698 raft_consensus.cc:385] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.788041 31698 raft_consensus.cc:740] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.788964 31698 consensus_queue.cc:260] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.791970 31698 ts_tablet_manager.cc:1434] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:31.795729 31700 tablet_bootstrap.cc:654] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.796500 31699 tablet_bootstrap.cc:492] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.797149 31699 ts_tablet_manager.cc:1403] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
I20260709 12:22:31.800576 31699 raft_consensus.cc:359] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.801290 31699 raft_consensus.cc:385] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.801556 31699 raft_consensus.cc:740] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.802253 31699 consensus_queue.cc:260] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.804920 31699 ts_tablet_manager.cc:1434] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:22:31.806528 31699 tablet_bootstrap.cc:492] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: Bootstrap starting.
I20260709 12:22:31.807734 31278 catalog_manager.cc:5697] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.815487 31700 tablet_bootstrap.cc:492] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.816104 31700 ts_tablet_manager.cc:1403] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.004s
I20260709 12:22:31.819200 31699 tablet_bootstrap.cc:654] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.819581 31700 raft_consensus.cc:359] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.820418 31700 raft_consensus.cc:385] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.820735 31700 raft_consensus.cc:740] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.821527 31700 consensus_queue.cc:260] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.824170 31700 ts_tablet_manager.cc:1434] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:31.825449 31699 tablet_bootstrap.cc:492] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: No bootstrap required, opened a new log
I20260709 12:22:31.825589 31700 tablet_bootstrap.cc:492] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: Bootstrap starting.
I20260709 12:22:31.826071 31699 ts_tablet_manager.cc:1403] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:22:31.830061 31699 raft_consensus.cc:359] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.830765 31699 raft_consensus.cc:385] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.831055 31699 raft_consensus.cc:740] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.831794 31699 consensus_queue.cc:260] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.833159 31700 tablet_bootstrap.cc:654] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:31.834124 31699 ts_tablet_manager.cc:1434] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:31.838313 31700 tablet_bootstrap.cc:492] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: No bootstrap required, opened a new log
I20260709 12:22:31.838800 31700 ts_tablet_manager.cc:1403] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:22:31.841709 31700 raft_consensus.cc:359] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.842330 31700 raft_consensus.cc:385] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:31.842558 31700 raft_consensus.cc:740] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Initialized, Role: FOLLOWER
I20260709 12:22:31.843192 31700 consensus_queue.cc:260] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.846069 31700 ts_tablet_manager.cc:1434] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:31.850068 31666 consensus_queue.cc:1048] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:31.865844 31708 consensus_queue.cc:1048] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.874668 31708 raft_consensus.cc:493] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.875555 31708 raft_consensus.cc:515] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.876153 31661 consensus_queue.cc:1048] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.879451 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.880293 31384 raft_consensus.cc:2468] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.880772 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.879448 31708 leader_election.cc:290] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.881688 31460 raft_consensus.cc:2468] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.882233 31499 leader_election.cc:304] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.883399 31666 raft_consensus.cc:2804] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.883792 31666 raft_consensus.cc:493] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.883832 31661 raft_consensus.cc:493] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.884227 31666 raft_consensus.cc:3060] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.884399 31661 raft_consensus.cc:515] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.889451 31661 leader_election.cc:290] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.889736 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45694a8578ce4797bc5fba3e3e3c638b" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.890550 31384 raft_consensus.cc:2468] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:31.891826 31425 leader_election.cc:304] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:31.892251 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45694a8578ce4797bc5fba3e3e3c638b" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:31.892796 31661 raft_consensus.cc:2804] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.892938 31532 raft_consensus.cc:2468] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 0.
I20260709 12:22:31.893273 31661 raft_consensus.cc:493] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.893699 31661 raft_consensus.cc:3060] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.895249 31666 raft_consensus.cc:515] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.899801 31666 leader_election.cc:290] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.901047 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.901877 31460 raft_consensus.cc:3060] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.902514 31661 raft_consensus.cc:515] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.905740 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45694a8578ce4797bc5fba3e3e3c638b" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.906358 31384 raft_consensus.cc:3060] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.913586 31730 consensus_queue.cc:1048] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:31.900949 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.915527 31383 raft_consensus.cc:3060] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.916128 31460 raft_consensus.cc:2468] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.923954 31661 leader_election.cc:290] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.924322 31383 raft_consensus.cc:2468] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.925125 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45694a8578ce4797bc5fba3e3e3c638b" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:31.926389 31384 raft_consensus.cc:2468] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:31.927286 31533 raft_consensus.cc:3060] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.928121 31425 leader_election.cc:304] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:31.929255 31661 raft_consensus.cc:2804] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.930092 31737 raft_consensus.cc:493] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.930580 31661 raft_consensus.cc:697] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:31.930645 31737 raft_consensus.cc:515] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.931672 31661 consensus_queue.cc:237] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.933288 31499 leader_election.cc:304] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.934473 31708 raft_consensus.cc:2804] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.934952 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.935053 31711 raft_consensus.cc:493] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.935073 31708 raft_consensus.cc:697] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:31.935603 31737 leader_election.cc:290] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.936640 31459 raft_consensus.cc:2468] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:31.936800 31711 raft_consensus.cc:515] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.936231 31534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd" is_pre_election: true
I20260709 12:22:31.937501 31708 consensus_queue.cc:237] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.938143 31347 leader_election.cc:304] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:31.938402 31534 raft_consensus.cc:2468] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 0.
I20260709 12:22:31.939173 31737 raft_consensus.cc:2804] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.939373 31711 leader_election.cc:290] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.942082 31737 raft_consensus.cc:493] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.942528 31737 raft_consensus.cc:3060] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.944119 31533 raft_consensus.cc:2468] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 1.
I20260709 12:22:31.948031 31708 raft_consensus.cc:493] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.948238 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.948752 31708 raft_consensus.cc:515] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.949275 31459 raft_consensus.cc:2468] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.951046 31497 leader_election.cc:304] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.951656 31708 leader_election.cc:290] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.952399 31708 raft_consensus.cc:2804] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.952833 31708 raft_consensus.cc:493] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.953004 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.953245 31708 raft_consensus.cc:3060] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.954438 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:31.954888 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:31.955211 31460 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.955662 31384 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:31.958081 31737 raft_consensus.cc:515] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.962611 31708 raft_consensus.cc:515] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.963797 31383 raft_consensus.cc:2393] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9eae65ab07f6425297e6b87360b844fd in current term 1: Already voted for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in this term.
I20260709 12:22:31.964826 31737 leader_election.cc:290] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:31.964828 31708 leader_election.cc:290] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.965593 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.966235 31460 raft_consensus.cc:3060] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.967872 31497 leader_election.cc:304] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.970867 31708 raft_consensus.cc:2804] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:31.971333 31708 raft_consensus.cc:493] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:31.971786 31708 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.967819 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.969439 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.972447 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:31.976089 31532 raft_consensus.cc:2393] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ff8d80cb13e4d8abeb9b265c29961ef in current term 1: Already voted for candidate 9eae65ab07f6425297e6b87360b844fd in this term.
I20260709 12:22:31.979374 31281 catalog_manager.cc:5697] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.982595 31460 raft_consensus.cc:2468] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 1.
I20260709 12:22:31.982218 31279 catalog_manager.cc:5697] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.983740 31384 raft_consensus.cc:2393] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9eae65ab07f6425297e6b87360b844fd in current term 1: Already voted for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in this term.
I20260709 12:22:31.983925 31347 leader_election.cc:304] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:31.984077 31708 raft_consensus.cc:515] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.985252 31737 raft_consensus.cc:2804] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:31.985158 31499 leader_election.cc:304] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9eae65ab07f6425297e6b87360b844fd; no voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:31.985966 31737 raft_consensus.cc:697] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:31.987169 31711 raft_consensus.cc:2749] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:31.987275 31708 leader_election.cc:290] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:31.988308 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:31.989017 31460 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.987159 31737 consensus_queue.cc:237] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:31.992316 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:31.992957 31384 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:31.997223 31460 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:31.998546 31497 leader_election.cc:304] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:31.999358 31711 raft_consensus.cc:2804] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.000021 31711 raft_consensus.cc:697] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.001444 31384 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:32.000989 31711 consensus_queue.cc:237] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.010110 31281 catalog_manager.cc:5697] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.014561 31279 catalog_manager.cc:5697] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.118963 31711 consensus_queue.cc:1048] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.131150 31708 consensus_queue.cc:1048] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.228026 31711 raft_consensus.cc:493] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.228540 31711 raft_consensus.cc:515] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.230772 31711 leader_election.cc:290] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:32.231087 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" is_pre_election: true
I20260709 12:22:32.231423 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750" is_pre_election: true
I20260709 12:22:32.231981 31384 raft_consensus.cc:2468] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:32.232173 31460 raft_consensus.cc:2468] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 0.
I20260709 12:22:32.233103 31499 leader_election.cc:304] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:32.233899 31711 raft_consensus.cc:2804] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:32.234272 31711 raft_consensus.cc:493] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.234653 31711 raft_consensus.cc:3060] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.240582 31711 raft_consensus.cc:515] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.242187 31711 leader_election.cc:290] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:32.243041 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:32.243315 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:32.243783 31384 raft_consensus.cc:3060] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.243916 31460 raft_consensus.cc:3060] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:32.251761 31460 raft_consensus.cc:2468] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:32.251765 31384 raft_consensus.cc:2468] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 1.
I20260709 12:22:32.253015 31497 leader_election.cc:304] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:32.253788 31711 raft_consensus.cc:2804] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:32.254190 31711 raft_consensus.cc:697] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.254906 31711 consensus_queue.cc:237] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.263974 31279 catalog_manager.cc:5697] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 1 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:32.322978 31711 consensus_queue.cc:1048] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.331624 31711 consensus_queue.cc:1048] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.390444 31661 consensus_queue.cc:1048] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.402256 31702 consensus_queue.cc:1048] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.415933 31459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
mode: GRACEFUL
new_leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:51380
I20260709 12:22:32.416675 31459 raft_consensus.cc:606] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Received request to transfer leadership to TS 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:32.422524 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:32.423084 31532 raft_consensus.cc:606] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:32.427953 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:32.428411 31532 raft_consensus.cc:606] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:32.432077 31737 consensus_queue.cc:1048] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.435415 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:32.435961 31532 raft_consensus.cc:606] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 1ff8d80cb13e4d8abeb9b265c29961ef
I20260709 12:22:32.446664 31533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:32.447355 31533 raft_consensus.cc:606] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 01dd6da1ae404576a76d694869fc9750
I20260709 12:22:32.447798 31685 consensus_queue.cc:1048] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.455546 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:32.456146 31532 raft_consensus.cc:606] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 01dd6da1ae404576a76d694869fc9750
I20260709 12:22:32.461547 31532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
mode: GRACEFUL
new_leader_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:57940
I20260709 12:22:32.462131 31532 raft_consensus.cc:606] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Received request to transfer leadership to TS 01dd6da1ae404576a76d694869fc9750
I20260709 12:22:32.471508 31384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
mode: GRACEFUL
new_leader_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:50946
I20260709 12:22:32.472056 31384 raft_consensus.cc:606] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Received request to transfer leadership to TS 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:32.479077 31754 consensus_queue.cc:1048] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.491291 31666 consensus_queue.cc:1048] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.499900 31708 raft_consensus.cc:993] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.500484 31754 raft_consensus.cc:1081] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.502625 31383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:50792
I20260709 12:22:32.503301 31383 raft_consensus.cc:493] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.503763 31383 raft_consensus.cc:3060] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.512580 31383 raft_consensus.cc:515] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.513561 31764 raft_consensus.cc:993] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.514205 31754 raft_consensus.cc:1081] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.515690 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:32.516441 31459 raft_consensus.cc:3060] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.517727 31384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:50792
I20260709 12:22:32.518415 31384 raft_consensus.cc:493] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.518822 31384 raft_consensus.cc:3060] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.525388 31459 raft_consensus.cc:2468] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.525933 31384 raft_consensus.cc:515] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.526901 31347 leader_election.cc:304] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:32.527932 31685 raft_consensus.cc:2804] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.528084 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c2eda0a8445c483d029374e41ff58" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.528453 31685 raft_consensus.cc:697] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:32.528748 31533 raft_consensus.cc:3055] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.529151 31533 raft_consensus.cc:740] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.529474 31383 leader_election.cc:290] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.529803 31754 consensus_queue.cc:1048] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.529575 31685 consensus_queue.cc:237] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.530081 31533 consensus_queue.cc:260] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.531352 31533 raft_consensus.cc:3060] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.532145 31384 leader_election.cc:290] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.534281 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.534816 31532 raft_consensus.cc:3055] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.535091 31532 raft_consensus.cc:740] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.535902 31532 consensus_queue.cc:260] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.537173 31532 raft_consensus.cc:3060] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.538296 31533 raft_consensus.cc:2468] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.539997 31279 catalog_manager.cc:5697] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.540689 31459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd98b4bc43b4b2a98d24ee520a281a2" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:32.543664 31459 raft_consensus.cc:3060] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.545214 31532 raft_consensus.cc:2468] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.551450 31348 leader_election.cc:304] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:32.551748 31459 raft_consensus.cc:2468] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.552650 31685 raft_consensus.cc:2804] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.553182 31685 raft_consensus.cc:697] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:32.554234 31685 consensus_queue.cc:237] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.555291 31666 raft_consensus.cc:993] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:32.556031 31764 raft_consensus.cc:1081] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:32.561044 31459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:42490
I20260709 12:22:32.561683 31459 raft_consensus.cc:493] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.562103 31459 raft_consensus.cc:3060] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.562332 31754 consensus_queue.cc:1048] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:32.573220 31459 raft_consensus.cc:515] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.573581 31281 catalog_manager.cc:5697] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.575384 31666 raft_consensus.cc:993] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:32.575994 31666 raft_consensus.cc:1081] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:32.576475 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:32.577095 31384 raft_consensus.cc:3060] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.578729 31460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:42490
I20260709 12:22:32.579308 31460 raft_consensus.cc:493] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.579684 31460 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.579792 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0268aae96e6541408d586b5ad2c04b2e" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.580557 31532 raft_consensus.cc:3055] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.580835 31532 raft_consensus.cc:740] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.581604 31532 consensus_queue.cc:260] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.582854 31532 raft_consensus.cc:3060] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.585096 31384 raft_consensus.cc:2468] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 2.
I20260709 12:22:32.586594 31425 leader_election.cc:304] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:32.587438 31661 raft_consensus.cc:2804] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.587955 31661 raft_consensus.cc:697] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:32.588800 31661 consensus_queue.cc:237] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.589625 31532 raft_consensus.cc:2468] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 2.
I20260709 12:22:32.590456 31459 leader_election.cc:290] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 2 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.591300 31460 raft_consensus.cc:515] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.594339 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:32.594861 31384 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.596498 31460 leader_election.cc:290] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 2 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.597487 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.598068 31532 raft_consensus.cc:3055] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.598412 31532 raft_consensus.cc:740] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.599104 31532 consensus_queue.cc:260] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.600088 31532 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.600886 31279 catalog_manager.cc:5697] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.601992 31384 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 2.
I20260709 12:22:32.603116 31425 leader_election.cc:304] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:32.604009 31661 raft_consensus.cc:2804] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.604468 31661 raft_consensus.cc:697] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:32.605387 31661 consensus_queue.cc:237] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.606186 31532 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 2.
I20260709 12:22:32.616304 31279 catalog_manager.cc:5697] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.650846 31754 consensus_queue.cc:1048] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.661952 31666 consensus_queue.cc:1048] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:32.672674 31711 raft_consensus.cc:993] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:32.673233 31666 raft_consensus.cc:1081] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 01dd6da1ae404576a76d694869fc9750 to start an election
I20260709 12:22:32.674834 31460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
 from {username='slave'} at 127.0.0.1:42490
I20260709 12:22:32.675402 31460 raft_consensus.cc:493] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.675774 31460 raft_consensus.cc:3060] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.681607 31460 raft_consensus.cc:515] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.683734 31460 leader_election.cc:290] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 2 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.684180 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:32.684351 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd8e9c8603476f9405414dbdf21aa5" candidate_uuid: "01dd6da1ae404576a76d694869fc9750" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.684937 31384 raft_consensus.cc:3060] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.685032 31532 raft_consensus.cc:3055] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.685444 31532 raft_consensus.cc:740] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.686213 31532 consensus_queue.cc:260] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.687453 31532 raft_consensus.cc:3060] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.692067 31384 raft_consensus.cc:2468] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 2.
I20260709 12:22:32.693185 31425 leader_election.cc:304] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:32.693892 31661 raft_consensus.cc:2804] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.694329 31661 raft_consensus.cc:697] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Becoming Leader. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:32.694482 31532 raft_consensus.cc:2468] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01dd6da1ae404576a76d694869fc9750 in term 2.
I20260709 12:22:32.695212 31661 consensus_queue.cc:237] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.704192 31281 catalog_manager.cc:5697] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 01dd6da1ae404576a76d694869fc9750 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "01dd6da1ae404576a76d694869fc9750" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.743393 31711 raft_consensus.cc:993] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: : Instructing follower 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.743959 31666 raft_consensus.cc:1081] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Signalling peer 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.745455 31384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:50792
I20260709 12:22:32.745920 31384 raft_consensus.cc:493] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.746214 31384 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.751237 31384 raft_consensus.cc:515] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.752699 31384 leader_election.cc:290] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.753708 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.753625 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:32.754482 31532 raft_consensus.cc:3055] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.754534 31460 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.754865 31532 raft_consensus.cc:740] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:32.755760 31532 consensus_queue.cc:260] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.757061 31532 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.761926 31460 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.763276 31347 leader_election.cc:304] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 1ff8d80cb13e4d8abeb9b265c29961ef; no voters: 
I20260709 12:22:32.764084 31685 raft_consensus.cc:2804] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.764503 31532 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.764536 31685 raft_consensus.cc:697] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:32.765949 31685 consensus_queue.cc:237] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.773108 31281 catalog_manager.cc:5697] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 1 to 2, leader changed from 9eae65ab07f6425297e6b87360b844fd (127.18.132.67) to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.915375 31661 raft_consensus.cc:993] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: : Instructing follower 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.915938 31702 raft_consensus.cc:1081] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Signalling peer 1ff8d80cb13e4d8abeb9b265c29961ef to start an election
I20260709 12:22:32.917435 31384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
 from {username='slave'} at 127.0.0.1:50780
I20260709 12:22:32.917919 31384 raft_consensus.cc:493] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:32.918200 31384 raft_consensus.cc:3060] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.923920 31384 raft_consensus.cc:515] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.925534 31384 leader_election.cc:290] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Requested vote from peers 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267), 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267)
I20260709 12:22:32.926508 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:32.926596 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6ad7de6a334859b17dd7d72886ca6c" candidate_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
I20260709 12:22:32.927126 31460 raft_consensus.cc:3055] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:32.927281 31532 raft_consensus.cc:3060] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.927412 31460 raft_consensus.cc:740] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:32.928293 31460 consensus_queue.cc:260] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.929316 31460 raft_consensus.cc:3060] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.932834 31532 raft_consensus.cc:2468] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.934105 31348 leader_election.cc:304] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:32.934824 31460 raft_consensus.cc:2468] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ff8d80cb13e4d8abeb9b265c29961ef in term 2.
I20260709 12:22:32.934888 31685 raft_consensus.cc:2804] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:32.935534 31685 raft_consensus.cc:697] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Leader. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:32.936385 31685 consensus_queue.cc:237] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:32.944808 31532 raft_consensus.cc:1275] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:32.946110 31685 consensus_queue.cc:1048] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:32.945468 31281 catalog_manager.cc:5697] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef reported cstate change: term changed from 1 to 2, leader changed from 01dd6da1ae404576a76d694869fc9750 (127.18.132.66) to 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:32.955053 31460 raft_consensus.cc:1275] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:32.964397 31737 consensus_queue.cc:1048] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.008641 31685 raft_consensus.cc:993] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: : Instructing follower 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:33.009202 31771 raft_consensus.cc:1081] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Signalling peer 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:33.010797 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:22:33.011348 31532 raft_consensus.cc:493] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.011796 31532 raft_consensus.cc:3060] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.018162 31532 raft_consensus.cc:515] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:33.019785 31532 leader_election.cc:290] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 2 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:33.020514 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:33.021061 31460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a44b2ecd297142058daa88bb99c000f1" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:33.021229 31384 raft_consensus.cc:3055] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:33.021701 31460 raft_consensus.cc:3060] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.021709 31384 raft_consensus.cc:740] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:33.022607 31383 raft_consensus.cc:1275] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.022735 31384 consensus_queue.cc:260] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:33.024142 31384 raft_consensus.cc:3060] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:33.024138 31702 consensus_queue.cc:1048] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.029237 31460 raft_consensus.cc:2468] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 2.
I20260709 12:22:33.030441 31497 leader_election.cc:304] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:33.031952 31666 raft_consensus.cc:2804] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.032342 31384 raft_consensus.cc:2468] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 2.
I20260709 12:22:33.032461 31666 raft_consensus.cc:697] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 2 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:33.033493 31666 consensus_queue.cc:237] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:33.035240 31533 raft_consensus.cc:1275] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.037251 31771 consensus_queue.cc:1048] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.038534 31532 raft_consensus.cc:1275] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.040158 31702 consensus_queue.cc:1048] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.043555 31281 catalog_manager.cc:5697] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 1 to 2, leader changed from 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65) to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 2 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.058661 31460 raft_consensus.cc:1275] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.060801 31737 consensus_queue.cc:1048] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.081997 31532 raft_consensus.cc:1275] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.083199 31702 consensus_queue.cc:1048] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.090798 31384 raft_consensus.cc:1275] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.092473 31661 consensus_queue.cc:1048] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.103343 31384 raft_consensus.cc:1275] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.104959 31702 consensus_queue.cc:1048] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.114449 31532 raft_consensus.cc:1275] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 01dd6da1ae404576a76d694869fc9750: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.115829 31661 consensus_queue.cc:1048] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.250223 31460 raft_consensus.cc:1275] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.252043 31771 consensus_queue.cc:1048] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:33.262190 31532 raft_consensus.cc:1275] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.263831 31771 consensus_queue.cc:1048] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.464911 31532 raft_consensus.cc:1275] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.466244 31771 consensus_queue.cc:1048] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.475396 31460 raft_consensus.cc:1275] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 1ff8d80cb13e4d8abeb9b265c29961ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.476994 31685 consensus_queue.cc:1048] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.481683 31383 raft_consensus.cc:1275] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.484575 31666 consensus_queue.cc:1048] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.501082 31460 raft_consensus.cc:1275] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:33.502774 31666 consensus_queue.cc:1048] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:35.476065 31278 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59934:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:22:35.498417 31278 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59934:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:22:35.581698 31807 tablet.cc:1724] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.600284 31810 tablet.cc:1724] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.618804 31814 tablet.cc:1724] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:35.668421 31348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:37267, user_credentials={real_user=slave}} blocked reactor thread for 49113.4us
I20260709 12:22:35.636356 31815 tablet.cc:1724] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.697763 31823 tablet.cc:1724] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.719113 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:22:35.727936 31486 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:0268aae96e6541408d586b5ad2c04b2e)
W20260709 12:22:35.729146 31486 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:0268aae96e6541408d586b5ad2c04b2e)
W20260709 12:22:35.731434 31425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:39611, user_credentials={real_user=slave}} blocked reactor thread for 58265.8us
I20260709 12:22:35.769085 31830 tablet.cc:1724] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:35.780894 31560 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:0268aae96e6541408d586b5ad2c04b2e)
I20260709 12:22:35.784516 31807 tablet.cc:1724] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.783015 31834 tablet.cc:1724] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.786106 31818 tablet.cc:1724] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:35.846628 31497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:36267, user_credentials={real_user=slave}} blocked reactor thread for 92520.6us
I20260709 12:22:35.918394 31839 tablet.cc:1724] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.924443 31810 tablet.cc:1724] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.947482 31851 tablet.cc:1724] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.958472 31815 tablet.cc:1724] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.959635 31823 tablet.cc:1724] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.964627 31814 tablet.cc:1724] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.968837 31834 tablet.cc:1724] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:35.972079 31842 log.cc:927] Time spent T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 12:22:35.973362 31818 tablet.cc:1724] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:35.966917 31845 tablet.cc:1724] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.004904 31850 tablet.cc:1724] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.018708 31830 tablet.cc:1724] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.020931 31278 catalog_manager.cc:5789] TS 9eae65ab07f6425297e6b87360b844fd (127.18.132.67:37267) does not have the latest schema for tablet a44b2ecd297142058daa88bb99c000f1 (table soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]). Expected version 1 got 0
I20260709 12:22:36.024924 31279 catalog_manager.cc:5789] TS 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267) does not have the latest schema for tablet 736cc75f5ed54fe398e3811e3de1661d (table soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]). Expected version 1 got 0
I20260709 12:22:36.025851 31279 catalog_manager.cc:5789] TS 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267) does not have the latest schema for tablet f3dd8e9c8603476f9405414dbdf21aa5 (table soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]). Expected version 1 got 0
I20260709 12:22:36.026593 31279 catalog_manager.cc:5789] TS 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267) does not have the latest schema for tablet 45694a8578ce4797bc5fba3e3e3c638b (table soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103]). Expected version 1 got 0
I20260709 12:22:36.042263 31815 tablet.cc:1724] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.042388 31823 tablet.cc:1724] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.061570 31845 tablet.cc:1724] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.063180 31823 tablet.cc:1724] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.064704 31851 tablet.cc:1724] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.071170 31814 tablet.cc:1724] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.076299 31810 tablet.cc:1724] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:36.081105 31457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
mode: GRACEFUL
new_leader_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:51392
I20260709 12:22:36.082023 31457 raft_consensus.cc:606] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Received request to transfer leadership to TS 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:36.125201 31381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
mode: GRACEFUL
new_leader_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:50950
I20260709 12:22:36.125958 31381 raft_consensus.cc:606] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Received request to transfer leadership to TS 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:36.128422 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:22:36.129037 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.139350 31457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805"
dest_uuid: "01dd6da1ae404576a76d694869fc9750"
mode: GRACEFUL
new_leader_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:51392
I20260709 12:22:36.140087 31457 raft_consensus.cc:606] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 LEADER]: Received request to transfer leadership to TS 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:36.139914 31279 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f: soft_deleted_table [id=09583e146cb74c2da9717c1ed08be103] alter complete (version 1)
I20260709 12:22:36.144479 31381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789"
dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
mode: GRACEFUL
new_leader_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:50950
I20260709 12:22:36.145074 31381 raft_consensus.cc:606] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Received request to transfer leadership to TS 9eae65ab07f6425297e6b87360b844fd
I20260709 12:22:36.146390 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:36.146826 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.440584 31661 raft_consensus.cc:993] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: : Instructing follower 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.441174 31831 raft_consensus.cc:1081] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 LEADER]: Signalling peer 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.442577 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:54464
I20260709 12:22:36.443033 31532 raft_consensus.cc:493] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.443284 31532 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.449208 31532 raft_consensus.cc:515] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.450744 31532 leader_election.cc:290] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 4 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:36.451663 31381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:36.451887 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f955bce464f4a3d8b537eff14ebe805" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:36.452442 31381 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.452529 31457 raft_consensus.cc:3055] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.452960 31457 raft_consensus.cc:740] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:36.453660 31457 consensus_queue.cc:260] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.454747 31457 raft_consensus.cc:3060] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.458489 31381 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 4.
I20260709 12:22:36.459803 31499 leader_election.cc:304] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:36.460799 31841 raft_consensus.cc:2804] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:36.460904 31457 raft_consensus.cc:2468] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 4.
I20260709 12:22:36.461265 31841 raft_consensus.cc:697] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 4 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:36.462248 31841 consensus_queue.cc:237] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.469363 31661 raft_consensus.cc:993] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: : Instructing follower 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.469817 31661 raft_consensus.cc:1081] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Signalling peer 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.470785 31828 raft_consensus.cc:993] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: : Instructing follower 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.471810 31528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:54464
I20260709 12:22:36.471557 31278 catalog_manager.cc:5697] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 3 to 4, leader changed from 01dd6da1ae404576a76d694869fc9750 (127.18.132.66) to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 4 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.472641 31528 raft_consensus.cc:493] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.473145 31528 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.472110 31819 raft_consensus.cc:1081] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Signalling peer 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.475265 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:22:36.475827 31532 raft_consensus.cc:493] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.476166 31532 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.481276 31528 raft_consensus.cc:515] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.483884 31528 leader_election.cc:290] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 3 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:36.484171 31381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:36.484159 31532 raft_consensus.cc:515] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.484632 31457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736cc75f5ed54fe398e3811e3de1661d" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:36.485128 31381 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.485373 31457 raft_consensus.cc:3055] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.485726 31457 raft_consensus.cc:740] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01dd6da1ae404576a76d694869fc9750, State: Running, Role: LEADER
I20260709 12:22:36.486474 31532 leader_election.cc:290] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 3 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:36.486655 31457 consensus_queue.cc:260] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.487164 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:36.487820 31382 raft_consensus.cc:3055] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.488190 31382 raft_consensus.cc:740] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:36.488559 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a066e76e16964b22a262b5007d2eb789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:36.488862 31457 raft_consensus.cc:3060] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.489173 31458 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.489045 31382 consensus_queue.cc:260] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.490674 31382 raft_consensus.cc:3060] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.493682 31381 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 3.
I20260709 12:22:36.495031 31499 leader_election.cc:304] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff8d80cb13e4d8abeb9b265c29961ef, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:36.495942 31841 raft_consensus.cc:2804] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:36.496435 31841 raft_consensus.cc:697] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 3 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:36.497085 31457 raft_consensus.cc:2468] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 3.
I20260709 12:22:36.497210 31458 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 3.
I20260709 12:22:36.497305 31841 consensus_queue.cc:237] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.499763 31497 leader_election.cc:304] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:36.500555 31835 raft_consensus.cc:2804] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:36.501034 31835 raft_consensus.cc:697] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 3 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:36.501855 31835 consensus_queue.cc:237] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.502936 31382 raft_consensus.cc:2468] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 3.
I20260709 12:22:36.510180 31278 catalog_manager.cc:5697] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 2 to 3, leader changed from 01dd6da1ae404576a76d694869fc9750 (127.18.132.66) to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 3 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.522720 31278 catalog_manager.cc:5697] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 2 to 3, leader changed from 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65) to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 3 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.551805 31828 raft_consensus.cc:993] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: : Instructing follower 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.552302 31819 raft_consensus.cc:1081] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Signalling peer 9eae65ab07f6425297e6b87360b844fd to start an election
I20260709 12:22:36.553638 31532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789"
dest_uuid: "9eae65ab07f6425297e6b87360b844fd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:22:36.554102 31532 raft_consensus.cc:493] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:36.554426 31532 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.560267 31532 raft_consensus.cc:515] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.561987 31532 leader_election.cc:290] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 3 election: Requested vote from peers 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611), 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267)
I20260709 12:22:36.562721 31381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef"
I20260709 12:22:36.563102 31458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b986577335a348c883f0c6c9b9f7a789" candidate_uuid: "9eae65ab07f6425297e6b87360b844fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01dd6da1ae404576a76d694869fc9750"
I20260709 12:22:36.563339 31381 raft_consensus.cc:3055] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:36.563822 31381 raft_consensus.cc:740] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ff8d80cb13e4d8abeb9b265c29961ef, State: Running, Role: LEADER
I20260709 12:22:36.563856 31458 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.564834 31381 consensus_queue.cc:260] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.566274 31381 raft_consensus.cc:3060] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:36.570159 31458 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 3.
I20260709 12:22:36.571280 31497 leader_election.cc:304] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01dd6da1ae404576a76d694869fc9750, 9eae65ab07f6425297e6b87360b844fd; no voters: 
I20260709 12:22:36.572075 31781 raft_consensus.cc:2804] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:36.572556 31781 raft_consensus.cc:697] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 3 LEADER]: Becoming Leader. State: Replica: 9eae65ab07f6425297e6b87360b844fd, State: Running, Role: LEADER
I20260709 12:22:36.572633 31381 raft_consensus.cc:2468] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eae65ab07f6425297e6b87360b844fd in term 3.
I20260709 12:22:36.573510 31781 consensus_queue.cc:237] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } }
I20260709 12:22:36.582705 31278 catalog_manager.cc:5697] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd reported cstate change: term changed from 2 to 3, leader changed from 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65) to 9eae65ab07f6425297e6b87360b844fd (127.18.132.67). New cstate: current_term: 3 leader_uuid: "9eae65ab07f6425297e6b87360b844fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9eae65ab07f6425297e6b87360b844fd" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 37267 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:36.880762 31458 raft_consensus.cc:1275] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 4 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:36.882131 31781 consensus_queue.cc:1048] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.893366 31381 raft_consensus.cc:1275] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 4 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:36.895104 31835 consensus_queue.cc:1048] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.924005 31457 raft_consensus.cc:1275] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:36.925577 31835 consensus_queue.cc:1048] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:36.935667 31381 raft_consensus.cc:1275] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:36.937258 31841 consensus_queue.cc:1048] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:36.968915 31381 raft_consensus.cc:1275] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:36.970528 31835 consensus_queue.cc:1048] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:36.981084 31457 raft_consensus.cc:1275] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:36.982681 31868 consensus_queue.cc:1048] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:37.038566 31381 raft_consensus.cc:1275] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:37.039988 31868 consensus_queue.cc:1048] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff8d80cb13e4d8abeb9b265c29961ef" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 39611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:37.048950 31457 raft_consensus.cc:1275] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Refusing update from remote peer 9eae65ab07f6425297e6b87360b844fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:37.050539 31781 consensus_queue.cc:1048] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "01dd6da1ae404576a76d694869fc9750" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:37.148002 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:37.153508 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:37.153992 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.159092 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:37.159546 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:38.160605 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:38.165966 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:38.166441 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.171136 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:38.171516 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:39.172603 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:39.178002 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:39.178498 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.183444 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:39.183780 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:40.184747 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:40.191509 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.192071 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:40.196761 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.197156 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.198328 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:41.204334 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:41.204911 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.211050 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:41.211464 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:42.329012 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:42.371246 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.372598 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.383960 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.384752 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:43.165343 31405 debug-util.cc:398] Leaking SignalData structure 0x7b080030ab40 after lost signal to thread 18964
W20260709 12:22:43.166887 31405 debug-util.cc:398] Leaking SignalData structure 0x7b0800392ce0 after lost signal to thread 31316
W20260709 12:22:43.168423 31405 debug-util.cc:398] Leaking SignalData structure 0x7b0800288aa0 after lost signal to thread 31409
W20260709 12:22:43.169648 31405 debug-util.cc:398] Leaking SignalData structure 0x7b080035c320 after lost signal to thread 31484
W20260709 12:22:43.170838 31405 debug-util.cc:398] Leaking SignalData structure 0x7b080013e700 after lost signal to thread 31558
I20260709 12:22:43.386544 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:43.395876 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:43.396508 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.404770 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:43.405336 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.406719 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:44.414937 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:44.415658 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.422389 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:44.422780 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.423979 18961 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:22:45.429410 18961 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:22:45.429885 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.437003 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:45.437491 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.498840 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
I20260709 12:22:46.542541 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:46.543422 18961 tablet_replica.cc:333] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.544538 18961 raft_consensus.cc:2243] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.545755 18961 raft_consensus.cc:2272] T 45694a8578ce4797bc5fba3e3e3c638b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.550146 18961 tablet_replica.cc:333] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.551596 18961 raft_consensus.cc:2243] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.552573 18961 raft_consensus.cc:2272] T a44b2ecd297142058daa88bb99c000f1 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.556397 18961 tablet_replica.cc:333] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.557117 18961 raft_consensus.cc:2243] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.557840 18961 raft_consensus.cc:2272] T 0268aae96e6541408d586b5ad2c04b2e P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.562012 18961 tablet_replica.cc:333] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.562851 18961 raft_consensus.cc:2243] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.564110 18961 raft_consensus.cc:2272] T edd98b4bc43b4b2a98d24ee520a281a2 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.566789 18961 tablet_replica.cc:333] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.567526 18961 raft_consensus.cc:2243] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.568109 18961 raft_consensus.cc:2272] T a066e76e16964b22a262b5007d2eb789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.570850 18961 tablet_replica.cc:333] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.571523 18961 raft_consensus.cc:2243] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.572145 18961 raft_consensus.cc:2272] T f3dd8e9c8603476f9405414dbdf21aa5 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.574747 18961 tablet_replica.cc:333] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.575402 18961 raft_consensus.cc:2243] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.576072 18961 raft_consensus.cc:2272] T 736cc75f5ed54fe398e3811e3de1661d P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.578619 18961 tablet_replica.cc:333] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.579214 18961 raft_consensus.cc:2243] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.580341 18961 raft_consensus.cc:2272] T 9a6ad7de6a334859b17dd7d72886ca6c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.582934 18961 tablet_replica.cc:333] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.583609 18961 raft_consensus.cc:2243] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.584695 18961 raft_consensus.cc:2272] T 606c2eda0a8445c483d029374e41ff58 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:46.586548 31425 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 12:22:46.588476 18961 tablet_replica.cc:333] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.589432 18961 raft_consensus.cc:2243] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.590121 18961 raft_consensus.cc:2272] T 1946d02b4477418db137ece17af0fa38 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:46.590535 31425 consensus_peers.cc:597] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.593293 18961 tablet_replica.cc:333] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.594020 18961 raft_consensus.cc:2243] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.594597 18961 raft_consensus.cc:2272] T 47c87e7aed8f4af98f22e77b6cc0c24c P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.597527 18961 tablet_replica.cc:333] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.598147 18961 raft_consensus.cc:2243] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.598649 18961 raft_consensus.cc:2272] T b92c02e4234a41ada8be4b831541c0c0 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.601518 18961 tablet_replica.cc:333] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.602147 18961 raft_consensus.cc:2243] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.603192 18961 raft_consensus.cc:2272] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.605998 18961 tablet_replica.cc:333] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.606627 18961 raft_consensus.cc:2243] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.607296 18961 raft_consensus.cc:2272] T 7f955bce464f4a3d8b537eff14ebe805 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.610441 18961 tablet_replica.cc:333] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.611023 18961 raft_consensus.cc:2243] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.612152 18961 raft_consensus.cc:2272] T ffed97c67b394156b3d2f394d5f9683b P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.615007 18961 tablet_replica.cc:333] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.615716 18961 raft_consensus.cc:2243] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.616302 18961 raft_consensus.cc:2272] T b986577335a348c883f0c6c9b9f7a789 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.618839 18961 tablet_replica.cc:333] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.619408 18961 raft_consensus.cc:2243] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.620489 18961 raft_consensus.cc:2272] T f2722ac415d549faa1fabd2749db3f81 P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.623179 18961 tablet_replica.cc:333] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef: stopping tablet replica
I20260709 12:22:46.623879 18961 raft_consensus.cc:2243] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.624464 18961 raft_consensus.cc:2272] T d823a306626d49339205b1d3c96988bd P 1ff8d80cb13e4d8abeb9b265c29961ef [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:46.663380 31425 consensus_peers.cc:597] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:46.678570 31499 consensus_peers.cc:597] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:46.683826 31425 consensus_peers.cc:597] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.710140 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
W20260709 12:22:46.712836 31425 consensus_peers.cc:597] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.765549 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
I20260709 12:22:46.804177 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:46.804953 18961 tablet_replica.cc:333] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.806066 18961 raft_consensus.cc:2243] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.807322 18961 raft_consensus.cc:2272] T f3dd8e9c8603476f9405414dbdf21aa5 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.811635 18961 tablet_replica.cc:333] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.812637 18961 raft_consensus.cc:2243] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:46.813721 31499 consensus_peers.cc:597] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.813805 18961 raft_consensus.cc:2272] T 45694a8578ce4797bc5fba3e3e3c638b P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.817018 18961 tablet_replica.cc:333] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.817750 18961 raft_consensus.cc:2243] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.818287 18961 raft_consensus.cc:2272] T 736cc75f5ed54fe398e3811e3de1661d P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.821391 18961 tablet_replica.cc:333] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.822207 18961 raft_consensus.cc:2243] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.822798 18961 raft_consensus.cc:2272] T a44b2ecd297142058daa88bb99c000f1 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:46.823940 31499 consensus_peers.cc:597] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.825817 18961 tablet_replica.cc:333] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.826570 18961 raft_consensus.cc:2243] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.827632 18961 raft_consensus.cc:2272] T 0268aae96e6541408d586b5ad2c04b2e P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.830154 18961 tablet_replica.cc:333] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.830912 18961 raft_consensus.cc:2243] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.831465 18961 raft_consensus.cc:2272] T edd98b4bc43b4b2a98d24ee520a281a2 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.833990 18961 tablet_replica.cc:333] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.834625 18961 raft_consensus.cc:2243] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.835348 18961 raft_consensus.cc:2272] T a066e76e16964b22a262b5007d2eb789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.838981 18961 tablet_replica.cc:333] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
W20260709 12:22:46.839298 31497 consensus_peers.cc:597] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd -> Peer 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267): Couldn't send request to peer 01dd6da1ae404576a76d694869fc9750. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.839706 18961 raft_consensus.cc:2243] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.840404 18961 raft_consensus.cc:2272] T 9a6ad7de6a334859b17dd7d72886ca6c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.842869 18961 tablet_replica.cc:333] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.843515 18961 raft_consensus.cc:2243] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.844144 18961 raft_consensus.cc:2272] T 606c2eda0a8445c483d029374e41ff58 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.846725 18961 tablet_replica.cc:333] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.847335 18961 raft_consensus.cc:2243] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.848652 18961 raft_consensus.cc:2272] T 1946d02b4477418db137ece17af0fa38 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.851886 18961 tablet_replica.cc:333] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.852658 18961 raft_consensus.cc:2243] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.853259 18961 raft_consensus.cc:2272] T ffed97c67b394156b3d2f394d5f9683b P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:46.854204 31499 consensus_peers.cc:597] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.856091 18961 tablet_replica.cc:333] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.856789 18961 raft_consensus.cc:2243] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.857293 18961 raft_consensus.cc:2272] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.859833 18961 tablet_replica.cc:333] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.860419 18961 raft_consensus.cc:2243] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.860960 18961 raft_consensus.cc:2272] T 7f955bce464f4a3d8b537eff14ebe805 P 01dd6da1ae404576a76d694869fc9750 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.863708 18961 tablet_replica.cc:333] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.864319 18961 raft_consensus.cc:2243] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.864926 18961 raft_consensus.cc:2272] T b986577335a348c883f0c6c9b9f7a789 P 01dd6da1ae404576a76d694869fc9750 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.867447 18961 tablet_replica.cc:333] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.868067 18961 raft_consensus.cc:2243] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.869127 18961 raft_consensus.cc:2272] T d823a306626d49339205b1d3c96988bd P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.871706 18961 tablet_replica.cc:333] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.872321 18961 raft_consensus.cc:2243] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.872818 18961 raft_consensus.cc:2272] T f2722ac415d549faa1fabd2749db3f81 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.876060 18961 tablet_replica.cc:333] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.876842 18961 raft_consensus.cc:2243] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:46.877943 18961 raft_consensus.cc:2272] T b92c02e4234a41ada8be4b831541c0c0 P 01dd6da1ae404576a76d694869fc9750 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:46.878664 31499 consensus_peers.cc:597] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd -> Peer 1ff8d80cb13e4d8abeb9b265c29961ef (127.18.132.65:39611): Couldn't send request to peer 1ff8d80cb13e4d8abeb9b265c29961ef. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:39611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:46.880735 18961 tablet_replica.cc:333] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750: stopping tablet replica
I20260709 12:22:46.881390 18961 raft_consensus.cc:2243] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:46.881902 18961 raft_consensus.cc:2272] T 47c87e7aed8f4af98f22e77b6cc0c24c P 01dd6da1ae404576a76d694869fc9750 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:46.929468 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
I20260709 12:22:46.975364 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
I20260709 12:22:47.009806 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:47.010557 18961 tablet_replica.cc:333] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.011487 18961 raft_consensus.cc:2243] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.012384 18961 raft_consensus.cc:2272] T f3dd8e9c8603476f9405414dbdf21aa5 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.015657 18961 tablet_replica.cc:333] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.016547 18961 raft_consensus.cc:2243] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.017198 18961 raft_consensus.cc:2272] T 45694a8578ce4797bc5fba3e3e3c638b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:47.017288 31497 consensus_peers.cc:597] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd -> Peer 01dd6da1ae404576a76d694869fc9750 (127.18.132.66:36267): Couldn't send request to peer 01dd6da1ae404576a76d694869fc9750. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.66:36267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:47.019778 18961 tablet_replica.cc:333] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.020640 18961 raft_consensus.cc:2243] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.021564 18961 raft_consensus.cc:2272] T 736cc75f5ed54fe398e3811e3de1661d P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.024118 18961 tablet_replica.cc:333] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.024772 18961 raft_consensus.cc:2243] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.025704 18961 raft_consensus.cc:2272] T a066e76e16964b22a262b5007d2eb789 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.028203 18961 tablet_replica.cc:333] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.028834 18961 raft_consensus.cc:2243] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.029747 18961 raft_consensus.cc:2272] T a44b2ecd297142058daa88bb99c000f1 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.032132 18961 tablet_replica.cc:333] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.032765 18961 raft_consensus.cc:2243] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.033360 18961 raft_consensus.cc:2272] T 0268aae96e6541408d586b5ad2c04b2e P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.035775 18961 tablet_replica.cc:333] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.036409 18961 raft_consensus.cc:2243] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.036933 18961 raft_consensus.cc:2272] T edd98b4bc43b4b2a98d24ee520a281a2 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.039245 18961 tablet_replica.cc:333] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.039901 18961 raft_consensus.cc:2243] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.040412 18961 raft_consensus.cc:2272] T 9a6ad7de6a334859b17dd7d72886ca6c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.042680 18961 tablet_replica.cc:333] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.043251 18961 raft_consensus.cc:2243] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.043816 18961 raft_consensus.cc:2272] T 606c2eda0a8445c483d029374e41ff58 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.046072 18961 tablet_replica.cc:333] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.046631 18961 raft_consensus.cc:2243] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.047097 18961 raft_consensus.cc:2272] T 1946d02b4477418db137ece17af0fa38 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.049401 18961 tablet_replica.cc:333] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.049957 18961 raft_consensus.cc:2243] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.050917 18961 raft_consensus.cc:2272] T b986577335a348c883f0c6c9b9f7a789 P 9eae65ab07f6425297e6b87360b844fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.053603 18961 tablet_replica.cc:333] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.054435 18961 raft_consensus.cc:2243] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.055173 18961 raft_consensus.cc:2272] T d823a306626d49339205b1d3c96988bd P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.058125 18961 tablet_replica.cc:333] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.058765 18961 raft_consensus.cc:2243] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.059247 18961 raft_consensus.cc:2272] T f2722ac415d549faa1fabd2749db3f81 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.061601 18961 tablet_replica.cc:333] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.062144 18961 raft_consensus.cc:2243] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.063081 18961 raft_consensus.cc:2272] T 47c87e7aed8f4af98f22e77b6cc0c24c P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.065568 18961 tablet_replica.cc:333] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.066138 18961 raft_consensus.cc:2243] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.066596 18961 raft_consensus.cc:2272] T b92c02e4234a41ada8be4b831541c0c0 P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.069195 18961 tablet_replica.cc:333] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.069715 18961 raft_consensus.cc:2243] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.070180 18961 raft_consensus.cc:2272] T ffed97c67b394156b3d2f394d5f9683b P 9eae65ab07f6425297e6b87360b844fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.072609 18961 tablet_replica.cc:333] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.073125 18961 raft_consensus.cc:2243] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.074035 18961 raft_consensus.cc:2272] T 7f955bce464f4a3d8b537eff14ebe805 P 9eae65ab07f6425297e6b87360b844fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.076428 18961 tablet_replica.cc:333] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd: stopping tablet replica
I20260709 12:22:47.076964 18961 raft_consensus.cc:2243] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:47.077450 18961 raft_consensus.cc:2272] T 5a9bdacf1dd14e0da7b2a4fff1cef146 P 9eae65ab07f6425297e6b87360b844fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.122939 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
I20260709 12:22:47.167196 18961 master.cc:562] Master@127.18.132.126:38887 shutting down...
I20260709 12:22:47.206390 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:47.207130 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:47.207507 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P c4c10e27db464effb8b56106b78e149f: stopping tablet replica
I20260709 12:22:47.229202 18961 master.cc:584] Master@127.18.132.126:38887 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22809 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:22:47.289510 18961 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.132.126:40431
I20260709 12:22:47.290843 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:47.296877 31899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.296912 31900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.298241 31902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:47.299654 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:47.300904 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:47.301085 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:47.301282 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599767301247 us; error 0 us; skew 500 ppm
I20260709 12:22:47.301821 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:47.304517 18961 webserver.cc:533] Webserver started at http://127.18.132.126:33519/ using document root <none> and password file <none>
I20260709 12:22:47.305047 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:47.305256 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:47.305543 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:47.306811 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/master-0-root/instance:
uuid: "6184f374be9a46069d73f958c1513bfa"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.311385 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:47.314778 31907 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.315514 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:47.315845 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/master-0-root
uuid: "6184f374be9a46069d73f958c1513bfa"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.316152 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:47.337553 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:47.338797 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:47.381573 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.126:40431
I20260709 12:22:47.381690 31958 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.126:40431 every 8 connection(s)
I20260709 12:22:47.385932 31959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.399152 31959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa: Bootstrap starting.
I20260709 12:22:47.404621 31959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.409260 31959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa: No bootstrap required, opened a new log
I20260709 12:22:47.411856 31959 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184f374be9a46069d73f958c1513bfa" member_type: VOTER }
I20260709 12:22:47.412313 31959 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.412563 31959 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184f374be9a46069d73f958c1513bfa, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.413254 31959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184f374be9a46069d73f958c1513bfa" member_type: VOTER }
I20260709 12:22:47.413774 31959 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:47.414000 31959 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:47.414280 31959 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.419745 31959 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184f374be9a46069d73f958c1513bfa" member_type: VOTER }
I20260709 12:22:47.420293 31959 leader_election.cc:304] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6184f374be9a46069d73f958c1513bfa; no voters: 
I20260709 12:22:47.421468 31959 leader_election.cc:290] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:47.421943 31962 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.423473 31962 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 1 LEADER]: Becoming Leader. State: Replica: 6184f374be9a46069d73f958c1513bfa, State: Running, Role: LEADER
I20260709 12:22:47.424239 31962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184f374be9a46069d73f958c1513bfa" member_type: VOTER }
I20260709 12:22:47.424744 31959 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:47.429354 31963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6184f374be9a46069d73f958c1513bfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184f374be9a46069d73f958c1513bfa" member_type: VOTER } }
I20260709 12:22:47.430064 31963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:47.429904 31964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6184f374be9a46069d73f958c1513bfa. Latest consensus state: current_term: 1 leader_uuid: "6184f374be9a46069d73f958c1513bfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6184f374be9a46069d73f958c1513bfa" member_type: VOTER } }
I20260709 12:22:47.430507 31964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:47.432770 31968 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:47.441728 31968 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:47.442837 18961 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:47.451817 31968 catalog_manager.cc:1383] Generated new cluster ID: ad3aa46f2d9d4ed1a6889367e6b32bf8
I20260709 12:22:47.452164 31968 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:47.469686 31968 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:47.471320 31968 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:47.489696 31968 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa: Generated new TSK 0
I20260709 12:22:47.490422 31968 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:47.509689 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:47.516597 31980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.517761 31981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.519624 31983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:47.519906 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:47.521371 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:47.521632 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:47.521819 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599767521799 us; error 0 us; skew 500 ppm
I20260709 12:22:47.522318 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:47.524823 18961 webserver.cc:533] Webserver started at http://127.18.132.65:33893/ using document root <none> and password file <none>
I20260709 12:22:47.525290 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:47.525449 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:47.525748 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:47.527004 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-0-root/instance:
uuid: "1c53af950ae844c8a8536d8181a55c7f"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.531711 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:47.535193 31988 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.536091 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:47.536394 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-0-root
uuid: "1c53af950ae844c8a8536d8181a55c7f"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.536645 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:47.547927 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:47.549137 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:47.550547 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:47.552878 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:47.553067 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.553356 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:47.553531 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.600248 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.65:46409
I20260709 12:22:47.600365 32050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.65:46409 every 8 connection(s)
I20260709 12:22:47.605950 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:47.613808 32055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.614727 32056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:47.618098 18961 server_base.cc:1061] running on GCE node
W20260709 12:22:47.619618 32058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:47.620949 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:47.621177 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:47.621392 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599767621370 us; error 0 us; skew 500 ppm
I20260709 12:22:47.622045 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:47.622133 32051 heartbeater.cc:344] Connected to a master server at 127.18.132.126:40431
I20260709 12:22:47.622663 32051 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:47.623665 32051 heartbeater.cc:507] Master 127.18.132.126:40431 requested a full tablet report, sending...
I20260709 12:22:47.625294 18961 webserver.cc:533] Webserver started at http://127.18.132.66:36551/ using document root <none> and password file <none>
I20260709 12:22:47.626058 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:47.626278 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:47.626564 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:47.626556 31924 ts_manager.cc:194] Registered new tserver with Master: 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409)
I20260709 12:22:47.628317 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-1-root/instance:
uuid: "483ed0fc9c0643bcbd0b017459719bb5"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.629235 31924 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33850
I20260709 12:22:47.633567 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:47.637552 32063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.638348 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:47.638662 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-1-root
uuid: "483ed0fc9c0643bcbd0b017459719bb5"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.638973 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:47.672919 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:47.674309 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:47.675961 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:47.678498 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:47.678725 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.678984 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:47.679164 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.727137 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.66:36035
I20260709 12:22:47.727270 32125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.66:36035 every 8 connection(s)
I20260709 12:22:47.732574 18961 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:47.740965 32129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.743115 32130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:47.746469 32132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:47.746680 18961 server_base.cc:1061] running on GCE node
I20260709 12:22:47.746821 32126 heartbeater.cc:344] Connected to a master server at 127.18.132.126:40431
I20260709 12:22:47.747516 32126 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:47.748215 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:47.748577 18961 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:47.748569 32126 heartbeater.cc:507] Master 127.18.132.126:40431 requested a full tablet report, sending...
I20260709 12:22:47.749089 18961 hybrid_clock.cc:648] HybridClock initialized: now 1783599767749062 us; error 0 us; skew 500 ppm
I20260709 12:22:47.750017 18961 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:47.751272 31924 ts_manager.cc:194] Registered new tserver with Master: 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:47.752980 18961 webserver.cc:533] Webserver started at http://127.18.132.67:44287/ using document root <none> and password file <none>
I20260709 12:22:47.753121 31924 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33864
I20260709 12:22:47.753687 18961 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:47.753948 18961 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:47.754343 18961 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:47.756211 18961 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-2-root/instance:
uuid: "30db6569e3354597b9c74a961b09980f"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.760947 18961 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:47.764508 32137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.765285 18961 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:47.765552 18961 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-2-root
uuid: "30db6569e3354597b9c74a961b09980f"
format_stamp: "Formatted at 2026-07-09 12:22:47 on dist-test-slave-xbvc"
I20260709 12:22:47.765816 18961 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskstXtSb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348522187-18961-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:47.786827 18961 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:47.788199 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:47.789705 18961 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:47.792081 18961 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:47.792294 18961 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.792568 18961 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:47.792735 18961 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:47.838027 18961 rpc_server.cc:307] RPC server started. Bound to: 127.18.132.67:43891
I20260709 12:22:47.838125 32199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.18.132.67:43891 every 8 connection(s)
I20260709 12:22:47.853075 32200 heartbeater.cc:344] Connected to a master server at 127.18.132.126:40431
I20260709 12:22:47.853606 32200 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:47.854447 32200 heartbeater.cc:507] Master 127.18.132.126:40431 requested a full tablet report, sending...
I20260709 12:22:47.856531 31924 ts_manager.cc:194] Registered new tserver with Master: 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:47.857573 18961 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0158922s
I20260709 12:22:47.858052 31924 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33876
I20260709 12:22:47.885244 31924 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33886:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:47.888200 31924 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:47.968050 32091 tablet_service.cc:1511] Processing CreateTablet for tablet 92812dafb1b24d5798303c69b7a9586b (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:47.970127 32091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92812dafb1b24d5798303c69b7a9586b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.977562 32090 tablet_service.cc:1511] Processing CreateTablet for tablet b61ab1d4b34a4686bbabf04d852203cf (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:47.979333 32090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61ab1d4b34a4686bbabf04d852203cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.982093 32016 tablet_service.cc:1511] Processing CreateTablet for tablet 92812dafb1b24d5798303c69b7a9586b (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:47.984309 32013 tablet_service.cc:1511] Processing CreateTablet for tablet 80f9f8dd2aa64bc0b439d82d64f0af89 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:47.984835 32015 tablet_service.cc:1511] Processing CreateTablet for tablet b61ab1d4b34a4686bbabf04d852203cf (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:47.986846 32012 tablet_service.cc:1511] Processing CreateTablet for tablet ec81d229e6e7462c848a4fb2e690da4e (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:47.987221 32014 tablet_service.cc:1511] Processing CreateTablet for tablet 1a698aab65a04e459b22902b1437a31a (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:47.988569 32016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92812dafb1b24d5798303c69b7a9586b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.990927 32013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f9f8dd2aa64bc0b439d82d64f0af89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.990808 32011 tablet_service.cc:1511] Processing CreateTablet for tablet 72f834602212496eb97901c7a81078a6 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:47.992015 32014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a698aab65a04e459b22902b1437a31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.992682 32012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec81d229e6e7462c848a4fb2e690da4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.993781 32010 tablet_service.cc:1511] Processing CreateTablet for tablet e214e1c1f48e4f7d9d44d4784c5caa01 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:47.994625 32015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61ab1d4b34a4686bbabf04d852203cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.996728 32009 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1aa3df495f44a8b6514c00a2a4e3a4 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:47.998131 32011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f834602212496eb97901c7a81078a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.998696 32008 tablet_service.cc:1511] Processing CreateTablet for tablet 8f7ecd79b39e485586e44cc4bd6572d4 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:48.000147 32008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f7ecd79b39e485586e44cc4bd6572d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.002143 32009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1aa3df495f44a8b6514c00a2a4e3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.006523 32010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214e1c1f48e4f7d9d44d4784c5caa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.020830 32089 tablet_service.cc:1511] Processing CreateTablet for tablet 1a698aab65a04e459b22902b1437a31a (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:48.022535 32089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a698aab65a04e459b22902b1437a31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.024856 32087 tablet_service.cc:1511] Processing CreateTablet for tablet ec81d229e6e7462c848a4fb2e690da4e (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:48.026351 32087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec81d229e6e7462c848a4fb2e690da4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.028332 32086 tablet_service.cc:1511] Processing CreateTablet for tablet 72f834602212496eb97901c7a81078a6 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:48.029433 32083 tablet_service.cc:1511] Processing CreateTablet for tablet 8f7ecd79b39e485586e44cc4bd6572d4 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:48.030508 32165 tablet_service.cc:1511] Processing CreateTablet for tablet 92812dafb1b24d5798303c69b7a9586b (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:48.032446 32165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92812dafb1b24d5798303c69b7a9586b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.034662 32088 tablet_service.cc:1511] Processing CreateTablet for tablet 80f9f8dd2aa64bc0b439d82d64f0af89 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:48.029881 32086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f834602212496eb97901c7a81078a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.032783 32085 tablet_service.cc:1511] Processing CreateTablet for tablet e214e1c1f48e4f7d9d44d4784c5caa01 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:48.042372 32164 tablet_service.cc:1511] Processing CreateTablet for tablet b61ab1d4b34a4686bbabf04d852203cf (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:48.031276 32084 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1aa3df495f44a8b6514c00a2a4e3a4 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:48.045043 32083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f7ecd79b39e485586e44cc4bd6572d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.046568 32162 tablet_service.cc:1511] Processing CreateTablet for tablet 80f9f8dd2aa64bc0b439d82d64f0af89 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:48.051657 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214e1c1f48e4f7d9d44d4784c5caa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.053360 32084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1aa3df495f44a8b6514c00a2a4e3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.053143 32161 tablet_service.cc:1511] Processing CreateTablet for tablet ec81d229e6e7462c848a4fb2e690da4e (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:48.056836 32159 tablet_service.cc:1511] Processing CreateTablet for tablet e214e1c1f48e4f7d9d44d4784c5caa01 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:48.044791 32163 tablet_service.cc:1511] Processing CreateTablet for tablet 1a698aab65a04e459b22902b1437a31a (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:48.061281 32157 tablet_service.cc:1511] Processing CreateTablet for tablet 8f7ecd79b39e485586e44cc4bd6572d4 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:48.064868 32088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f9f8dd2aa64bc0b439d82d64f0af89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.065907 32215 tablet_bootstrap.cc:492] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.055562 32160 tablet_service.cc:1511] Processing CreateTablet for tablet 72f834602212496eb97901c7a81078a6 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:48.059229 32158 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1aa3df495f44a8b6514c00a2a4e3a4 (DEFAULT_TABLE table=test-workload [id=cfad096c15274e2f853f5e91fb63a216]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:48.075260 32164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61ab1d4b34a4686bbabf04d852203cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.076587 32160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f834602212496eb97901c7a81078a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.077282 32161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec81d229e6e7462c848a4fb2e690da4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.079959 32162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f9f8dd2aa64bc0b439d82d64f0af89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.083977 32163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a698aab65a04e459b22902b1437a31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.088018 32158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1aa3df495f44a8b6514c00a2a4e3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.089486 32157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f7ecd79b39e485586e44cc4bd6572d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.093497 32159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e214e1c1f48e4f7d9d44d4784c5caa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.135691 32216 tablet_bootstrap.cc:492] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.201471 32216 tablet_bootstrap.cc:654] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.210796 32217 tablet_bootstrap.cc:492] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.232537 32215 tablet_bootstrap.cc:654] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.233379 32217 tablet_bootstrap.cc:654] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.238409 32216 tablet_bootstrap.cc:492] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.239903 32216 ts_tablet_manager.cc:1403] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.006s
I20260709 12:22:48.243297 32216 raft_consensus.cc:359] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.244134 32216 raft_consensus.cc:385] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.244227 32215 tablet_bootstrap.cc:492] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.244450 32216 raft_consensus.cc:740] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.245775 32215 ts_tablet_manager.cc:1403] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.005s
I20260709 12:22:48.246234 32216 consensus_queue.cc:260] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.248621 32217 tablet_bootstrap.cc:492] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.248730 32126 heartbeater.cc:499] Master 127.18.132.126:40431 was elected leader, sending a full tablet report...
I20260709 12:22:48.249219 32216 ts_tablet_manager.cc:1434] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:48.249014 32215 raft_consensus.cc:359] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.249257 32217 ts_tablet_manager.cc:1403] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.010s
I20260709 12:22:48.249930 32215 raft_consensus.cc:385] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.250378 32216 tablet_bootstrap.cc:492] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.250304 32215 raft_consensus.cc:740] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.251540 32215 consensus_queue.cc:260] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.255784 32217 raft_consensus.cc:359] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.256942 32217 raft_consensus.cc:385] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.257395 32217 raft_consensus.cc:740] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.257565 32216 tablet_bootstrap.cc:654] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.258667 32217 consensus_queue.cc:260] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.268296 32200 heartbeater.cc:499] Master 127.18.132.126:40431 was elected leader, sending a full tablet report...
I20260709 12:22:48.269232 32217 ts_tablet_manager.cc:1434] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:22:48.270936 32217 tablet_bootstrap.cc:492] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.281278 32217 tablet_bootstrap.cc:654] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.295547 32217 tablet_bootstrap.cc:492] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.296444 32217 ts_tablet_manager.cc:1403] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.006s
I20260709 12:22:48.301362 32217 raft_consensus.cc:359] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.302135 32051 heartbeater.cc:499] Master 127.18.132.126:40431 was elected leader, sending a full tablet report...
I20260709 12:22:48.302670 32216 tablet_bootstrap.cc:492] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.302986 32215 ts_tablet_manager.cc:1434] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.057s	user 0.028s	sys 0.028s
I20260709 12:22:48.303318 32216 ts_tablet_manager.cc:1403] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.030s
I20260709 12:22:48.304395 32215 tablet_bootstrap.cc:492] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.302246 32217 raft_consensus.cc:385] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.307479 32217 raft_consensus.cc:740] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.308450 32217 consensus_queue.cc:260] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.310870 32217 ts_tablet_manager.cc:1434] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:22:48.312008 32217 tablet_bootstrap.cc:492] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.312664 32215 tablet_bootstrap.cc:654] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.317337 32216 raft_consensus.cc:359] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.318348 32216 raft_consensus.cc:385] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.318656 32216 raft_consensus.cc:740] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.320291 32217 tablet_bootstrap.cc:654] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.319880 32216 consensus_queue.cc:260] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.322675 32216 ts_tablet_manager.cc:1434] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:22:48.323976 32216 tablet_bootstrap.cc:492] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.334227 32217 tablet_bootstrap.cc:492] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.334432 32215 tablet_bootstrap.cc:492] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.335038 32217 ts_tablet_manager.cc:1403] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 12:22:48.335106 32215 ts_tablet_manager.cc:1403] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.007s
I20260709 12:22:48.336314 32216 tablet_bootstrap.cc:654] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.339756 32215 raft_consensus.cc:359] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
W20260709 12:22:48.342728 32201 tablet.cc:2406] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:48.344324 32217 raft_consensus.cc:359] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.344957 32215 raft_consensus.cc:385] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.345250 32217 raft_consensus.cc:385] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.345388 32215 raft_consensus.cc:740] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.345782 32217 raft_consensus.cc:740] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.346392 32215 consensus_queue.cc:260] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.346784 32217 consensus_queue.cc:260] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.348819 32215 ts_tablet_manager.cc:1434] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:22:48.349602 32217 ts_tablet_manager.cc:1434] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:48.349850 32215 tablet_bootstrap.cc:492] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.350930 32217 tablet_bootstrap.cc:492] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.357537 32215 tablet_bootstrap.cc:654] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.357997 32216 tablet_bootstrap.cc:492] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.358597 32216 ts_tablet_manager.cc:1403] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.005s
I20260709 12:22:48.360105 32217 tablet_bootstrap.cc:654] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.362556 32216 raft_consensus.cc:359] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.363600 32216 raft_consensus.cc:385] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.363970 32216 raft_consensus.cc:740] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.365196 32216 consensus_queue.cc:260] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.372632 32217 tablet_bootstrap.cc:492] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.373317 32217 ts_tablet_manager.cc:1403] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:22:48.376469 32215 tablet_bootstrap.cc:492] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.377630 32215 ts_tablet_manager.cc:1403] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 12:22:48.377820 32216 ts_tablet_manager.cc:1434] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 12:22:48.377797 32217 raft_consensus.cc:359] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.378799 32217 raft_consensus.cc:385] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.379120 32217 raft_consensus.cc:740] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.380383 32216 tablet_bootstrap.cc:492] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.379966 32217 consensus_queue.cc:260] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.380985 32215 raft_consensus.cc:359] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.381795 32215 raft_consensus.cc:385] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.382125 32215 raft_consensus.cc:740] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.387226 32215 consensus_queue.cc:260] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.388054 32217 ts_tablet_manager.cc:1434] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:48.389235 32217 tablet_bootstrap.cc:492] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.392769 32216 tablet_bootstrap.cc:654] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.395920 32223 raft_consensus.cc:493] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.396487 32223 raft_consensus.cc:515] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.397632 32215 ts_tablet_manager.cc:1434] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:22:48.400081 32217 tablet_bootstrap.cc:654] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.405529 32215 tablet_bootstrap.cc:492] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.415753 32223 leader_election.cc:290] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:48.416285 32215 tablet_bootstrap.cc:654] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.430934 32215 tablet_bootstrap.cc:492] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.431715 32215 ts_tablet_manager.cc:1403] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.004s
W20260709 12:22:48.439486 31972 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:48.440343 32215 raft_consensus.cc:359] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.441048 32215 raft_consensus.cc:385] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.441318 32215 raft_consensus.cc:740] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.443387 32215 consensus_queue.cc:260] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.448339 32217 tablet_bootstrap.cc:492] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.453074 32217 ts_tablet_manager.cc:1403] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.064s	user 0.034s	sys 0.021s
I20260709 12:22:48.453948 32215 ts_tablet_manager.cc:1434] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 12:22:48.455241 32215 tablet_bootstrap.cc:492] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.455789 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:48.456532 32217 raft_consensus.cc:359] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.457348 32217 raft_consensus.cc:385] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.457630 32217 raft_consensus.cc:740] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
W20260709 12:22:48.457849 32141 leader_election.cc:343] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.458506 32217 consensus_queue.cc:260] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.462625 32216 tablet_bootstrap.cc:492] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.463340 32216 ts_tablet_manager.cc:1403] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.083s	user 0.029s	sys 0.029s
I20260709 12:22:48.463967 32217 ts_tablet_manager.cc:1434] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 12:22:48.465193 32217 tablet_bootstrap.cc:492] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.466830 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:48.467206 32216 raft_consensus.cc:359] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.468011 32215 tablet_bootstrap.cc:654] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.468279 32216 raft_consensus.cc:385] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.468917 32216 raft_consensus.cc:740] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
W20260709 12:22:48.469662 32138 leader_election.cc:343] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.468273 32223 raft_consensus.cc:493] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.470161 32216 consensus_queue.cc:260] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.470197 32138 leader_election.cc:304] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30db6569e3354597b9c74a961b09980f; no voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:48.470461 32223 raft_consensus.cc:515] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.474131 32216 ts_tablet_manager.cc:1434] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:22:48.475351 32216 tablet_bootstrap.cc:492] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.475289 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
W20260709 12:22:48.476953 32141 leader_election.cc:343] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.477599 32223 leader_election.cc:290] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:48.478194 32223 raft_consensus.cc:2749] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:48.485787 32216 tablet_bootstrap.cc:654] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.487669 32217 tablet_bootstrap.cc:654] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.488948 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
W20260709 12:22:48.491310 32138 leader_election.cc:343] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.491976 32138 leader_election.cc:304] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30db6569e3354597b9c74a961b09980f; no voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:48.493799 32237 raft_consensus.cc:2749] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:48.497886 32237 raft_consensus.cc:493] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.498412 32215 tablet_bootstrap.cc:492] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.498299 32237 raft_consensus.cc:515] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.499195 32215 ts_tablet_manager.cc:1403] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.010s
I20260709 12:22:48.501711 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f834602212496eb97901c7a81078a6" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:48.501709 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f834602212496eb97901c7a81078a6" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:48.503188 32101 raft_consensus.cc:2468] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
W20260709 12:22:48.503471 32138 leader_election.cc:343] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.503741 32215 raft_consensus.cc:359] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.504587 32141 leader_election.cc:304] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:48.504806 32215 raft_consensus.cc:385] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.505246 32215 raft_consensus.cc:740] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.505496 32223 raft_consensus.cc:2804] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.505455 32237 leader_election.cc:290] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:48.506173 32223 raft_consensus.cc:493] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.506572 32223 raft_consensus.cc:3060] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.507133 32215 consensus_queue.cc:260] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.508474 32217 tablet_bootstrap.cc:492] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.509056 32217 ts_tablet_manager.cc:1403] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.014s
I20260709 12:22:48.510422 32216 tablet_bootstrap.cc:492] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.510993 32216 ts_tablet_manager.cc:1403] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.000s
I20260709 12:22:48.512483 32217 raft_consensus.cc:359] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.513238 32217 raft_consensus.cc:385] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.513219 32223 raft_consensus.cc:515] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.513749 32217 raft_consensus.cc:740] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.514079 32216 raft_consensus.cc:359] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.514819 32216 raft_consensus.cc:385] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.515210 32216 raft_consensus.cc:740] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.514693 32217 consensus_queue.cc:260] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.516013 32216 consensus_queue.cc:260] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.517293 32217 ts_tablet_manager.cc:1434] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:22:48.517524 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f834602212496eb97901c7a81078a6" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:48.518577 32216 ts_tablet_manager.cc:1434] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:22:48.519261 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f834602212496eb97901c7a81078a6" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:48.519696 32216 tablet_bootstrap.cc:492] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.519902 32101 raft_consensus.cc:3060] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.526868 32216 tablet_bootstrap.cc:654] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.527843 32221 raft_consensus.cc:493] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.528445 32221 raft_consensus.cc:515] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.530144 32101 raft_consensus.cc:2468] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:48.530645 32217 tablet_bootstrap.cc:492] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.534065 32216 tablet_bootstrap.cc:492] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.534847 32216 ts_tablet_manager.cc:1403] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:22:48.539601 32216 raft_consensus.cc:359] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.531265 32215 ts_tablet_manager.cc:1434] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:22:48.540340 32216 raft_consensus.cc:385] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.540716 32216 raft_consensus.cc:740] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.541635 32216 consensus_queue.cc:260] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.542734 32221 leader_election.cc:290] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.542883 32217 tablet_bootstrap.cc:654] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:48.545800 32138 leader_election.cc:343] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.547317 32215 tablet_bootstrap.cc:492] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.551420 32216 ts_tablet_manager.cc:1434] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:22:48.554926 32216 tablet_bootstrap.cc:492] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.555943 32215 tablet_bootstrap.cc:654] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.516476 32223 leader_election.cc:290] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:48.555998 32222 raft_consensus.cc:493] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.559427 32222 raft_consensus.cc:515] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.568162 32222 leader_election.cc:290] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.568248 32217 tablet_bootstrap.cc:492] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.574466 32217 ts_tablet_manager.cc:1403] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.005s
I20260709 12:22:48.580358 32141 leader_election.cc:304] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:48.581745 32223 raft_consensus.cc:2804] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.582468 32223 raft_consensus.cc:697] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:48.588045 32244 raft_consensus.cc:493] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.588816 32244 raft_consensus.cc:515] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.587067 32223 consensus_queue.cc:237] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.589658 32216 tablet_bootstrap.cc:654] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.594780 32217 raft_consensus.cc:359] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.596517 32244 leader_election.cc:290] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.600855 32217 raft_consensus.cc:385] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.602548 32217 raft_consensus.cc:740] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.603621 32217 consensus_queue.cc:260] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.606386 32217 ts_tablet_manager.cc:1434] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:22:48.607625 32217 tablet_bootstrap.cc:492] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.612895 32222 raft_consensus.cc:493] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.613595 32222 raft_consensus.cc:515] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.615767 32222 leader_election.cc:290] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.620455 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:48.620085 31922 catalog_manager.cc:5697] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 1 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.621948 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:48.622745 32026 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
W20260709 12:22:48.624033 32064 leader_election.cc:343] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.627015 32217 tablet_bootstrap.cc:654] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.628327 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.631004 32175 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:48.629431 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.626034 32064 leader_election.cc:304] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.631953 32174 raft_consensus.cc:2468] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:48.632958 32244 raft_consensus.cc:2804] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.633826 32244 raft_consensus.cc:493] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.635139 32244 raft_consensus.cc:3060] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.636418 32215 tablet_bootstrap.cc:492] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.637109 32215 ts_tablet_manager.cc:1403] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.010s
I20260709 12:22:48.643237 32067 leader_election.cc:304] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:48.644305 32221 raft_consensus.cc:2804] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.644912 32221 raft_consensus.cc:493] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.645344 32221 raft_consensus.cc:3060] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.647921 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.648355 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:48.648689 32175 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:48.650077 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a698aab65a04e459b22902b1437a31a" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:48.652149 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a698aab65a04e459b22902b1437a31a" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.652312 32244 raft_consensus.cc:515] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.652827 32175 raft_consensus.cc:2468] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:48.653692 32101 raft_consensus.cc:2393] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c53af950ae844c8a8536d8181a55c7f in current term 1: Already voted for candidate 483ed0fc9c0643bcbd0b017459719bb5 in this term.
I20260709 12:22:48.655979 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.656608 32175 raft_consensus.cc:3060] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.657136 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:48.657800 32026 raft_consensus.cc:3060] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:48.663990 31992 leader_election.cc:343] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.664883 31992 leader_election.cc:304] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:48.665510 32175 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:48.666098 31992 leader_election.cc:304] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:48.666918 32067 leader_election.cc:304] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.671605 32216 tablet_bootstrap.cc:492] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.674700 32216 ts_tablet_manager.cc:1403] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.007s
I20260709 12:22:48.677472 32026 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:48.678272 32222 raft_consensus.cc:2764] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:48.673668 32221 raft_consensus.cc:515] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.679656 32244 leader_election.cc:290] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.680362 32244 raft_consensus.cc:2804] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.680564 32221 leader_election.cc:290] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.681031 32222 raft_consensus.cc:2804] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.681437 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:48.677909 32216 raft_consensus.cc:359] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.682179 32216 raft_consensus.cc:385] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.682476 32216 raft_consensus.cc:740] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.683672 32217 tablet_bootstrap.cc:492] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.683271 32216 consensus_queue.cc:260] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.681453 32222 raft_consensus.cc:493] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.684253 32217 ts_tablet_manager.cc:1403] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.001s
I20260709 12:22:48.684579 32222 raft_consensus.cc:3060] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.680910 32244 raft_consensus.cc:697] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:48.685858 32216 ts_tablet_manager.cc:1434] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:48.686924 32216 tablet_bootstrap.cc:492] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
W20260709 12:22:48.683475 32064 leader_election.cc:343] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.687362 32217 raft_consensus.cc:359] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:48.688303 32217 raft_consensus.cc:385] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.686137 32244 consensus_queue.cc:237] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.688982 32217 raft_consensus.cc:740] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.690068 32217 consensus_queue.cc:260] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:48.692754 32217 ts_tablet_manager.cc:1434] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:48.693859 32217 tablet_bootstrap.cc:492] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:48.694708 32216 tablet_bootstrap.cc:654] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.679980 32215 raft_consensus.cc:359] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.695458 32215 raft_consensus.cc:385] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.696044 32215 raft_consensus.cc:740] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.697902 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.698541 32174 raft_consensus.cc:3060] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.699458 32215 consensus_queue.cc:260] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.701414 32217 tablet_bootstrap.cc:654] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.702181 32215 ts_tablet_manager.cc:1434] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:22:48.703177 32222 raft_consensus.cc:515] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.706214 32255 raft_consensus.cc:493] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.706791 32255 raft_consensus.cc:515] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.706933 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a698aab65a04e459b22902b1437a31a" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:48.707861 32101 raft_consensus.cc:3060] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.711114 32174 raft_consensus.cc:2468] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:48.711957 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:48.712384 32173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a698aab65a04e459b22902b1437a31a" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.712597 32067 leader_election.cc:304] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:48.713335 32173 raft_consensus.cc:3060] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.712750 32026 raft_consensus.cc:2468] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:48.715857 32221 raft_consensus.cc:2804] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.719465 32064 leader_election.cc:304] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.722771 32244 raft_consensus.cc:2804] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.723160 32244 raft_consensus.cc:493] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.723486 32244 raft_consensus.cc:3060] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.725224 31922 catalog_manager.cc:5697] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.738901 32244 raft_consensus.cc:515] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.743434 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.744791 32254 raft_consensus.cc:493] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.745622 32067 leader_election.cc:343] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.745393 32254 raft_consensus.cc:515] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.748834 32244 leader_election.cc:290] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.748936 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:48.749619 32100 raft_consensus.cc:2468] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:48.750214 32254 leader_election.cc:290] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.751070 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.751412 31992 leader_election.cc:304] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.753749 32174 raft_consensus.cc:2468] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:48.757889 32254 raft_consensus.cc:2804] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.758342 32254 raft_consensus.cc:493] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.758684 32254 raft_consensus.cc:3060] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.759696 32222 leader_election.cc:290] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.760363 32222 raft_consensus.cc:493] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.760902 32222 raft_consensus.cc:515] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.763926 32215 tablet_bootstrap.cc:492] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.763873 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
W20260709 12:22:48.765785 31992 leader_election.cc:343] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.772928 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.773550 32221 raft_consensus.cc:697] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
W20260709 12:22:48.774533 32067 leader_election.cc:343] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.775259 32255 leader_election.cc:290] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.775115 32221 consensus_queue.cc:237] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.777181 32222 leader_election.cc:290] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.778439 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.779196 32174 raft_consensus.cc:2468] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:48.779521 32216 tablet_bootstrap.cc:492] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.780561 32216 ts_tablet_manager.cc:1403] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.058s
I20260709 12:22:48.780407 31992 leader_election.cc:304] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:48.782557 32101 raft_consensus.cc:2468] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:48.784349 31992 leader_election.cc:304] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
W20260709 12:22:48.782302 32064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.18.132.65:46409, user_credentials={real_user=slave}} blocked reactor thread for 62934.7us
I20260709 12:22:48.786024 32216 raft_consensus.cc:359] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:48.786779 32216 raft_consensus.cc:385] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.787292 32216 raft_consensus.cc:740] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.788403 32222 raft_consensus.cc:2804] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.786758 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:48.789526 32026 raft_consensus.cc:3060] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.789211 32216 consensus_queue.cc:260] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:48.791517 32216 ts_tablet_manager.cc:1434] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:22:48.792584 32216 tablet_bootstrap.cc:492] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:48.793531 32222 raft_consensus.cc:493] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.794052 32222 raft_consensus.cc:3060] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.799459 32254 raft_consensus.cc:515] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.801496 32173 raft_consensus.cc:2468] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:48.800485 32263 raft_consensus.cc:2804] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.806939 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:48.807777 32101 raft_consensus.cc:3060] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.803983 32221 raft_consensus.cc:493] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.809759 32221 raft_consensus.cc:515] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.810549 32216 tablet_bootstrap.cc:654] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.814285 32215 tablet_bootstrap.cc:654] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.814466 32026 raft_consensus.cc:2468] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:48.818293 32173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.819043 32173 raft_consensus.cc:3060] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.818234 31921 catalog_manager.cc:5697] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.820300 32064 leader_election.cc:304] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 30db6569e3354597b9c74a961b09980f
I20260709 12:22:48.820616 32254 leader_election.cc:290] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.821831 32262 raft_consensus.cc:2804] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.822367 32262 raft_consensus.cc:697] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:48.823261 32262 consensus_queue.cc:237] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.830212 32101 raft_consensus.cc:2468] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:48.832166 31992 leader_election.cc:304] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.835661 32263 raft_consensus.cc:697] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:48.835146 32254 raft_consensus.cc:493] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.837210 32254 raft_consensus.cc:515] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.838718 32221 leader_election.cc:290] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.840067 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.841018 32174 raft_consensus.cc:2468] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:48.837321 32263 consensus_queue.cc:237] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.841642 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:48.843829 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:48.843947 32026 raft_consensus.cc:2468] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:48.844591 32067 leader_election.cc:304] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.844640 32100 raft_consensus.cc:2468] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:48.846514 32221 raft_consensus.cc:2804] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.850721 32216 tablet_bootstrap.cc:492] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:48.851311 32216 ts_tablet_manager.cc:1403] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.020s
I20260709 12:22:48.852288 32221 raft_consensus.cc:493] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.852886 31992 leader_election.cc:304] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:48.853353 31921 catalog_manager.cc:5697] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.854435 32216 raft_consensus.cc:359] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.855297 32216 raft_consensus.cc:385] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.855742 32216 raft_consensus.cc:740] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.841674 32173 raft_consensus.cc:2468] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:48.856789 32216 consensus_queue.cc:260] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.852874 32221 raft_consensus.cc:3060] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.859444 32217 tablet_bootstrap.cc:492] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:48.859650 32216 ts_tablet_manager.cc:1434] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:48.860002 32215 tablet_bootstrap.cc:492] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.860073 32217 ts_tablet_manager.cc:1403] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.008s
I20260709 12:22:48.860590 32215 ts_tablet_manager.cc:1403] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.002s
I20260709 12:22:48.863545 32215 raft_consensus.cc:359] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.863765 32217 raft_consensus.cc:359] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.864355 32215 raft_consensus.cc:385] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.864573 32217 raft_consensus.cc:385] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.865175 32217 raft_consensus.cc:740] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.864732 32215 raft_consensus.cc:740] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.865428 32265 raft_consensus.cc:2804] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.864434 32254 leader_election.cc:290] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.866245 32215 consensus_queue.cc:260] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.866245 32217 consensus_queue.cc:260] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.868788 32217 ts_tablet_manager.cc:1434] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:48.868863 32215 ts_tablet_manager.cc:1434] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:22:48.869995 32215 tablet_bootstrap.cc:492] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.867067 32254 raft_consensus.cc:2804] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.870955 32254 raft_consensus.cc:493] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.871290 32254 raft_consensus.cc:3060] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.872202 32222 raft_consensus.cc:515] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.874507 32222 leader_election.cc:290] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.878656 32215 tablet_bootstrap.cc:654] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.879083 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.883876 32174 raft_consensus.cc:3060] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.884236 32221 raft_consensus.cc:515] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.886615 32221 leader_election.cc:290] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.887441 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:48.888530 32265 raft_consensus.cc:697] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:48.889258 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.889489 32265 consensus_queue.cc:237] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.890166 32175 raft_consensus.cc:3060] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.879993 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:48.895988 32100 raft_consensus.cc:3060] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.895740 32254 raft_consensus.cc:515] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.897742 32026 raft_consensus.cc:2393] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 483ed0fc9c0643bcbd0b017459719bb5 in current term 1: Already voted for candidate 1c53af950ae844c8a8536d8181a55c7f in this term.
I20260709 12:22:48.880816 32173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:48.901265 32254 leader_election.cc:290] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:48.903296 32175 raft_consensus.cc:2468] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:48.903852 32174 raft_consensus.cc:2468] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:48.904899 32067 leader_election.cc:304] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:48.905179 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:48.906054 32101 raft_consensus.cc:2393] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c53af950ae844c8a8536d8181a55c7f in current term 1: Already voted for candidate 483ed0fc9c0643bcbd0b017459719bb5 in this term.
I20260709 12:22:48.907109 32215 tablet_bootstrap.cc:492] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.907680 32215 ts_tablet_manager.cc:1403] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.005s
I20260709 12:22:48.906956 31920 catalog_manager.cc:5697] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.908057 32221 raft_consensus.cc:2804] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.908669 32221 raft_consensus.cc:697] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:48.909483 32221 consensus_queue.cc:237] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.910630 32215 raft_consensus.cc:359] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.911298 32215 raft_consensus.cc:385] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.911557 32215 raft_consensus.cc:740] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.912295 31992 leader_election.cc:304] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:48.916666 32100 raft_consensus.cc:2468] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:48.917659 32265 raft_consensus.cc:2804] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.918401 32265 raft_consensus.cc:697] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:48.912333 32215 consensus_queue.cc:260] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.919507 32265 consensus_queue.cc:237] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:48.926445 32215 ts_tablet_manager.cc:1434] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:48.927639 32215 tablet_bootstrap.cc:492] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:48.926469 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:48.930053 32175 raft_consensus.cc:2393] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c53af950ae844c8a8536d8181a55c7f in current term 1: Already voted for candidate 483ed0fc9c0643bcbd0b017459719bb5 in this term.
I20260709 12:22:48.931430 31992 leader_election.cc:304] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f; no voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:48.932458 32265 raft_consensus.cc:2749] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:48.935380 32215 tablet_bootstrap.cc:654] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.938143 31920 catalog_manager.cc:5697] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.941412 32215 tablet_bootstrap.cc:492] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:48.941936 32215 ts_tablet_manager.cc:1403] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:22:48.942022 31922 catalog_manager.cc:5697] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.944073 31922 catalog_manager.cc:5697] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.945606 32215 raft_consensus.cc:359] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:48.946302 32215 raft_consensus.cc:385] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.946558 32215 raft_consensus.cc:740] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.947305 32215 consensus_queue.cc:260] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:48.949249 32215 ts_tablet_manager.cc:1434] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:48.980756 32223 consensus_queue.cc:1048] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.992085 32026 raft_consensus.cc:3060] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.003155 32223 consensus_queue.cc:1048] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.075513 32223 raft_consensus.cc:493] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.076114 32223 raft_consensus.cc:515] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:49.078238 32223 leader_election.cc:290] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409)
I20260709 12:22:49.079013 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:49.079430 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:49.079950 32100 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:49.080242 32026 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:49.081241 32141 leader_election.cc:304] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:49.082034 32223 raft_consensus.cc:2804] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.082369 32223 raft_consensus.cc:493] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.082653 32223 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.088294 32223 raft_consensus.cc:515] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:49.089859 32223 leader_election.cc:290] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409)
I20260709 12:22:49.090637 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:49.090883 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:49.091217 32100 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.091480 32026 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.096532 32100 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:49.096870 32026 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:49.097568 32141 leader_election.cc:304] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:49.098310 32223 raft_consensus.cc:2804] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.098744 32223 raft_consensus.cc:697] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:49.099620 32223 consensus_queue.cc:237] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:49.107043 31920 catalog_manager.cc:5697] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 1 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.118970 32263 raft_consensus.cc:493] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.119549 32263 raft_consensus.cc:515] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.121503 32263 leader_election.cc:290] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.122251 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:49.122542 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:49.123353 32175 raft_consensus.cc:2393] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c53af950ae844c8a8536d8181a55c7f in current term 1: Already voted for candidate 483ed0fc9c0643bcbd0b017459719bb5 in this term.
I20260709 12:22:49.124497 31992 leader_election.cc:304] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f; no voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:49.125196 32263 raft_consensus.cc:3060] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.131332 32263 raft_consensus.cc:2749] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.168509 32221 consensus_queue.cc:1048] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.171684 32221 consensus_queue.cc:1048] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.181329 32255 consensus_queue.cc:1048] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.186556 32221 consensus_queue.cc:1048] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.252879 32223 raft_consensus.cc:493] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.253544 32223 raft_consensus.cc:515] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.256021 32223 leader_election.cc:290] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:49.256448 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:49.256784 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:49.257326 32026 raft_consensus.cc:2393] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30db6569e3354597b9c74a961b09980f in current term 1: Already voted for candidate 483ed0fc9c0643bcbd0b017459719bb5 in this term.
I20260709 12:22:49.256826 32263 consensus_queue.cc:1048] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.258631 32141 leader_election.cc:304] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30db6569e3354597b9c74a961b09980f; no voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:49.259477 32223 raft_consensus.cc:3060] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.269126 32223 raft_consensus.cc:2749] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.269594 32263 consensus_queue.cc:1048] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.302002 32263 consensus_queue.cc:1048] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.313124 32265 consensus_queue.cc:1048] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.353262 32175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:43278
I20260709 12:22:49.353960 32175 raft_consensus.cc:606] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:49.364888 32265 consensus_queue.cc:1048] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.370311 32101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:48152
I20260709 12:22:49.371024 32101 raft_consensus.cc:606] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:49.378335 32254 consensus_queue.cc:1048] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.387377 32221 consensus_queue.cc:1048] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.387710 32100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:48152
I20260709 12:22:49.388402 32100 raft_consensus.cc:606] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:49.410938 32255 consensus_queue.cc:1048] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.414719 32255 consensus_queue.cc:1048] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.428386 32025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
mode: GRACEFUL
new_leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:42752
I20260709 12:22:49.429657 32025 raft_consensus.cc:606] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Received request to transfer leadership to TS 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:49.446038 32255 consensus_queue.cc:1048] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.452721 32174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72f834602212496eb97901c7a81078a6"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
mode: GRACEFUL
new_leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:43278
I20260709 12:22:49.453576 32174 raft_consensus.cc:606] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Received request to transfer leadership to TS 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:49.464607 32025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
mode: GRACEFUL
new_leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:42752
I20260709 12:22:49.464838 32262 raft_consensus.cc:993] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:49.465308 32025 raft_consensus.cc:606] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Received request to transfer leadership to TS 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:49.465471 32255 raft_consensus.cc:1081] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:49.467865 32025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42736
I20260709 12:22:49.468468 32025 raft_consensus.cc:493] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.468847 32025 raft_consensus.cc:3060] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.471074 32100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "30db6569e3354597b9c74a961b09980f"
 from {username='slave'} at 127.0.0.1:48152
I20260709 12:22:49.471716 32100 raft_consensus.cc:606] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 30db6569e3354597b9c74a961b09980f
I20260709 12:22:49.475472 32025 raft_consensus.cc:515] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.477793 32025 leader_election.cc:290] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.478488 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:49.478979 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f9f8dd2aa64bc0b439d82d64f0af89" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:49.479209 32100 raft_consensus.cc:3055] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.479599 32100 raft_consensus.cc:740] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:49.479672 32174 raft_consensus.cc:3060] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.480619 32100 consensus_queue.cc:260] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.482026 32100 raft_consensus.cc:3060] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.487895 32174 raft_consensus.cc:2468] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:49.489192 31992 leader_election.cc:304] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:49.489683 32223 consensus_queue.cc:1048] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.490056 32254 raft_consensus.cc:2804] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.490495 32100 raft_consensus.cc:2468] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:49.490624 32254 raft_consensus.cc:697] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:49.491798 32254 consensus_queue.cc:237] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.497416 32237 raft_consensus.cc:993] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:49.498271 32223 raft_consensus.cc:1081] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:49.500576 32026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42724
I20260709 12:22:49.502156 32026 raft_consensus.cc:493] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.502496 32026 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.503000 31922 catalog_manager.cc:5697] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.510202 32303 consensus_queue.cc:1048] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.510281 32026 raft_consensus.cc:515] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:49.514859 32026 leader_election.cc:290] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.516582 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:49.516702 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:49.517119 32174 raft_consensus.cc:3055] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.517529 32174 raft_consensus.cc:740] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:49.519125 32174 consensus_queue.cc:260] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:49.520251 32174 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.527660 32174 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:49.528813 31992 leader_election.cc:304] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:49.529596 32254 raft_consensus.cc:2804] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.530141 32254 raft_consensus.cc:697] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:49.531118 32254 consensus_queue.cc:237] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:49.538599 31924 catalog_manager.cc:5697] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 30db6569e3354597b9c74a961b09980f (127.18.132.67) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.589838 32262 raft_consensus.cc:993] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 30db6569e3354597b9c74a961b09980f to start an election
I20260709 12:22:49.590489 32255 raft_consensus.cc:1081] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 30db6569e3354597b9c74a961b09980f to start an election
I20260709 12:22:49.592204 32174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
 from {username='slave'} at 127.0.0.1:43264
I20260709 12:22:49.592895 32174 raft_consensus.cc:493] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.593305 32174 raft_consensus.cc:3060] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.599933 32174 raft_consensus.cc:515] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.603279 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:49.603404 32174 leader_election.cc:290] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:49.604029 32026 raft_consensus.cc:3060] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.608165 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f7ecd79b39e485586e44cc4bd6572d4" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:49.609051 32100 raft_consensus.cc:3055] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.609349 32100 raft_consensus.cc:740] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:49.610237 32100 consensus_queue.cc:260] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.611460 32100 raft_consensus.cc:3060] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.611804 32026 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 2.
I20260709 12:22:49.612617 32025 raft_consensus.cc:1240] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Rejecting Update request from peer 483ed0fc9c0643bcbd0b017459719bb5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:49.613258 32138 leader_election.cc:304] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:49.614303 32303 raft_consensus.cc:2804] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.615082 32303 raft_consensus.cc:697] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 2 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:49.615919 32303 consensus_queue.cc:237] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.618844 32100 raft_consensus.cc:2468] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 2.
I20260709 12:22:49.623876 31922 catalog_manager.cc:5697] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 2 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.648126 32262 raft_consensus.cc:993] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:49.648604 32255 raft_consensus.cc:1081] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:49.650122 32025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42736
I20260709 12:22:49.650669 32025 raft_consensus.cc:493] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.650983 32025 raft_consensus.cc:3060] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.657038 32025 raft_consensus.cc:515] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.658740 32025 leader_election.cc:290] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.659677 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:49.660053 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61ab1d4b34a4686bbabf04d852203cf" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:49.660476 32100 raft_consensus.cc:3055] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.660706 32174 raft_consensus.cc:3060] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.660845 32100 raft_consensus.cc:740] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:49.661800 32100 consensus_queue.cc:260] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.663244 32100 raft_consensus.cc:3060] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.668859 32174 raft_consensus.cc:2468] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:49.670704 31992 leader_election.cc:304] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:49.671972 32254 raft_consensus.cc:2804] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.672390 32100 raft_consensus.cc:2468] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:49.672803 32254 raft_consensus.cc:697] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:49.674010 32254 consensus_queue.cc:237] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.681577 31922 catalog_manager.cc:5697] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.710762 32263 raft_consensus.cc:993] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: : Instructing follower 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:49.711388 32254 raft_consensus.cc:1081] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Signalling peer 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:49.713037 32100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:48148
I20260709 12:22:49.713610 32100 raft_consensus.cc:493] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.713932 32100 raft_consensus.cc:3060] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.720185 32100 raft_consensus.cc:515] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.722146 32100 leader_election.cc:290] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.722975 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:49.723341 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1aa3df495f44a8b6514c00a2a4e3a4" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:49.723742 32025 raft_consensus.cc:3055] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.724051 32174 raft_consensus.cc:3060] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.724097 32025 raft_consensus.cc:740] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:49.725050 32025 consensus_queue.cc:260] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.726163 32025 raft_consensus.cc:3060] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.730315 32174 raft_consensus.cc:2468] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:49.731796 32067 leader_election.cc:304] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:49.731948 32025 raft_consensus.cc:2468] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:49.732740 32255 raft_consensus.cc:2804] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.733204 32255 raft_consensus.cc:697] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:49.734016 32255 consensus_queue.cc:237] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.741693 31922 catalog_manager.cc:5697] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 1 to 2, leader changed from 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65) to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.775767 32263 raft_consensus.cc:993] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: : Instructing follower 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:49.776274 32254 raft_consensus.cc:1081] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Signalling peer 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:49.777863 32100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:48148
I20260709 12:22:49.778347 32100 raft_consensus.cc:493] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.778614 32100 raft_consensus.cc:3060] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.784458 32100 raft_consensus.cc:515] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.786384 32100 leader_election.cc:290] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.787284 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:49.787642 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec81d229e6e7462c848a4fb2e690da4e" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:49.788012 32025 raft_consensus.cc:3055] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.788306 32174 raft_consensus.cc:3060] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.788362 32025 raft_consensus.cc:740] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:49.789254 32025 consensus_queue.cc:260] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.790308 32025 raft_consensus.cc:3060] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.794386 32174 raft_consensus.cc:2468] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:49.795601 32067 leader_election.cc:304] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:49.796301 32025 raft_consensus.cc:2468] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:49.796487 32255 raft_consensus.cc:2804] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.797125 32255 raft_consensus.cc:697] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:49.798044 32255 consensus_queue.cc:237] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.804965 31922 catalog_manager.cc:5697] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 1 to 2, leader changed from 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65) to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.880947 32223 raft_consensus.cc:993] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: : Instructing follower 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:49.881424 32303 raft_consensus.cc:1081] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Signalling peer 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:49.882975 32100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72f834602212496eb97901c7a81078a6"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:48142
I20260709 12:22:49.883632 32100 raft_consensus.cc:493] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:49.883970 32100 raft_consensus.cc:3060] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.890517 32100 raft_consensus.cc:515] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.892665 32100 leader_election.cc:290] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:49.893728 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f834602212496eb97901c7a81078a6" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:49.893767 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f834602212496eb97901c7a81078a6" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:49.894548 32025 raft_consensus.cc:3060] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.894636 32174 raft_consensus.cc:3055] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:49.895097 32174 raft_consensus.cc:740] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:49.895967 32174 consensus_queue.cc:260] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.897334 32174 raft_consensus.cc:3060] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.900724 32025 raft_consensus.cc:2468] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:49.901758 32064 leader_election.cc:304] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:49.902544 32255 raft_consensus.cc:2804] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:49.903087 32255 raft_consensus.cc:697] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:49.903406 32174 raft_consensus.cc:2468] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:49.904033 32255 consensus_queue.cc:237] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:49.911331 31922 catalog_manager.cc:5697] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 1 to 2, leader changed from 30db6569e3354597b9c74a961b09980f (127.18.132.67) to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.951321 32174 raft_consensus.cc:1275] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:49.952821 32305 consensus_queue.cc:1048] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:49.955029 32174 raft_consensus.cc:1275] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:49.956580 32305 consensus_queue.cc:1048] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:49.963699 32100 raft_consensus.cc:1275] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:49.965898 32305 consensus_queue.cc:1048] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:49.967329 32100 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:49.981662 32100 raft_consensus.cc:1275] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:49.983072 32254 consensus_queue.cc:1048] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.142804 32025 raft_consensus.cc:1275] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 30db6569e3354597b9c74a961b09980f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.144246 32303 consensus_queue.cc:1048] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.148195 32175 raft_consensus.cc:1275] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.149695 32305 consensus_queue.cc:1048] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.152734 32100 raft_consensus.cc:1275] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 30db6569e3354597b9c74a961b09980f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.155539 32303 consensus_queue.cc:1048] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.167649 32101 raft_consensus.cc:1275] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.168334 32025 raft_consensus.cc:1275] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.170409 32305 consensus_queue.cc:1048] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.172384 32255 consensus_queue.cc:1048] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.176162 32175 raft_consensus.cc:1275] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.177842 32255 consensus_queue.cc:1048] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.241916 32175 raft_consensus.cc:1275] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.243256 32255 consensus_queue.cc:1048] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.251524 32025 raft_consensus.cc:1275] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.253651 32255 consensus_queue.cc:1048] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:50.289872 32175 raft_consensus.cc:1275] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.291343 32255 consensus_queue.cc:1048] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.300947 32025 raft_consensus.cc:1275] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.303247 32262 consensus_queue.cc:1048] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:52.511335 31924 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33894:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:52.514742 31924 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:52.580904 32011 tablet_service.cc:1511] Processing CreateTablet for tablet 08a9d0465bc54e24a3a31233cb6cca99 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:52.582103 32091 tablet_service.cc:1511] Processing CreateTablet for tablet 08a9d0465bc54e24a3a31233cb6cca99 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:52.583997 32091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a9d0465bc54e24a3a31233cb6cca99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.583832 32011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a9d0465bc54e24a3a31233cb6cca99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.591188 32162 tablet_service.cc:1511] Processing CreateTablet for tablet 08a9d0465bc54e24a3a31233cb6cca99 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:52.593269 32162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08a9d0465bc54e24a3a31233cb6cca99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.597640 32089 tablet_service.cc:1511] Processing CreateTablet for tablet b4ec95e9cdd84bab9d7924426679778b (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:52.599372 32089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec95e9cdd84bab9d7924426679778b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.601528 32165 tablet_service.cc:1511] Processing CreateTablet for tablet b4ec95e9cdd84bab9d7924426679778b (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:52.603205 32165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec95e9cdd84bab9d7924426679778b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.607690 32016 tablet_service.cc:1511] Processing CreateTablet for tablet b4ec95e9cdd84bab9d7924426679778b (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:52.607736 32087 tablet_service.cc:1511] Processing CreateTablet for tablet 779a4a7d9cc547e6adaac0833137b496 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:52.609449 32087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779a4a7d9cc547e6adaac0833137b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.611325 32157 tablet_service.cc:1511] Processing CreateTablet for tablet 779a4a7d9cc547e6adaac0833137b496 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:52.612915 32015 tablet_service.cc:1511] Processing CreateTablet for tablet 779a4a7d9cc547e6adaac0833137b496 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:52.612959 32157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779a4a7d9cc547e6adaac0833137b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.609439 32016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ec95e9cdd84bab9d7924426679778b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.614349 32090 tablet_service.cc:1511] Processing CreateTablet for tablet 873b343e8765411da643bcad1ea4ac33 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:52.616505 32015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779a4a7d9cc547e6adaac0833137b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.617182 32090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873b343e8765411da643bcad1ea4ac33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.624927 32009 tablet_service.cc:1511] Processing CreateTablet for tablet 873b343e8765411da643bcad1ea4ac33 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:52.627117 32009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873b343e8765411da643bcad1ea4ac33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.644650 32163 tablet_service.cc:1511] Processing CreateTablet for tablet 873b343e8765411da643bcad1ea4ac33 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:52.646494 32163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873b343e8765411da643bcad1ea4ac33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.655751 32010 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9646e666d6415089e3c5df86603bb7 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:52.657310 32010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9646e666d6415089e3c5df86603bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.661298 32013 tablet_service.cc:1511] Processing CreateTablet for tablet 8b64ec2875aa400ea661f8a0253450eb (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:52.662926 32013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b64ec2875aa400ea661f8a0253450eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.665649 32159 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9646e666d6415089e3c5df86603bb7 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:52.667356 32014 tablet_service.cc:1511] Processing CreateTablet for tablet e7a6fb36d99b45b2890a68ee0f51f655 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:52.668875 32014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a6fb36d99b45b2890a68ee0f51f655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.668792 32161 tablet_service.cc:1511] Processing CreateTablet for tablet 8b64ec2875aa400ea661f8a0253450eb (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:52.669139 32164 tablet_service.cc:1511] Processing CreateTablet for tablet e7a6fb36d99b45b2890a68ee0f51f655 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:52.671801 32088 tablet_service.cc:1511] Processing CreateTablet for tablet e7a6fb36d99b45b2890a68ee0f51f655 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:52.673331 32088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a6fb36d99b45b2890a68ee0f51f655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.663331 32085 tablet_service.cc:1511] Processing CreateTablet for tablet 8b64ec2875aa400ea661f8a0253450eb (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:52.675769 32012 tablet_service.cc:1511] Processing CreateTablet for tablet 5001e9ef2e284085b80ef24e8216df00 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:52.676793 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b64ec2875aa400ea661f8a0253450eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.677572 32012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5001e9ef2e284085b80ef24e8216df00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.682927 32091 tablet_service.cc:1511] Processing CreateTablet for tablet 4a9646e666d6415089e3c5df86603bb7 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:52.684374 32091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9646e666d6415089e3c5df86603bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.667351 32159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a9646e666d6415089e3c5df86603bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.688273 32161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b64ec2875aa400ea661f8a0253450eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.695921 32164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a6fb36d99b45b2890a68ee0f51f655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.731079 32158 tablet_service.cc:1511] Processing CreateTablet for tablet 5001e9ef2e284085b80ef24e8216df00 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:52.732748 32158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5001e9ef2e284085b80ef24e8216df00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.735926 32008 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb202b756324f029664229e1bc30ee9 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:52.737556 32008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb202b756324f029664229e1bc30ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.739614 32160 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb202b756324f029664229e1bc30ee9 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:52.741045 32160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb202b756324f029664229e1bc30ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.785113 32089 tablet_service.cc:1511] Processing CreateTablet for tablet 5001e9ef2e284085b80ef24e8216df00 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:52.785633 32083 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb202b756324f029664229e1bc30ee9 (DEFAULT_TABLE table=soft_deleted_table [id=89940abc3505486b8f10880e18336c97]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:52.786772 32089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5001e9ef2e284085b80ef24e8216df00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.787456 32083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb202b756324f029664229e1bc30ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.804600 32329 tablet_bootstrap.cc:492] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:52.808234 32327 tablet_bootstrap.cc:492] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:52.848711 32330 tablet_bootstrap.cc:492] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:52.858093 32330 tablet_bootstrap.cc:654] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.873250 32329 tablet_bootstrap.cc:654] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.873289 32330 tablet_bootstrap.cc:492] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:52.867255 32327 tablet_bootstrap.cc:654] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.874346 32330 ts_tablet_manager.cc:1403] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.009s
I20260709 12:22:52.878845 32330 raft_consensus.cc:359] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.880131 32330 raft_consensus.cc:385] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.880564 32330 raft_consensus.cc:740] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.881695 32330 consensus_queue.cc:260] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.884735 32330 ts_tablet_manager.cc:1434] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 12:22:52.885824 32330 tablet_bootstrap.cc:492] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:52.888626 32327 tablet_bootstrap.cc:492] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:52.888924 32329 tablet_bootstrap.cc:492] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:52.889333 32327 ts_tablet_manager.cc:1403] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.081s	user 0.003s	sys 0.015s
I20260709 12:22:52.889595 32329 ts_tablet_manager.cc:1403] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.005s
I20260709 12:22:52.893318 32330 tablet_bootstrap.cc:654] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.892995 32327 raft_consensus.cc:359] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.893886 32327 raft_consensus.cc:385] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.893406 32329 raft_consensus.cc:359] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.894217 32327 raft_consensus.cc:740] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.894574 32329 raft_consensus.cc:385] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.894954 32329 raft_consensus.cc:740] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.895210 32327 consensus_queue.cc:260] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.895955 32329 consensus_queue.cc:260] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.898881 32329 ts_tablet_manager.cc:1434] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:52.902860 32329 tablet_bootstrap.cc:492] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:52.901185 32327 ts_tablet_manager.cc:1434] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:22:52.904361 32330 tablet_bootstrap.cc:492] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:52.904774 32327 tablet_bootstrap.cc:492] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:52.904944 32330 ts_tablet_manager.cc:1403] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 12:22:52.908456 32330 raft_consensus.cc:359] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.909221 32330 raft_consensus.cc:385] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.909507 32330 raft_consensus.cc:740] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.910228 32330 consensus_queue.cc:260] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.913129 32327 tablet_bootstrap.cc:654] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.916193 32330 ts_tablet_manager.cc:1434] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:22:52.917284 32330 tablet_bootstrap.cc:492] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:52.926496 32330 tablet_bootstrap.cc:654] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.926800 32329 tablet_bootstrap.cc:654] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.933980 32330 tablet_bootstrap.cc:492] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:52.934440 32327 tablet_bootstrap.cc:492] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:52.934530 32330 ts_tablet_manager.cc:1403] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:22:52.935094 32327 ts_tablet_manager.cc:1403] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.007s
I20260709 12:22:52.935204 32329 tablet_bootstrap.cc:492] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:52.935896 32329 ts_tablet_manager.cc:1403] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 12:22:52.938326 32330 raft_consensus.cc:359] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.938462 32327 raft_consensus.cc:359] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.939167 32330 raft_consensus.cc:385] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.939352 32327 raft_consensus.cc:385] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.939226 32329 raft_consensus.cc:359] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.939975 32327 raft_consensus.cc:740] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.939713 32330 raft_consensus.cc:740] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.940260 32329 raft_consensus.cc:385] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.940812 32329 raft_consensus.cc:740] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.940474 32328 raft_consensus.cc:493] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.940887 32327 consensus_queue.cc:260] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.941020 32330 consensus_queue.cc:260] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.941670 32328 raft_consensus.cc:515] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.944239 32327 ts_tablet_manager.cc:1434] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:22:52.944293 32330 ts_tablet_manager.cc:1434] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260709 12:22:52.941905 32329 consensus_queue.cc:260] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.946345 32330 tablet_bootstrap.cc:492] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:52.953503 32329 ts_tablet_manager.cc:1434] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 12:22:52.953846 32330 tablet_bootstrap.cc:654] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.954013 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:52.954752 32329 tablet_bootstrap.cc:492] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:52.954897 32026 raft_consensus.cc:2468] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:52.945381 32327 tablet_bootstrap.cc:492] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:52.961587 32328 leader_election.cc:290] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:52.963325 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:52.968036 32064 leader_election.cc:304] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:52.970908 32328 raft_consensus.cc:2804] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.971439 32328 raft_consensus.cc:493] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.971830 32328 raft_consensus.cc:3060] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:52.972111 32067 leader_election.cc:343] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.975701 32330 tablet_bootstrap.cc:492] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:52.976301 32330 ts_tablet_manager.cc:1403] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.003s
I20260709 12:22:52.978623 32327 tablet_bootstrap.cc:654] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.980118 32329 tablet_bootstrap.cc:654] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.980950 32330 raft_consensus.cc:359] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.981770 32330 raft_consensus.cc:385] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.982129 32330 raft_consensus.cc:740] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.983299 32330 consensus_queue.cc:260] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.984685 32328 raft_consensus.cc:515] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:52.988407 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:52.989005 32026 raft_consensus.cc:3060] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.989645 32330 ts_tablet_manager.cc:1434] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:52.990935 32330 tablet_bootstrap.cc:492] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:52.991122 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
W20260709 12:22:52.993192 32067 leader_election.cc:343] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.989789 32328 leader_election.cc:290] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:52.998065 32327 tablet_bootstrap.cc:492] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:52.998206 32329 tablet_bootstrap.cc:492] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:52.998252 32330 tablet_bootstrap.cc:654] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.998840 32327 ts_tablet_manager.cc:1403] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.005s
I20260709 12:22:52.998905 32329 ts_tablet_manager.cc:1403] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.008s
I20260709 12:22:53.010320 32026 raft_consensus.cc:2468] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.012178 32064 leader_election.cc:304] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 30db6569e3354597b9c74a961b09980f
I20260709 12:22:53.012025 32327 raft_consensus.cc:359] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.012702 32330 tablet_bootstrap.cc:492] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:53.012928 32327 raft_consensus.cc:385] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.012624 32329 raft_consensus.cc:359] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.013411 32327 raft_consensus.cc:740] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.013473 32330 ts_tablet_manager.cc:1403] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 12:22:53.013615 32328 raft_consensus.cc:2804] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.013654 32329 raft_consensus.cc:385] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.014451 32328 raft_consensus.cc:697] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:53.014353 32327 consensus_queue.cc:260] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.014367 32329 raft_consensus.cc:740] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.015492 32328 consensus_queue.cc:237] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.016989 32327 ts_tablet_manager.cc:1434] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:22:53.016605 32329 consensus_queue.cc:260] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.017195 32330 raft_consensus.cc:359] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.017975 32330 raft_consensus.cc:385] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.018246 32330 raft_consensus.cc:740] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.018436 32327 tablet_bootstrap.cc:492] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:53.019008 32330 consensus_queue.cc:260] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.021529 32330 ts_tablet_manager.cc:1434] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:53.022710 32330 tablet_bootstrap.cc:492] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:53.026453 32327 tablet_bootstrap.cc:654] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.028014 32329 ts_tablet_manager.cc:1434] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:22:53.029764 32330 tablet_bootstrap.cc:654] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.036046 32329 tablet_bootstrap.cc:492] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:53.048785 32327 tablet_bootstrap.cc:492] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:53.049405 32327 ts_tablet_manager.cc:1403] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.016s
I20260709 12:22:53.050081 32330 tablet_bootstrap.cc:492] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:53.050731 32330 ts_tablet_manager.cc:1403] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.013s
I20260709 12:22:53.051608 32329 tablet_bootstrap.cc:654] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.052591 32327 raft_consensus.cc:359] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.053339 32327 raft_consensus.cc:385] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.053613 32327 raft_consensus.cc:740] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.054162 32330 raft_consensus.cc:359] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.054416 32327 consensus_queue.cc:260] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.055146 32330 raft_consensus.cc:385] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.054174 31921 catalog_manager.cc:5697] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.062420 32330 raft_consensus.cc:740] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.064170 32327 ts_tablet_manager.cc:1434] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:22:53.063504 32330 consensus_queue.cc:260] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.065435 32327 tablet_bootstrap.cc:492] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:53.066444 32329 tablet_bootstrap.cc:492] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:53.066560 32330 ts_tablet_manager.cc:1434] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.012s
I20260709 12:22:53.067255 32329 ts_tablet_manager.cc:1403] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.000s
I20260709 12:22:53.068045 32330 tablet_bootstrap.cc:492] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:53.070797 32329 raft_consensus.cc:359] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.071607 32329 raft_consensus.cc:385] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.071923 32329 raft_consensus.cc:740] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.073582 32329 consensus_queue.cc:260] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.075278 32330 tablet_bootstrap.cc:654] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.087632 32329 ts_tablet_manager.cc:1434] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:22:53.096316 32329 tablet_bootstrap.cc:492] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:53.085394 32328 raft_consensus.cc:493] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.095085 32327 tablet_bootstrap.cc:654] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.097855 32328 raft_consensus.cc:515] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.101293 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.102003 32026 raft_consensus.cc:2468] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:53.103798 32064 leader_election.cc:304] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.104858 32255 raft_consensus.cc:2804] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.105343 32255 raft_consensus.cc:493] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.105762 32255 raft_consensus.cc:3060] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.106837 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.107820 32175 raft_consensus.cc:2468] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:53.109813 32328 leader_election.cc:290] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.120337 32311 raft_consensus.cc:493] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.121096 32311 raft_consensus.cc:515] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.124676 32327 tablet_bootstrap.cc:492] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:53.125053 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.125329 32327 ts_tablet_manager.cc:1403] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.015s
I20260709 12:22:53.126240 32330 tablet_bootstrap.cc:492] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:53.126819 32330 ts_tablet_manager.cc:1403] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.043s
I20260709 12:22:53.128944 32327 raft_consensus.cc:359] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.129746 32327 raft_consensus.cc:385] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.130064 32327 raft_consensus.cc:740] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.130873 32327 consensus_queue.cc:260] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
W20260709 12:22:53.131345 32138 leader_election.cc:343] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.125340 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.132717 32311 leader_election.cc:290] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.133281 32100 raft_consensus.cc:2468] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.135105 32141 leader_election.cc:304] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:53.136514 32311 raft_consensus.cc:2804] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.137010 32311 raft_consensus.cc:493] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.137410 32311 raft_consensus.cc:3060] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.139282 32330 raft_consensus.cc:359] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.140084 32327 ts_tablet_manager.cc:1434] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.007s
I20260709 12:22:53.140159 32330 raft_consensus.cc:385] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.140754 32330 raft_consensus.cc:740] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.141507 32327 tablet_bootstrap.cc:492] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:53.141570 32330 consensus_queue.cc:260] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.144322 32330 ts_tablet_manager.cc:1434] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 12:22:53.145424 32330 tablet_bootstrap.cc:492] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:53.132375 32255 raft_consensus.cc:515] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.149694 32327 tablet_bootstrap.cc:654] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.131362 32329 tablet_bootstrap.cc:654] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.152022 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.152712 32026 raft_consensus.cc:3060] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.153005 32330 tablet_bootstrap.cc:654] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.157644 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:53.158533 32175 raft_consensus.cc:3060] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.184041 32311 raft_consensus.cc:515] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.192836 32305 raft_consensus.cc:493] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.201932 32305 raft_consensus.cc:515] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.202962 32329 tablet_bootstrap.cc:492] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:53.200809 32330 tablet_bootstrap.cc:492] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:53.185398 32255 leader_election.cc:290] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.203969 32330 ts_tablet_manager.cc:1403] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.059s	user 0.031s	sys 0.024s
I20260709 12:22:53.206003 32026 raft_consensus.cc:2468] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.207335 32064 leader_election.cc:304] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.207469 32330 raft_consensus.cc:359] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.208233 32330 raft_consensus.cc:385] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.208525 32330 raft_consensus.cc:740] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.208817 32328 raft_consensus.cc:2804] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.209344 32328 raft_consensus.cc:697] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:53.209326 32330 consensus_queue.cc:260] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.210446 32328 consensus_queue.cc:237] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.211189 32330 ts_tablet_manager.cc:1434] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:53.212240 32330 tablet_bootstrap.cc:492] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: Bootstrap starting.
I20260709 12:22:53.215641 32329 ts_tablet_manager.cc:1403] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.004s
I20260709 12:22:53.218613 32175 raft_consensus.cc:2468] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.219298 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.215591 32305 leader_election.cc:290] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.219607 32329 raft_consensus.cc:359] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.220399 32329 raft_consensus.cc:385] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.220705 32329 raft_consensus.cc:740] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.221565 32329 consensus_queue.cc:260] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
W20260709 12:22:53.222225 32138 leader_election.cc:343] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.224346 32311 leader_election.cc:290] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.227715 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.228405 32100 raft_consensus.cc:3060] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.228434 32330 tablet_bootstrap.cc:654] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.237165 32327 tablet_bootstrap.cc:492] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:53.237802 32327 ts_tablet_manager.cc:1403] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.097s	user 0.042s	sys 0.035s
I20260709 12:22:53.239106 32311 raft_consensus.cc:493] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.239403 32100 raft_consensus.cc:2468] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.241047 32141 leader_election.cc:304] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:53.239842 32311 raft_consensus.cc:515] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.243631 32327 raft_consensus.cc:359] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.244412 32327 raft_consensus.cc:385] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.244684 32327 raft_consensus.cc:740] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.245500 32327 consensus_queue.cc:260] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.247393 32311 leader_election.cc:290] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.247231 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.248903 32025 raft_consensus.cc:2468] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.250299 32138 leader_election.cc:304] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:53.248054 32327 ts_tablet_manager.cc:1434] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:53.247308 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.254417 32100 raft_consensus.cc:2468] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.254727 32327 tablet_bootstrap.cc:492] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:53.256712 31924 catalog_manager.cc:5697] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:53.259837 31992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:36035, user_credentials={real_user=slave}} blocked reactor thread for 54843.6us
I20260709 12:22:53.260402 32355 raft_consensus.cc:2804] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.261189 32311 raft_consensus.cc:2804] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.268222 32311 raft_consensus.cc:493] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.269469 32311 raft_consensus.cc:3060] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.264230 32330 tablet_bootstrap.cc:492] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: No bootstrap required, opened a new log
I20260709 12:22:53.270164 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb202b756324f029664229e1bc30ee9" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.270834 32330 ts_tablet_manager.cc:1403] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.011s
I20260709 12:22:53.271833 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb202b756324f029664229e1bc30ee9" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
W20260709 12:22:53.273211 31992 leader_election.cc:343] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:53.273936 31992 leader_election.cc:343] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.274376 31992 leader_election.cc:304] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f; no voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.274151 32330 raft_consensus.cc:359] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.266760 32329 ts_tablet_manager.cc:1434] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.016s
I20260709 12:22:53.275961 32329 tablet_bootstrap.cc:492] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:53.279897 32349 raft_consensus.cc:2749] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.284471 32329 tablet_bootstrap.cc:654] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.285674 32355 raft_consensus.cc:697] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:53.286298 32311 raft_consensus.cc:515] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.287338 32355 consensus_queue.cc:237] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.287883 32330 raft_consensus.cc:385] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.288283 32330 raft_consensus.cc:740] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.289448 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.290140 32025 raft_consensus.cc:3060] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.290422 32327 tablet_bootstrap.cc:654] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.294162 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.294828 32100 raft_consensus.cc:3060] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.290879 32357 raft_consensus.cc:493] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.295478 32357 raft_consensus.cc:515] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.299252 32357 leader_election.cc:290] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.298625 31922 catalog_manager.cc:5697] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 1 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.300311 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.300625 32311 leader_election.cc:290] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.301148 32026 raft_consensus.cc:2393] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30db6569e3354597b9c74a961b09980f in current term 1: Already voted for candidate 483ed0fc9c0643bcbd0b017459719bb5 in this term.
I20260709 12:22:53.301959 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.304292 32141 leader_election.cc:304] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30db6569e3354597b9c74a961b09980f; no voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.304917 32100 raft_consensus.cc:2468] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.305389 32330 consensus_queue.cc:260] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.306149 32141 leader_election.cc:304] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.307046 32311 raft_consensus.cc:3060] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.308126 32330 ts_tablet_manager.cc:1434] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:22:53.309083 32327 tablet_bootstrap.cc:492] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:53.310119 32357 raft_consensus.cc:2804] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.312208 32357 raft_consensus.cc:697] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:53.313165 32025 raft_consensus.cc:2468] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.313131 32357 consensus_queue.cc:237] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.316282 32327 ts_tablet_manager.cc:1403] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.004s
I20260709 12:22:53.319747 32327 raft_consensus.cc:359] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.320212 32328 raft_consensus.cc:493] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.320505 32327 raft_consensus.cc:385] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.320832 32327 raft_consensus.cc:740] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.320748 32328 raft_consensus.cc:515] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.321748 32327 consensus_queue.cc:260] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.323128 32328 leader_election.cc:290] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.324455 32327 ts_tablet_manager.cc:1434] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:22:53.324944 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.325637 32175 raft_consensus.cc:2468] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:53.327061 32067 leader_election.cc:304] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.327878 32328 raft_consensus.cc:2804] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.325587 32327 tablet_bootstrap.cc:492] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:53.328284 32328 raft_consensus.cc:493] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.328752 32328 raft_consensus.cc:3060] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.328816 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.329542 32025 raft_consensus.cc:2468] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:53.328389 32329 tablet_bootstrap.cc:492] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:53.331342 32329 ts_tablet_manager.cc:1403] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.006s
I20260709 12:22:53.339676 32329 raft_consensus.cc:359] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.340745 32329 raft_consensus.cc:385] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.341118 32329 raft_consensus.cc:740] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.342450 32329 consensus_queue.cc:260] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.346028 32327 tablet_bootstrap.cc:654] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.349509 32311 raft_consensus.cc:2749] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.350512 32329 ts_tablet_manager.cc:1434] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 12:22:53.350714 31924 catalog_manager.cc:5697] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 1 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.351716 32329 tablet_bootstrap.cc:492] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:53.353729 32328 raft_consensus.cc:515] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.358373 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:53.359193 32175 raft_consensus.cc:3060] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.359654 32329 tablet_bootstrap.cc:654] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.361083 32349 raft_consensus.cc:493] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.361686 32349 raft_consensus.cc:515] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.364271 32349 leader_election.cc:290] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.367460 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.368104 32328 leader_election.cc:290] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.368371 32100 raft_consensus.cc:2468] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 0.
I20260709 12:22:53.369992 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.370774 32175 raft_consensus.cc:2468] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.372781 31992 leader_election.cc:304] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.372488 32067 leader_election.cc:304] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
W20260709 12:22:53.373920 31992 leader_election.cc:343] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.375079 32328 raft_consensus.cc:2804] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.375743 32328 raft_consensus.cc:697] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:53.377091 32349 raft_consensus.cc:2804] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.377673 32349 raft_consensus.cc:493] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.378019 32328 consensus_queue.cc:237] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.378145 32349 raft_consensus.cc:3060] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.379045 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.379838 32025 raft_consensus.cc:3060] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.382892 32327 tablet_bootstrap.cc:492] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:53.383738 32327 ts_tablet_manager.cc:1403] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.024s
I20260709 12:22:53.388332 32327 raft_consensus.cc:359] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.389207 32327 raft_consensus.cc:385] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.389513 32327 raft_consensus.cc:740] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.390297 32327 consensus_queue.cc:260] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.392639 32327 ts_tablet_manager.cc:1434] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:53.394129 32327 tablet_bootstrap.cc:492] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: Bootstrap starting.
I20260709 12:22:53.396957 32025 raft_consensus.cc:2468] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.397809 31922 catalog_manager.cc:5697] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.400997 32327 tablet_bootstrap.cc:654] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.403806 32329 tablet_bootstrap.cc:492] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:53.404474 32353 raft_consensus.cc:493] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.404475 32329 ts_tablet_manager.cc:1403] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.017s
I20260709 12:22:53.411882 32353 raft_consensus.cc:515] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.414227 32353 leader_election.cc:290] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.415925 32329 raft_consensus.cc:359] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.416757 32329 raft_consensus.cc:385] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.416886 32349 raft_consensus.cc:515] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.417461 32329 raft_consensus.cc:740] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.418376 32329 consensus_queue.cc:260] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.419270 32349 leader_election.cc:290] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.420991 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.416730 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.421501 32329 ts_tablet_manager.cc:1434] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
W20260709 12:22:53.422946 31992 leader_election.cc:343] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.423085 32329 tablet_bootstrap.cc:492] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
W20260709 12:22:53.423743 31992 leader_election.cc:343] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.423799 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:53.424295 31992 leader_election.cc:304] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f; no voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.425395 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.425994 32349 raft_consensus.cc:2749] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.426084 32100 raft_consensus.cc:3060] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.432938 32329 tablet_bootstrap.cc:654] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:53.425518 31992 leader_election.cc:343] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.445116 32100 raft_consensus.cc:2468] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 1.
I20260709 12:22:53.447044 32327 tablet_bootstrap.cc:492] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: No bootstrap required, opened a new log
I20260709 12:22:53.447468 32329 tablet_bootstrap.cc:492] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:53.447829 32327 ts_tablet_manager.cc:1403] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent bootstrapping tablet: real 0.054s	user 0.032s	sys 0.017s
I20260709 12:22:53.448048 32329 ts_tablet_manager.cc:1403] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 12:22:53.447144 31992 leader_election.cc:304] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 30db6569e3354597b9c74a961b09980f
I20260709 12:22:53.449534 32349 raft_consensus.cc:2804] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.450016 32349 raft_consensus.cc:697] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:53.450834 32349 consensus_queue.cc:237] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.451474 32329 raft_consensus.cc:359] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.452270 32329 raft_consensus.cc:385] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.452557 32329 raft_consensus.cc:740] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.453302 32329 consensus_queue.cc:260] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.455471 32329 ts_tablet_manager.cc:1434] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:53.457084 32329 tablet_bootstrap.cc:492] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: Bootstrap starting.
I20260709 12:22:53.465688 32329 tablet_bootstrap.cc:654] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.464692 32255 consensus_queue.cc:1048] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:53.463577 32327 raft_consensus.cc:359] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.467629 32327 raft_consensus.cc:385] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.464061 32348 raft_consensus.cc:493] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.468006 32327 raft_consensus.cc:740] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.468369 32348 raft_consensus.cc:515] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.468901 32327 consensus_queue.cc:260] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.471335 32327 ts_tablet_manager.cc:1434] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:22:53.471401 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64ec2875aa400ea661f8a0253450eb" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.472127 32025 raft_consensus.cc:2468] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:53.473058 32348 leader_election.cc:290] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.474004 32064 leader_election.cc:304] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.476202 32173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64ec2875aa400ea661f8a0253450eb" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.476949 32173 raft_consensus.cc:2468] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 0.
I20260709 12:22:53.480396 32348 raft_consensus.cc:2804] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.481092 32348 raft_consensus.cc:493] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.481465 32348 raft_consensus.cc:3060] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.498375 31921 catalog_manager.cc:5697] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 1 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.513499 32255 consensus_queue.cc:1048] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:53.525570 31972 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:53.492820 32348 raft_consensus.cc:515] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.527293 32329 tablet_bootstrap.cc:492] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: No bootstrap required, opened a new log
I20260709 12:22:53.527940 32329 ts_tablet_manager.cc:1403] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.005s
I20260709 12:22:53.529522 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64ec2875aa400ea661f8a0253450eb" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.530285 32026 raft_consensus.cc:3060] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.532792 32329 raft_consensus.cc:359] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.533561 32329 raft_consensus.cc:385] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.533835 32329 raft_consensus.cc:740] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.534584 32329 consensus_queue.cc:260] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.537461 32329 ts_tablet_manager.cc:1434] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:53.544417 32026 raft_consensus.cc:2468] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.547583 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64ec2875aa400ea661f8a0253450eb" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:53.549669 32175 raft_consensus.cc:3060] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.559813 32348 leader_election.cc:290] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.560886 32064 leader_election.cc:304] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.561977 32348 raft_consensus.cc:2804] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.563398 32348 raft_consensus.cc:697] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:53.564337 32348 consensus_queue.cc:237] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.565476 32175 raft_consensus.cc:2468] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 1.
I20260709 12:22:53.578490 32311 raft_consensus.cc:493] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.579177 32311 raft_consensus.cc:515] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.581535 31921 catalog_manager.cc:5697] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 1 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.582657 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb202b756324f029664229e1bc30ee9" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.583374 32100 raft_consensus.cc:2468] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.584416 32141 leader_election.cc:304] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.585466 32357 raft_consensus.cc:2804] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.585819 32357 raft_consensus.cc:493] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.586125 32357 raft_consensus.cc:3060] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.587713 32311 leader_election.cc:290] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.590732 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb202b756324f029664229e1bc30ee9" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.592451 32025 raft_consensus.cc:2468] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.598920 32357 raft_consensus.cc:515] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.601044 32357 leader_election.cc:290] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.601894 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb202b756324f029664229e1bc30ee9" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.602212 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb202b756324f029664229e1bc30ee9" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.602656 32025 raft_consensus.cc:3060] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.602785 32100 raft_consensus.cc:3060] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.610574 32100 raft_consensus.cc:2468] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.610574 32025 raft_consensus.cc:2468] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.612038 32138 leader_election.cc:304] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:53.612905 32357 raft_consensus.cc:2804] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.613417 32357 raft_consensus.cc:697] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:53.614243 32357 consensus_queue.cc:237] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.623093 31921 catalog_manager.cc:5697] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 1 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.680279 32348 consensus_queue.cc:1048] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.692068 32372 consensus_queue.cc:1048] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:53.712348 32305 raft_consensus.cc:493] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.712929 32305 raft_consensus.cc:515] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.715291 32305 leader_election.cc:290] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.715950 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.716486 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30db6569e3354597b9c74a961b09980f" is_pre_election: true
I20260709 12:22:53.716912 32100 raft_consensus.cc:2393] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c53af950ae844c8a8536d8181a55c7f in current term 1: Already voted for candidate 30db6569e3354597b9c74a961b09980f in this term.
I20260709 12:22:53.718508 31992 leader_election.cc:304] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f; no voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.719328 32305 raft_consensus.cc:3060] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.725931 32305 raft_consensus.cc:2749] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.731812 32357 raft_consensus.cc:493] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.732422 32357 raft_consensus.cc:515] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.734423 32357 leader_election.cc:290] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.735215 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.735548 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.736126 32026 raft_consensus.cc:2468] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.736369 32100 raft_consensus.cc:2468] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 0.
I20260709 12:22:53.736529 32357 consensus_queue.cc:1048] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.737249 32138 leader_election.cc:304] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:53.738158 32357 raft_consensus.cc:2804] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.738524 32357 raft_consensus.cc:493] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.738893 32357 raft_consensus.cc:3060] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.748121 32355 consensus_queue.cc:1048] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.748092 32357 raft_consensus.cc:515] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.754799 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.755440 32101 raft_consensus.cc:3060] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.757915 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:53.758615 32026 raft_consensus.cc:3060] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.766466 32026 raft_consensus.cc:2468] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.767710 32357 leader_election.cc:290] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.769181 32101 raft_consensus.cc:2468] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 1.
I20260709 12:22:53.770385 32141 leader_election.cc:304] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.771122 32357 raft_consensus.cc:2804] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.771595 32357 raft_consensus.cc:697] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:53.772344 32357 consensus_queue.cc:237] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.781589 31922 catalog_manager.cc:5697] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 0 to 1, leader changed from <none> to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 1 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.843245 32357 raft_consensus.cc:493] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.843808 32357 raft_consensus.cc:515] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.845639 32357 leader_election.cc:290] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:53.846552 32026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c53af950ae844c8a8536d8181a55c7f" is_pre_election: true
I20260709 12:22:53.846719 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5" is_pre_election: true
I20260709 12:22:53.847517 32101 raft_consensus.cc:2393] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30db6569e3354597b9c74a961b09980f in current term 1: Already voted for candidate 1c53af950ae844c8a8536d8181a55c7f in this term.
I20260709 12:22:53.848542 32141 leader_election.cc:304] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30db6569e3354597b9c74a961b09980f; no voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.849261 32355 raft_consensus.cc:3060] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.856164 32355 raft_consensus.cc:2749] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.876940 32101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:48152
I20260709 12:22:53.877929 32101 raft_consensus.cc:606] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:53.879410 32255 consensus_queue.cc:1048] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.880019 32355 consensus_queue.cc:1048] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.885730 32100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:48152
I20260709 12:22:53.886492 32100 raft_consensus.cc:606] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:53.898447 32348 consensus_queue.cc:1048] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.899603 32175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:43278
I20260709 12:22:53.900391 32175 raft_consensus.cc:606] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:53.901800 32311 consensus_queue.cc:1048] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.907733 32372 raft_consensus.cc:993] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:53.908317 32372 raft_consensus.cc:1081] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:53.917186 32100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:48152
I20260709 12:22:53.917990 32100 raft_consensus.cc:606] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 1c53af950ae844c8a8536d8181a55c7f
I20260709 12:22:53.919692 32024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42736
I20260709 12:22:53.920432 32024 raft_consensus.cc:493] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.920878 32024 raft_consensus.cc:3060] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.929312 32255 raft_consensus.cc:993] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:53.929865 32255 raft_consensus.cc:1081] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:53.932322 32026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42736
I20260709 12:22:53.933017 32026 raft_consensus.cc:493] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.933455 32175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
mode: GRACEFUL
new_leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:43278
I20260709 12:22:53.933655 32024 raft_consensus.cc:515] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.933491 32026 raft_consensus.cc:3060] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.934180 32175 raft_consensus.cc:606] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Received request to transfer leadership to TS 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.936800 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.937361 32100 raft_consensus.cc:3055] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.937638 32100 raft_consensus.cc:740] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:53.939179 32100 consensus_queue.cc:260] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.940413 32100 raft_consensus.cc:3060] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.941401 32175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08a9d0465bc54e24a3a31233cb6cca99" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:53.942051 32175 raft_consensus.cc:3060] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.942821 32026 raft_consensus.cc:515] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.945623 32101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:53.945675 32025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
mode: GRACEFUL
new_leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:42752
I20260709 12:22:53.946282 32101 raft_consensus.cc:3055] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.946384 32025 raft_consensus.cc:606] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Received request to transfer leadership to TS 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.946692 32101 raft_consensus.cc:740] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:53.947707 32101 consensus_queue.cc:260] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.948357 32100 raft_consensus.cc:2468] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:53.949005 32101 raft_consensus.cc:3060] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.948976 32026 leader_election.cc:290] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.949633 31992 leader_election.cc:304] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.950129 32174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b343e8765411da643bcad1ea4ac33" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:53.950666 32305 raft_consensus.cc:2804] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.950839 32174 raft_consensus.cc:3060] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.951243 32305 raft_consensus.cc:697] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:53.952279 32305 consensus_queue.cc:237] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.955085 32175 raft_consensus.cc:2468] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:53.955613 32024 leader_election.cc:290] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:53.956701 32101 raft_consensus.cc:2468] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:53.957708 31992 leader_election.cc:304] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:53.958539 32353 raft_consensus.cc:2804] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.959007 32353 raft_consensus.cc:697] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:53.959916 32353 consensus_queue.cc:237] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:53.960760 32174 raft_consensus.cc:2468] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:53.962945 32174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
mode: GRACEFUL
new_leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:43278
I20260709 12:22:53.963541 32174 raft_consensus.cc:606] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Received request to transfer leadership to TS 483ed0fc9c0643bcbd0b017459719bb5
I20260709 12:22:53.965478 31924 catalog_manager.cc:5697] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.970129 32353 consensus_queue.cc:1048] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.984275 32305 consensus_queue.cc:1048] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.985812 31921 catalog_manager.cc:5697] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.008987 32305 raft_consensus.cc:993] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: : Instructing follower 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:54.013118 32349 raft_consensus.cc:1081] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Signalling peer 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:54.591331 32101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:48148
I20260709 12:22:54.592125 32101 raft_consensus.cc:493] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:54.592594 32101 raft_consensus.cc:3060] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.603273 32101 raft_consensus.cc:515] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.621683 32101 leader_election.cc:290] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:54.624246 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:54.625068 32172 raft_consensus.cc:3060] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.629172 32098 raft_consensus.cc:1240] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Rejecting Update request from peer 1c53af950ae844c8a8536d8181a55c7f for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:54.630992 32311 raft_consensus.cc:993] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: : Instructing follower 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:54.631595 32311 raft_consensus.cc:1081] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Signalling peer 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:54.634013 32172 raft_consensus.cc:2468] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:54.635439 32067 leader_election.cc:304] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:54.636410 32255 raft_consensus.cc:2804] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:54.636893 32255 raft_consensus.cc:697] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:54.637840 32255 consensus_queue.cc:237] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.639864 32098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:48142
I20260709 12:22:54.640631 32098 raft_consensus.cc:493] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:54.641047 32098 raft_consensus.cc:3060] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.648617 32349 consensus_queue.cc:1059] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:54.649595 32349 raft_consensus.cc:3055] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:54.649922 32349 raft_consensus.cc:740] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:54.650833 32349 consensus_queue.cc:260] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.653000 32349 raft_consensus.cc:3060] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.658541 32098 raft_consensus.cc:515] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.659901 32372 consensus_queue.cc:1048] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:54.661103 32098 leader_election.cc:290] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:54.662916 32172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:54.666719 32311 consensus_queue.cc:1048] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:54.670467 32097 raft_consensus.cc:1275] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.672410 32172 raft_consensus.cc:3055] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:54.672466 32390 consensus_queue.cc:1048] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:54.673125 32172 raft_consensus.cc:740] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:54.674350 32172 consensus_queue.cc:260] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.676397 32172 raft_consensus.cc:3060] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.679539 32098 raft_consensus.cc:1275] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.683238 32168 raft_consensus.cc:1240] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Rejecting Update request from peer 1c53af950ae844c8a8536d8181a55c7f for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:54.686878 32023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a6fb36d99b45b2890a68ee0f51f655" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:54.687088 32170 raft_consensus.cc:1275] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.688900 32025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a9646e666d6415089e3c5df86603bb7" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:54.689487 32025 raft_consensus.cc:3060] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.689347 32169 raft_consensus.cc:1275] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.699239 32305 consensus_queue.cc:1048] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:54.712610 32389 consensus_queue.cc:1048] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:54.713577 32172 raft_consensus.cc:2468] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:54.715165 32389 consensus_queue.cc:1048] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.720360 32357 consensus_queue.cc:1048] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:54.724309 32372 consensus_queue.cc:1048] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:54.727063 32311 consensus_queue.cc:1048] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:54.729096 32311 raft_consensus.cc:993] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:54.729650 32311 raft_consensus.cc:1081] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:54.731508 32392 raft_consensus.cc:993] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:54.732127 32392 raft_consensus.cc:1081] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 1c53af950ae844c8a8536d8181a55c7f to start an election
I20260709 12:22:54.732280 31924 catalog_manager.cc:5697] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 1 to 2, leader changed from 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65) to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.738611 32067 leader_election.cc:304] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:54.739939 32328 raft_consensus.cc:2804] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:54.740473 32328 raft_consensus.cc:697] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:54.741446 32328 consensus_queue.cc:237] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.767535 32022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42736
I20260709 12:22:54.768486 32022 raft_consensus.cc:493] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:54.775470 32022 raft_consensus.cc:3060] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.782245 32399 raft_consensus.cc:993] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: : Instructing follower 483ed0fc9c0643bcbd0b017459719bb5 to start an election
I20260709 12:22:54.783010 32399 raft_consensus.cc:1081] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Signalling peer 483ed0fc9c0643bcbd0b017459719bb5 to start an election
W20260709 12:22:54.777056 32138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.65:46409, user_credentials={real_user=slave}} blocked reactor thread for 50939.1us
I20260709 12:22:54.824697 32100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
 from {username='slave'} at 127.0.0.1:48142
I20260709 12:22:54.825452 32100 raft_consensus.cc:493] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:54.826022 32100 raft_consensus.cc:3060] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.825292 32025 raft_consensus.cc:2468] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:54.828004 32024 raft_consensus.cc:1240] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Rejecting Update request from peer 30db6569e3354597b9c74a961b09980f for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:54.840816 32357 consensus_queue.cc:1048] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:54.856415 32100 raft_consensus.cc:515] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.859077 32100 leader_election.cc:290] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:54.878310 32169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:54.877378 32024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
 from {username='slave'} at 127.0.0.1:42724
I20260709 12:22:54.880517 32024 raft_consensus.cc:493] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:54.880914 32024 raft_consensus.cc:3060] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.887724 32023 raft_consensus.cc:2468] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:54.876869 32021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5001e9ef2e284085b80ef24e8216df00" candidate_uuid: "483ed0fc9c0643bcbd0b017459719bb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:54.893781 32021 raft_consensus.cc:3060] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.896636 32024 raft_consensus.cc:515] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.892436 32022 raft_consensus.cc:515] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.901365 32100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:54.902043 32100 raft_consensus.cc:3055] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:54.902401 32100 raft_consensus.cc:740] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:54.902524 32022 leader_election.cc:290] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:54.916510 32024 leader_election.cc:290] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 30db6569e3354597b9c74a961b09980f (127.18.132.67:43891)
I20260709 12:22:54.912073 32173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ec95e9cdd84bab9d7924426679778b" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:54.914304 32097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:54.918486 32173 raft_consensus.cc:3060] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.918913 32097 raft_consensus.cc:3060] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.915525 32169 raft_consensus.cc:3055] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:54.921433 32169 raft_consensus.cc:740] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:54.922435 32169 consensus_queue.cc:260] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.923655 32169 raft_consensus.cc:3060] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.904456 32100 consensus_queue.cc:260] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.916159 32167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "779a4a7d9cc547e6adaac0833137b496" candidate_uuid: "1c53af950ae844c8a8536d8181a55c7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30db6569e3354597b9c74a961b09980f"
I20260709 12:22:54.927045 32167 raft_consensus.cc:3055] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:54.927390 32167 raft_consensus.cc:740] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:54.928325 32167 consensus_queue.cc:260] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.929724 32167 raft_consensus.cc:3060] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.937726 32097 raft_consensus.cc:2468] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:54.939421 31992 leader_election.cc:304] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:54.940472 32353 raft_consensus.cc:2804] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:54.941006 32353 raft_consensus.cc:697] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:54.941962 32353 consensus_queue.cc:237] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.942839 32100 raft_consensus.cc:3060] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.941001 31920 catalog_manager.cc:5697] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 1 to 2, leader changed from 30db6569e3354597b9c74a961b09980f (127.18.132.67) to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.912441 32021 raft_consensus.cc:2468] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:54.950160 32064 leader_election.cc:304] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:54.951319 32372 raft_consensus.cc:2804] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:54.951902 32372 raft_consensus.cc:697] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Becoming Leader. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:54.952783 32372 consensus_queue.cc:237] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.953305 32023 raft_consensus.cc:1240] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Rejecting Update request from peer 30db6569e3354597b9c74a961b09980f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:22:54.953128 32169 raft_consensus.cc:2468] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483ed0fc9c0643bcbd0b017459719bb5 in term 2.
I20260709 12:22:54.954116 32100 raft_consensus.cc:2468] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:54.955595 31992 leader_election.cc:304] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:54.956207 32173 raft_consensus.cc:2468] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:54.956645 32389 raft_consensus.cc:2804] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:54.957260 32389 raft_consensus.cc:697] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Leader. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:54.948463 32167 raft_consensus.cc:2468] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c53af950ae844c8a8536d8181a55c7f in term 2.
I20260709 12:22:54.958185 32389 consensus_queue.cc:237] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:54.968604 31922 catalog_manager.cc:5697] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 30db6569e3354597b9c74a961b09980f (127.18.132.67) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.974006 31921 catalog_manager.cc:5697] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 reported cstate change: term changed from 1 to 2, leader changed from 30db6569e3354597b9c74a961b09980f (127.18.132.67) to 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66). New cstate: current_term: 2 leader_uuid: "483ed0fc9c0643bcbd0b017459719bb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.983754 31922 catalog_manager.cc:5697] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65). New cstate: current_term: 2 leader_uuid: "1c53af950ae844c8a8536d8181a55c7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.137622 32023 raft_consensus.cc:1275] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.139012 32372 consensus_queue.cc:1048] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.148697 32167 raft_consensus.cc:1275] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.150723 32348 consensus_queue.cc:1048] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.190615 32023 raft_consensus.cc:1275] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.192178 32348 consensus_queue.cc:1048] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.204806 32167 raft_consensus.cc:1275] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.206413 32348 consensus_queue.cc:1048] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:55.249881 32122 debug-util.cc:398] Leaking SignalData structure 0x7b080029ce40 after lost signal to thread 18964
W20260709 12:22:55.251190 32122 debug-util.cc:398] Leaking SignalData structure 0x7b08001db300 after lost signal to thread 31958
W20260709 12:22:55.252861 32122 debug-util.cc:398] Leaking SignalData structure 0x7b080010d420 after lost signal to thread 32050
W20260709 12:22:55.254074 32122 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3a00 after lost signal to thread 32125
W20260709 12:22:55.255339 32122 debug-util.cc:398] Leaking SignalData structure 0x7b0800216d80 after lost signal to thread 32199
I20260709 12:22:55.381552 32167 raft_consensus.cc:1275] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.383229 32389 consensus_queue.cc:1048] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.394591 32100 raft_consensus.cc:1275] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.397081 32305 consensus_queue.cc:1048] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.425568 32167 raft_consensus.cc:1275] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.426951 32305 consensus_queue.cc:1048] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.434332 32100 raft_consensus.cc:1275] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 1c53af950ae844c8a8536d8181a55c7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.436559 32305 consensus_queue.cc:1048] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:55.557909 32023 raft_consensus.cc:1275] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.559494 32348 consensus_queue.cc:1048] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:55.571293 32169 raft_consensus.cc:1275] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Refusing update from remote peer 483ed0fc9c0643bcbd0b017459719bb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:55.573333 32372 consensus_queue.cc:1048] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.344347 31922 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33894:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:22:57.369504 31922 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33894:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 12:22:57.476173 32067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:43891, user_credentials={real_user=slave}} blocked reactor thread for 73596.7us
I20260709 12:22:57.529774 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.577157 32459 tablet.cc:1724] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:57.632737 31992 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.67:43891, user_credentials={real_user=slave}} blocked reactor thread for 55027.4us
I20260709 12:22:57.654996 32471 tablet.cc:1724] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.715853 32476 tablet.cc:1724] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:57.702997 32141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.18.132.66:36035, user_credentials={real_user=slave}} blocked reactor thread for 47098.1us
I20260709 12:22:57.703078 32473 tablet.cc:1724] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.671180 32462 tablet.cc:1724] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.792399 32485 tablet.cc:1724] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.822492 32486 tablet.cc:1724] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.854476 32490 tablet.cc:1724] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.781026 32459 tablet.cc:1724] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.921202 32491 tablet.cc:1724] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.928664 32471 tablet.cc:1724] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.936503 32486 tablet.cc:1724] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.948040 32494 tablet.cc:1724] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.950484 32023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b"
dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
mode: GRACEFUL
new_leader_uuid: "30db6569e3354597b9c74a961b09980f"
 from {username='slave'} at 127.0.0.1:51274
I20260709 12:22:57.951229 32023 raft_consensus.cc:606] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Received request to transfer leadership to TS 30db6569e3354597b9c74a961b09980f
I20260709 12:22:57.882889 32492 tablet.cc:1724] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.961344 32462 tablet.cc:1724] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.965739 32485 tablet.cc:1724] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.968793 32486 tablet.cc:1724] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.984784 32496 tablet.cc:1724] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.985222 32476 tablet.cc:1724] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:57.993957 31922 catalog_manager.cc:5789] TS 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035) does not have the latest schema for tablet 5001e9ef2e284085b80ef24e8216df00 (table soft_deleted_table [id=89940abc3505486b8f10880e18336c97]). Expected version 1 got 0
I20260709 12:22:57.994987 31922 catalog_manager.cc:5789] TS 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035) does not have the latest schema for tablet 8b64ec2875aa400ea661f8a0253450eb (table soft_deleted_table [id=89940abc3505486b8f10880e18336c97]). Expected version 1 got 0
I20260709 12:22:57.998778 32476 tablet.cc:1724] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.000114 31922 catalog_manager.cc:5789] TS 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035) does not have the latest schema for tablet e7a6fb36d99b45b2890a68ee0f51f655 (table soft_deleted_table [id=89940abc3505486b8f10880e18336c97]). Expected version 1 got 0
I20260709 12:22:58.000823 32491 tablet.cc:1724] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.028155 32476 tablet.cc:1724] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.048395 32496 tablet.cc:1724] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.051285 32492 tablet.cc:1724] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.035086 32494 tablet.cc:1724] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.061698 32490 tablet.cc:1724] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.067289 32491 tablet.cc:1724] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:58.092922 32099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01"
dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
mode: GRACEFUL
new_leader_uuid: "30db6569e3354597b9c74a961b09980f"
 from {username='slave'} at 127.0.0.1:45460
I20260709 12:22:58.093555 32099 raft_consensus.cc:606] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Received request to transfer leadership to TS 30db6569e3354597b9c74a961b09980f
I20260709 12:22:58.096355 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:58.097165 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.119932 31922 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa: soft_deleted_table [id=89940abc3505486b8f10880e18336c97] alter complete (version 1)
I20260709 12:22:58.205161 32451 raft_consensus.cc:993] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: : Instructing follower 30db6569e3354597b9c74a961b09980f to start an election
I20260709 12:22:58.205852 32464 raft_consensus.cc:1081] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Signalling peer 30db6569e3354597b9c74a961b09980f to start an election
I20260709 12:22:58.207643 32171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
 from {username='slave'} at 127.0.0.1:43264
I20260709 12:22:58.208144 32171 raft_consensus.cc:493] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:58.208461 32171 raft_consensus.cc:3060] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:58.214485 32171 raft_consensus.cc:515] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:58.216447 32171 leader_election.cc:290] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 2 election: Requested vote from peers 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409), 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035)
I20260709 12:22:58.217769 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:58.217897 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e214e1c1f48e4f7d9d44d4784c5caa01" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:58.218715 32098 raft_consensus.cc:3055] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:58.218786 32024 raft_consensus.cc:3060] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:58.219118 32098 raft_consensus.cc:740] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 483ed0fc9c0643bcbd0b017459719bb5, State: Running, Role: LEADER
I20260709 12:22:58.220176 32098 consensus_queue.cc:260] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:58.221793 32098 raft_consensus.cc:3060] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:58.224836 32024 raft_consensus.cc:2468] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 2.
I20260709 12:22:58.226214 32138 leader_election.cc:304] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c53af950ae844c8a8536d8181a55c7f, 30db6569e3354597b9c74a961b09980f; no voters: 
I20260709 12:22:58.227171 32355 raft_consensus.cc:2804] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:58.227731 32355 raft_consensus.cc:697] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 2 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:58.228654 32355 consensus_queue.cc:237] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } }
I20260709 12:22:58.231230 32098 raft_consensus.cc:2468] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 2.
I20260709 12:22:58.239527 31922 catalog_manager.cc:5697] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 1 to 2, leader changed from 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66) to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 2 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.247694 32469 raft_consensus.cc:993] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: : Instructing follower 30db6569e3354597b9c74a961b09980f to start an election
I20260709 12:22:58.248361 32427 raft_consensus.cc:1081] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Signalling peer 30db6569e3354597b9c74a961b09980f to start an election
I20260709 12:22:58.250279 32171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b"
dest_uuid: "30db6569e3354597b9c74a961b09980f"
 from {username='slave'} at 127.0.0.1:43266
I20260709 12:22:58.250849 32171 raft_consensus.cc:493] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:58.251194 32171 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:58.257117 32171 raft_consensus.cc:515] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:58.258751 32171 leader_election.cc:290] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 3 election: Requested vote from peers 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035), 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409)
I20260709 12:22:58.260006 32098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "483ed0fc9c0643bcbd0b017459719bb5"
I20260709 12:22:58.260667 32024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92812dafb1b24d5798303c69b7a9586b" candidate_uuid: "30db6569e3354597b9c74a961b09980f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c53af950ae844c8a8536d8181a55c7f"
I20260709 12:22:58.260723 32098 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:58.261408 32024 raft_consensus.cc:3055] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:58.261873 32024 raft_consensus.cc:740] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c53af950ae844c8a8536d8181a55c7f, State: Running, Role: LEADER
I20260709 12:22:58.262717 32024 consensus_queue.cc:260] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:58.264034 32024 raft_consensus.cc:3060] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:58.269037 32098 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 3.
I20260709 12:22:58.270385 32141 leader_election.cc:304] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30db6569e3354597b9c74a961b09980f, 483ed0fc9c0643bcbd0b017459719bb5; no voters: 
I20260709 12:22:58.271237 32355 raft_consensus.cc:2804] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:58.271906 32355 raft_consensus.cc:697] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 3 LEADER]: Becoming Leader. State: Replica: 30db6569e3354597b9c74a961b09980f, State: Running, Role: LEADER
I20260709 12:22:58.272753 32355 consensus_queue.cc:237] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } }
I20260709 12:22:58.276268 32024 raft_consensus.cc:2468] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30db6569e3354597b9c74a961b09980f in term 3.
I20260709 12:22:58.285590 31922 catalog_manager.cc:5697] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f reported cstate change: term changed from 2 to 3, leader changed from 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65) to 30db6569e3354597b9c74a961b09980f (127.18.132.67). New cstate: current_term: 3 leader_uuid: "30db6569e3354597b9c74a961b09980f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30db6569e3354597b9c74a961b09980f" member_type: VOTER last_known_addr { host: "127.18.132.67" port: 43891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.617216 32023 raft_consensus.cc:1275] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Refusing update from remote peer 30db6569e3354597b9c74a961b09980f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.618685 32355 consensus_queue.cc:1048] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.630879 32099 raft_consensus.cc:1275] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Refusing update from remote peer 30db6569e3354597b9c74a961b09980f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.633283 32480 consensus_queue.cc:1048] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.776836 32024 raft_consensus.cc:1275] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 3 FOLLOWER]: Refusing update from remote peer 30db6569e3354597b9c74a961b09980f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:58.778378 32506 consensus_queue.cc:1048] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c53af950ae844c8a8536d8181a55c7f" member_type: VOTER last_known_addr { host: "127.18.132.65" port: 46409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.788884 32099 raft_consensus.cc:1275] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 3 FOLLOWER]: Refusing update from remote peer 30db6569e3354597b9c74a961b09980f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:58.790784 32355 consensus_queue.cc:1048] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [LEADER]: Connected to new peer: Peer: permanent_uuid: "483ed0fc9c0643bcbd0b017459719bb5" member_type: VOTER last_known_addr { host: "127.18.132.66" port: 36035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:59.098652 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.106103 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:59.107040 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:00.292667 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:00.298215 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:00.298727 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:00.959550 32122 debug-util.cc:398] Leaking SignalData structure 0x7b0800369260 after lost signal to thread 18964
W20260709 12:23:00.961174 32122 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9f20 after lost signal to thread 31958
W20260709 12:23:00.962699 32122 debug-util.cc:398] Leaking SignalData structure 0x7b0800125cc0 after lost signal to thread 32050
W20260709 12:23:00.964095 32122 debug-util.cc:398] Leaking SignalData structure 0x7b08002694a0 after lost signal to thread 32125
W20260709 12:23:00.965191 32122 debug-util.cc:398] Leaking SignalData structure 0x7b080029dc40 after lost signal to thread 32199
I20260709 12:23:01.300056 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:01.306596 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:01.307144 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:02.308609 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.317705 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:02.318297 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.319662 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.325517 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.326078 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.327208 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.332697 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.333163 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.334326 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.341003 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.341662 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.342742 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.348125 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:06.348613 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.349776 18961 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.355307 18961 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:07.355894 18961 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:08.415323 18961 tablet_server.cc:179] TabletServer@127.18.132.65:0 shutting down...
W20260709 12:23:08.425350 32138 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 12:23:08.432755 32138 consensus_peers.cc:597] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:08.466661 32064 consensus_peers.cc:597] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.480206 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:08.481168 18961 tablet_replica.cc:333] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.482234 18961 raft_consensus.cc:2243] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.483101 18961 raft_consensus.cc:2272] T 4a9646e666d6415089e3c5df86603bb7 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.486371 18961 tablet_replica.cc:333] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.487138 18961 raft_consensus.cc:2243] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.487947 18961 raft_consensus.cc:2272] T 8b64ec2875aa400ea661f8a0253450eb P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.491719 18961 tablet_replica.cc:333] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.492534 18961 raft_consensus.cc:2243] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.493074 18961 raft_consensus.cc:2272] T 5001e9ef2e284085b80ef24e8216df00 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.496768 18961 tablet_replica.cc:333] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.497915 18961 raft_consensus.cc:2243] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:08.498414 32064 consensus_peers.cc:597] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.498906 18961 raft_consensus.cc:2272] T 0fb202b756324f029664229e1bc30ee9 P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.502820 18961 tablet_replica.cc:333] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.503858 18961 raft_consensus.cc:2243] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.504706 18961 raft_consensus.cc:2272] T e7a6fb36d99b45b2890a68ee0f51f655 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.508117 32138 consensus_peers.cc:597] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.508586 18961 tablet_replica.cc:333] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.509392 18961 raft_consensus.cc:2243] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.510408 18961 raft_consensus.cc:2272] T b4ec95e9cdd84bab9d7924426679778b P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.514086 18961 tablet_replica.cc:333] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.514938 18961 raft_consensus.cc:2243] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.516235 18961 raft_consensus.cc:2272] T 1a698aab65a04e459b22902b1437a31a P 1c53af950ae844c8a8536d8181a55c7f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.516950 32064 consensus_peers.cc:597] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.519271 18961 tablet_replica.cc:333] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.520068 18961 raft_consensus.cc:2243] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.521050 18961 raft_consensus.cc:2272] T 08a9d0465bc54e24a3a31233cb6cca99 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.524446 18961 tablet_replica.cc:333] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.525096 18961 raft_consensus.cc:2243] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.525753 18961 raft_consensus.cc:2272] T 72f834602212496eb97901c7a81078a6 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.528419 18961 tablet_replica.cc:333] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.529029 18961 raft_consensus.cc:2243] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.529995 18961 raft_consensus.cc:2272] T b61ab1d4b34a4686bbabf04d852203cf P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.532987 18961 tablet_replica.cc:333] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.533787 18961 raft_consensus.cc:2243] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.535015 18961 raft_consensus.cc:2272] T 779a4a7d9cc547e6adaac0833137b496 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.537777 18961 tablet_replica.cc:333] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.538409 18961 raft_consensus.cc:2243] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.538933 18961 raft_consensus.cc:2272] T 92812dafb1b24d5798303c69b7a9586b P 1c53af950ae844c8a8536d8181a55c7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.541900 18961 tablet_replica.cc:333] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.542685 18961 raft_consensus.cc:2243] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.543340 18961 raft_consensus.cc:2272] T 8f7ecd79b39e485586e44cc4bd6572d4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.546238 18961 tablet_replica.cc:333] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.546871 18961 raft_consensus.cc:2243] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.547387 18961 raft_consensus.cc:2272] T ec81d229e6e7462c848a4fb2e690da4e P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.551424 18961 tablet_replica.cc:333] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
W20260709 12:23:08.551750 32064 consensus_peers.cc:597] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.552330 18961 raft_consensus.cc:2243] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.552973 18961 raft_consensus.cc:2272] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.555517 18961 tablet_replica.cc:333] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.556177 18961 raft_consensus.cc:2243] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.556741 18961 raft_consensus.cc:2272] T e214e1c1f48e4f7d9d44d4784c5caa01 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.559412 18961 tablet_replica.cc:333] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.560016 18961 raft_consensus.cc:2243] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.561120 18961 raft_consensus.cc:2272] T 873b343e8765411da643bcad1ea4ac33 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.565043 18961 tablet_replica.cc:333] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f: stopping tablet replica
I20260709 12:23:08.565749 18961 raft_consensus.cc:2243] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:23:08.565848 32064 consensus_peers.cc:597] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.566900 18961 raft_consensus.cc:2272] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 1c53af950ae844c8a8536d8181a55c7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.618243 18961 tablet_server.cc:196] TabletServer@127.18.132.65:0 shutdown complete.
I20260709 12:23:08.673987 18961 tablet_server.cc:179] TabletServer@127.18.132.66:0 shutting down...
I20260709 12:23:08.706996 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:08.707923 18961 tablet_replica.cc:333] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.708837 18961 raft_consensus.cc:2243] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.709949 18961 raft_consensus.cc:2272] T 5001e9ef2e284085b80ef24e8216df00 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.712905 18961 tablet_replica.cc:333] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.713642 18961 raft_consensus.cc:2243] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.714588 18961 raft_consensus.cc:2272] T 8b64ec2875aa400ea661f8a0253450eb P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.717130 18961 tablet_replica.cc:333] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.717815 18961 raft_consensus.cc:2243] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.718344 18961 raft_consensus.cc:2272] T 0fb202b756324f029664229e1bc30ee9 P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.720880 18961 tablet_replica.cc:333] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.721534 18961 raft_consensus.cc:2243] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.722476 18961 raft_consensus.cc:2272] T e7a6fb36d99b45b2890a68ee0f51f655 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.725073 18961 tablet_replica.cc:333] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.725711 18961 raft_consensus.cc:2243] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.726758 18961 raft_consensus.cc:2272] T 4a9646e666d6415089e3c5df86603bb7 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.729489 18961 tablet_replica.cc:333] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.730191 18961 raft_consensus.cc:2243] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.730770 18961 raft_consensus.cc:2272] T b4ec95e9cdd84bab9d7924426679778b P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.733381 18961 tablet_replica.cc:333] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.733986 18961 raft_consensus.cc:2243] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.734483 18961 raft_consensus.cc:2272] T 1a698aab65a04e459b22902b1437a31a P 483ed0fc9c0643bcbd0b017459719bb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.736923 18961 tablet_replica.cc:333] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.737532 18961 raft_consensus.cc:2243] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.738111 18961 raft_consensus.cc:2272] T 08a9d0465bc54e24a3a31233cb6cca99 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.740687 18961 tablet_replica.cc:333] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.741282 18961 raft_consensus.cc:2243] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.741889 18961 raft_consensus.cc:2272] T 873b343e8765411da643bcad1ea4ac33 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.744227 18961 tablet_replica.cc:333] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.744846 18961 raft_consensus.cc:2243] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.745383 18961 raft_consensus.cc:2272] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.747864 18961 tablet_replica.cc:333] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.748435 18961 raft_consensus.cc:2243] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.749392 18961 raft_consensus.cc:2272] T ec81d229e6e7462c848a4fb2e690da4e P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.751904 18961 tablet_replica.cc:333] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.752480 18961 raft_consensus.cc:2243] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.753064 18961 raft_consensus.cc:2272] T 779a4a7d9cc547e6adaac0833137b496 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.755847 18961 tablet_replica.cc:333] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.756609 18961 raft_consensus.cc:2243] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.757329 18961 raft_consensus.cc:2272] T 92812dafb1b24d5798303c69b7a9586b P 483ed0fc9c0643bcbd0b017459719bb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.760071 18961 tablet_replica.cc:333] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.760635 18961 raft_consensus.cc:2243] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.761152 18961 raft_consensus.cc:2272] T 8f7ecd79b39e485586e44cc4bd6572d4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.763504 18961 tablet_replica.cc:333] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.764142 18961 raft_consensus.cc:2243] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.764627 18961 raft_consensus.cc:2272] T e214e1c1f48e4f7d9d44d4784c5caa01 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.767277 18961 tablet_replica.cc:333] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.767922 18961 raft_consensus.cc:2243] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.768954 18961 raft_consensus.cc:2272] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.771548 18961 tablet_replica.cc:333] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.772159 18961 raft_consensus.cc:2243] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.772857 18961 raft_consensus.cc:2272] T b61ab1d4b34a4686bbabf04d852203cf P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.776376 18961 tablet_replica.cc:333] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5: stopping tablet replica
I20260709 12:23:08.777082 18961 raft_consensus.cc:2243] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.778463 18961 raft_consensus.cc:2272] T 72f834602212496eb97901c7a81078a6 P 483ed0fc9c0643bcbd0b017459719bb5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.780047 32141 consensus_peers.cc:597] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f -> Peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Couldn't send request to peer 483ed0fc9c0643bcbd0b017459719bb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:08.780159 32138 consensus_peers.cc:597] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:08.811458 32141 consensus_peers.cc:597] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f -> Peer 483ed0fc9c0643bcbd0b017459719bb5 (127.18.132.66:36035): Couldn't send request to peer 483ed0fc9c0643bcbd0b017459719bb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.856117 18961 tablet_server.cc:196] TabletServer@127.18.132.66:0 shutdown complete.
I20260709 12:23:08.909950 18961 tablet_server.cc:179] TabletServer@127.18.132.67:0 shutting down...
I20260709 12:23:08.951339 18961 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:08.952328 18961 tablet_replica.cc:333] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.953452 18961 raft_consensus.cc:2243] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.954144 18961 raft_consensus.cc:2272] T e7a6fb36d99b45b2890a68ee0f51f655 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.954631 32138 consensus_peers.cc:597] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f -> Peer 1c53af950ae844c8a8536d8181a55c7f (127.18.132.65:46409): Couldn't send request to peer 1c53af950ae844c8a8536d8181a55c7f. Status: Network error: Client connection negotiation failed: client connection to 127.18.132.65:46409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.956990 18961 tablet_replica.cc:333] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.957867 18961 raft_consensus.cc:2243] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.958420 18961 raft_consensus.cc:2272] T 5001e9ef2e284085b80ef24e8216df00 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.961112 18961 tablet_replica.cc:333] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.961833 18961 raft_consensus.cc:2243] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.962357 18961 raft_consensus.cc:2272] T 8b64ec2875aa400ea661f8a0253450eb P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.964843 18961 tablet_replica.cc:333] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.965732 18961 raft_consensus.cc:2243] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.966639 18961 raft_consensus.cc:2272] T 0fb202b756324f029664229e1bc30ee9 P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.969866 18961 tablet_replica.cc:333] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.970577 18961 raft_consensus.cc:2243] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.971151 18961 raft_consensus.cc:2272] T b4ec95e9cdd84bab9d7924426679778b P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.973518 18961 tablet_replica.cc:333] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.974166 18961 raft_consensus.cc:2243] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.974871 18961 raft_consensus.cc:2272] T 873b343e8765411da643bcad1ea4ac33 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.977386 18961 tablet_replica.cc:333] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.978005 18961 raft_consensus.cc:2243] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.978519 18961 raft_consensus.cc:2272] T 80f9f8dd2aa64bc0b439d82d64f0af89 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.981031 18961 tablet_replica.cc:333] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.981607 18961 raft_consensus.cc:2243] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.982592 18961 raft_consensus.cc:2272] T e214e1c1f48e4f7d9d44d4784c5caa01 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.985153 18961 tablet_replica.cc:333] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.985759 18961 raft_consensus.cc:2243] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.986251 18961 raft_consensus.cc:2272] T 9a1aa3df495f44a8b6514c00a2a4e3a4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.988935 18961 tablet_replica.cc:333] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.989564 18961 raft_consensus.cc:2243] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.990135 18961 raft_consensus.cc:2272] T 779a4a7d9cc547e6adaac0833137b496 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.992592 18961 tablet_replica.cc:333] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.993183 18961 raft_consensus.cc:2243] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.994164 18961 raft_consensus.cc:2272] T 92812dafb1b24d5798303c69b7a9586b P 30db6569e3354597b9c74a961b09980f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.996667 18961 tablet_replica.cc:333] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:08.997344 18961 raft_consensus.cc:2243] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:08.998200 18961 raft_consensus.cc:2272] T 8f7ecd79b39e485586e44cc4bd6572d4 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.000567 18961 tablet_replica.cc:333] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:09.001106 18961 raft_consensus.cc:2243] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.001611 18961 raft_consensus.cc:2272] T 08a9d0465bc54e24a3a31233cb6cca99 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.004174 18961 tablet_replica.cc:333] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:09.004878 18961 raft_consensus.cc:2243] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.005316 18961 raft_consensus.cc:2272] T 1a698aab65a04e459b22902b1437a31a P 30db6569e3354597b9c74a961b09980f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.007688 18961 tablet_replica.cc:333] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:09.008172 18961 raft_consensus.cc:2243] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.008606 18961 raft_consensus.cc:2272] T ec81d229e6e7462c848a4fb2e690da4e P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.010840 18961 tablet_replica.cc:333] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:09.011337 18961 raft_consensus.cc:2243] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.011826 18961 raft_consensus.cc:2272] T 72f834602212496eb97901c7a81078a6 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.014169 18961 tablet_replica.cc:333] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:09.014698 18961 raft_consensus.cc:2243] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.015185 18961 raft_consensus.cc:2272] T 4a9646e666d6415089e3c5df86603bb7 P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.017516 18961 tablet_replica.cc:333] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f: stopping tablet replica
I20260709 12:23:09.017995 18961 raft_consensus.cc:2243] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.018378 18961 raft_consensus.cc:2272] T b61ab1d4b34a4686bbabf04d852203cf P 30db6569e3354597b9c74a961b09980f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.066728 18961 tablet_server.cc:196] TabletServer@127.18.132.67:0 shutdown complete.
I20260709 12:23:09.113427 18961 master.cc:562] Master@127.18.132.126:40431 shutting down...
I20260709 12:23:09.140213 18961 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.140961 18961 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.141333 18961 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6184f374be9a46069d73f958c1513bfa: stopping tablet replica
I20260709 12:23:09.164029 18961 master.cc:584] Master@127.18.132.126:40431 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21935 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44744 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (440492 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:23:09.227963 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2264 messages since previous log ~33 seconds ago
I20260709 12:23:09.228248 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2268 messages since previous log ~33 seconds ago
I20260709 12:23:09.228438 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2268 messages since previous log ~33 seconds ago
I20260709 12:23:09.228672 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:23:09.228879 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:23:09.229104 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~97 seconds ago
I20260709 12:23:09.229336 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~144 seconds ago
I20260709 12:23:09.229528 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 3 messages since previous log ~292 seconds ago
I20260709 12:23:09.229857 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 13 messages since previous log ~0 seconds ago
I20260709 12:23:09.230206 18961 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~20 seconds ago
